subjected to correlational analysis or exploratory factor analysis using a software program such
as SAS or SPSS for assessment of convergent and discriminant validity. Items that do not meet
the expected norms of factor loading (same-factor loadings higher than 0.60, and cross-factor
loadings less than 0.30) should be dropped at this stage. The remaining scales are evaluated for
reliability using a measure of internal consistency such as Cronbach alpha. Scale dimensionality
may also be verified at this stage, depending on whether the targeted constructs were
conceptualized as being unidimensional or multi-dimensional. Next, evaluate the predictive
ability of each construct within a theoretically specified nomological network of construct using
regression analysis or structural equation modeling. If the construct measures satisfy most or
all of the requirements of reliability and validity described in this chapter, we can be assured
that our operationalized measures are reasonably adequate and accurate.
The integrated approach to measurement validation discussed here is quite demanding
of researcher time and effort. Nonetheless, this elaborate multi-stage process is needed to
ensure that measurement scales used in our research meets the expected norms of scientific
research. Because inferences drawn using flawed or compromised scales are meaningless, scale
validation and measurement remains one of the most important and involved phase of
empirical research.
65
Chapter 8
Sampling
Sampling is the statistical process of selecting a subset (called a “sample”) of a
population of interest for purposes of making observations and statistical inferences about
that population. Social science research is generally about inferring patterns of behaviors
within specific populations. We cannot study entire populations because of feasibility and cost
constraints, and hence, we must select a representative sample from the population of interest
for observation and analysis. It is extremely important to choose a sample that is truly
representative of the population so that the inferences derived from the sample can be
generalized back to the population of interest. Improper and biased sampling is the primary
reason for often divergent and erroneous inferences reported in opinion polls and exit polls
conducted by different polling groups such as CNN/Gallup Poll, ABC, and CBS, prior to every U.S.
Presidential elections.
The Sampling Process
Figure 8.1. The sampling process
The sampling process comprises of several stage. The first stage is defining the target
population. A population can be defined as all people or items (unit of analysis) with the
characteristics that one wishes to study. The unit of analysis may be a person, group,
66 | S o c i a l S c i e n c e R e s e a r c h
organization, country, object, or any other entity that you wish to draw scientific inferences
about. Sometimes the population is obvious. For example, if a manufacturer wants to
determine whether finished goods manufactured at a production line meets certain quality
requirements or must be scrapped and reworked, then the population consists of the entire set
of finished goods manufactured at that production facility. At other times, the target population
may be a little harder to understand. If you wish to identify the primary drivers of academic
learning among high school students, then what is your target population: high school students,
their teachers, school principals, or parents? The right answer in this case is high school
students, because you are interested in their performance, not the performance of their
teachers, parents, or schools. Likewise, if you wish to analyze the behavior of roulette wheels to
identify biased wheels, your population of interest is not different observations from a single
roulette wheel, but different roulette wheels (i.e., their behavior over an infinite set of wheels).
The second step in the sampling process is to choose a sampling frame. This is an
accessible section of the target population (usually a list with contact information) from where
a sample can be drawn. If your target population is professional employees at work, because
you cannot access all professional employees around the world, a more realistic sampling frame
will be employee lists of one or two local companies that are willing to participate in your study.
If your target population is organizations, then the Fortune 500 list of firms or the Standard &
Poor’s (S&P) list of firms registered with the New York Stock exchange may be acceptable
sampling frames.
Note that sampling frames may not entirely be representative of the population at large,
and if so, inferences derived by such a sample may not be generalizable to the population. For
instance, if your target population is organizational employees at large (e.g., you wish to study
employee self-esteem in this population) and your sampling frame is employees at automotive
companies in the American Midwest, findings from such groups may not even be generalizable
to the American workforce at large, let alone the global workplace. This is because the
American auto industry has been under severe competitive pressures for the last 50 years and
has seen numerous episodes of reorganization and downsizing, possibly resulting in low
employee morale and self-esteem. Furthermore, the majority of the American workforce is
employed in service industries or in small businesses, and not in automotive industry. Hence, a
sample of American auto industry employees is not particularly representative of the American
workforce. Likewise, the Fortune 500 list includes the 500 largest American enterprises, which
is not representative of all American firms in general, most of which are medium and smallsized
firms rather than large firms, and is therefore, a biased sampling frame. In contrast, the
S&P list will allow you to select large, medium, and/or small companies, depending on whether
you use the S&P large-cap, mid-cap, or small-cap lists, but includes publicly traded firms (and
not private firms) and hence still biased. Also note that the population from which a sample is
drawn may not necessarily be the same as the population about which we actually want
information. For example, if a researcher wants to the success rate of a new “quit smoking”
program, then the target population is the universe of smokers who had access to this program,
which may be an unknown population. Hence, the researcher may sample patients arriving at a
local medical facility for smoking cessation treatment, some of whom may not have had
exposure to this particular “quit smoking” program, in which case, the sampling frame does not
correspond to the population of interest.
The last step in sampling is choosing a sample from the sampling frame using a welldefined
sampling technique. Sampling techniques can be grouped into two broad categories:
probability (random) sampling and non-probability sampling. Probability sampling is ideal if
Add Your Gadget Here
HIGHLIGHT OF THE WEEK
-
Survey Research Survey research a research method involving the use of standardized questionnaires or interviews to collect data about peop...
-
Inter-rater reliability. Inter-rater reliability, also called inter-observer reliability, is a measure of consistency between two or more i...
-
discriminant validity is exploratory factor analysis. This is a data reduction technique which aggregates a given set of items to a smalle...
-
can estimate parameters of this line, such as its slope and intercept from the GLM. From highschool algebra, recall that straight lines can...
-
Positivist Case Research Exemplar Case research can also be used in a positivist manner to test theories or hypotheses. Such studies are ra...
-
Quantitative Analysis: Descriptive Statistics Numeric data collected in a research project can be analyzed quantitatively using statistical...
-
Probability Sampling Probability sampling is a technique in which every unit in the population has a chance (non-zero probability) of being...
-
Experimental Research Experimental research, often considered to be the “gold standard” in research designs, is one of the most rigorous of...
-
Bivariate Analysis Bivariate analysis examines how two variables are related to each other. The most common bivariate statistic is the biva...
-
Case Research Case research, also called case study, is a method of intensively studying a phenomenon over time within its natural setting ...
Sunday, 13 March 2016
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment