Nonequivalent dependent variable (NEDV) design. This is a single-group pre-post
quasi-experimental design with two outcome measures, where one measure is theoretically
expected to be influenced by the treatment and the other measure is not. For instance, if you
are designing a new calculus curriculum for high school students, this curriculum is likely to
influence students’ posttest calculus scores but not algebra scores. However, the posttest
algebra scores may still vary due to extraneous factors such as history or maturation. Hence,
the pre-post algebra scores can be used as a control measure, while that of pre-post calculus can
be treated as the treatment measure. The design notation, shown in Figure 10.13, indicates the
single group by a single N, followed by pretest O1 and posttest O2 for calculus and algebra for the
same group of students. This design is weak in internal validity, but its advantage lies in not
having to use a separate control group.
An interesting variation of the NEDV design is a pattern matching NEDV design, which
employs multiple outcome variables and a theory that explains how much each variable will be
92 | S o c i a l S c i e n c e R e s e a r c h
affected by the treatment. The researcher can then examine if the theoretical prediction is
matched in actual observations. This pattern-matching technique, based on the degree of
correspondence between theoretical and observed patterns is a powerful way of alleviating
internal validity concerns in the original NEDV design.
Figure 10.13. NEDV design
Perils of Experimental Research
Experimental research is one of the most difficult of research designs, and should not be
taken lightly. This type of research is often best with a multitude of methodological problems.
First, though experimental research requires theories for framing hypotheses for testing, much
of current experimental research is atheoretical. Without theories, the hypotheses being tested
tend to be ad hoc, possibly illogical, and meaningless. Second, many of the measurement
instruments used in experimental research are not tested for reliability and validity, and are
incomparable across studies. Consequently, results generated using such instruments are also
incomparable. Third, many experimental research use inappropriate research designs, such as
irrelevant dependent variables, no interaction effects, no experimental controls, and nonequivalent
stimulus across treatment groups. Findings from such studies tend to lack internal
validity and are highly suspect. Fourth, the treatments (tasks) used in experimental research
may be diverse, incomparable, and inconsistent across studies and sometimes inappropriate for
the subject population. For instance, undergraduate student subjects are often asked to
pretend that they are marketing managers and asked to perform a complex budget allocation
task in which they have no experience or expertise. The use of such inappropriate tasks,
introduces new threats to internal validity (i.e., subject’s performance may be an artifact of the
content or difficulty of the task setting), generates findings that are non-interpretable and
meaningless, and makes integration of findings across studies impossible.
The design of proper experimental treatments is a very important task in experimental
design, because the treatment is the raison d’etre of the experimental method, and must never
be rushed or neglected. To design an adequate and appropriate task, researchers should use
prevalidated tasks if available, conduct treatment manipulation checks to check for the
adequacy of such tasks (by debriefing subjects after performing the assigned task), conduct
pilot tests (repeatedly, if necessary), and if doubt, using tasks that are simpler and familiar for
the respondent sample than tasks that are complex or unfamiliar.
In summary, this chapter introduced key concepts in the experimental design research
method and introduced a variety of true experimental and quasi-experimental designs.
Although these designs vary widely in internal validity, designs with less internal validity
should not be overlooked and may sometimes be useful under specific circumstances and
empirical contingencies.
93
Chapter 11
Case Research
Case research, also called case study, is a method of intensively studying a phenomenon
over time within its natural setting in one or a few sites. Multiple methods of data collection,
such as interviews, observations, prerecorded documents, and secondary data, may be
employed and inferences about the phenomenon of interest tend to be rich, detailed, and
contextualized. Case research can be employed in a positivist manner for the purpose of theory
testing or in an interpretive manner for theory building. This method is more popular in
business research than in other social science disciplines.
Case research has several unique strengths over competing research methods such as
experiments and survey research. First, case research can be used for either theory building or
theory testing, while positivist methods can be used for theory testing only. In interpretive case
research, the constructs of interest need not be known in advance, but may emerge from the
data as the research progresses. Second, the research questions can be modified during the
research process if the original questions are found to be less relevant or salient. This is not
possible in any positivist method after the data is collected. Third, case research can help
derive richer, more contextualized, and more authentic interpretation of the phenomenon of
interest than most other research meth
Add Your Gadget Here
HIGHLIGHT OF THE WEEK
-
Survey Research Survey research a research method involving the use of standardized questionnaires or interviews to collect data about peop...
-
Inter-rater reliability. Inter-rater reliability, also called inter-observer reliability, is a measure of consistency between two or more i...
-
discriminant validity is exploratory factor analysis. This is a data reduction technique which aggregates a given set of items to a smalle...
-
can estimate parameters of this line, such as its slope and intercept from the GLM. From highschool algebra, recall that straight lines can...
-
Positivist Case Research Exemplar Case research can also be used in a positivist manner to test theories or hypotheses. Such studies are ra...
-
Quantitative Analysis: Descriptive Statistics Numeric data collected in a research project can be analyzed quantitatively using statistical...
-
Probability Sampling Probability sampling is a technique in which every unit in the population has a chance (non-zero probability) of being...
-
Experimental Research Experimental research, often considered to be the “gold standard” in research designs, is one of the most rigorous of...
-
Bivariate Analysis Bivariate analysis examines how two variables are related to each other. The most common bivariate statistic is the biva...
-
Case Research Case research, also called case study, is a method of intensively studying a phenomenon over time within its natural setting ...
Sunday, 13 March 2016
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment