Pages

Add Your Gadget Here

HIGHLIGHT OF THE WEEK

Sunday 13 March 2016

Nonequivalent dependent variable (NEDV) design. This is a single-group pre-post quasi-experimental design with two outcome measures, where one measure is theoretically expected to be influenced by the treatment and the other measure is not. For instance, if you are designing a new calculus curriculum for high school students, this curriculum is likely to influence students’ posttest calculus scores but not algebra scores. However, the posttest algebra scores may still vary due to extraneous factors such as history or maturation. Hence, the pre-post algebra scores can be used as a control measure, while that of pre-post calculus can be treated as the treatment measure. The design notation, shown in Figure 10.13, indicates the single group by a single N, followed by pretest O1 and posttest O2 for calculus and algebra for the same group of students. This design is weak in internal validity, but its advantage lies in not having to use a separate control group. An interesting variation of the NEDV design is a pattern matching NEDV design, which employs multiple outcome variables and a theory that explains how much each variable will be 92 | S o c i a l S c i e n c e R e s e a r c h affected by the treatment. The researcher can then examine if the theoretical prediction is matched in actual observations. This pattern-matching technique, based on the degree of correspondence between theoretical and observed patterns is a powerful way of alleviating internal validity concerns in the original NEDV design. Figure 10.13. NEDV design Perils of Experimental Research Experimental research is one of the most difficult of research designs, and should not be taken lightly. This type of research is often best with a multitude of methodological problems. First, though experimental research requires theories for framing hypotheses for testing, much of current experimental research is atheoretical. Without theories, the hypotheses being tested tend to be ad hoc, possibly illogical, and meaningless. Second, many of the measurement instruments used in experimental research are not tested for reliability and validity, and are incomparable across studies. Consequently, results generated using such instruments are also incomparable. Third, many experimental research use inappropriate research designs, such as irrelevant dependent variables, no interaction effects, no experimental controls, and nonequivalent stimulus across treatment groups. Findings from such studies tend to lack internal validity and are highly suspect. Fourth, the treatments (tasks) used in experimental research may be diverse, incomparable, and inconsistent across studies and sometimes inappropriate for the subject population. For instance, undergraduate student subjects are often asked to pretend that they are marketing managers and asked to perform a complex budget allocation task in which they have no experience or expertise. The use of such inappropriate tasks, introduces new threats to internal validity (i.e., subject’s performance may be an artifact of the content or difficulty of the task setting), generates findings that are non-interpretable and meaningless, and makes integration of findings across studies impossible. The design of proper experimental treatments is a very important task in experimental design, because the treatment is the raison d’etre of the experimental method, and must never be rushed or neglected. To design an adequate and appropriate task, researchers should use prevalidated tasks if available, conduct treatment manipulation checks to check for the adequacy of such tasks (by debriefing subjects after performing the assigned task), conduct pilot tests (repeatedly, if necessary), and if doubt, using tasks that are simpler and familiar for the respondent sample than tasks that are complex or unfamiliar. In summary, this chapter introduced key concepts in the experimental design research method and introduced a variety of true experimental and quasi-experimental designs. Although these designs vary widely in internal validity, designs with less internal validity should not be overlooked and may sometimes be useful under specific circumstances and empirical contingencies. 93 Chapter 11 Case Research Case research, also called case study, is a method of intensively studying a phenomenon over time within its natural setting in one or a few sites. Multiple methods of data collection, such as interviews, observations, prerecorded documents, and secondary data, may be employed and inferences about the phenomenon of interest tend to be rich, detailed, and contextualized. Case research can be employed in a positivist manner for the purpose of theory testing or in an interpretive manner for theory building. This method is more popular in business research than in other social science disciplines. Case research has several unique strengths over competing research methods such as experiments and survey research. First, case research can be used for either theory building or theory testing, while positivist methods can be used for theory testing only. In interpretive case research, the constructs of interest need not be known in advance, but may emerge from the data as the research progresses. Second, the research questions can be modified during the research process if the original questions are found to be less relevant or salient. This is not possible in any positivist method after the data is collected. Third, case research can help derive richer, more contextualized, and more authentic interpretation of the phenomenon of interest than most other research meth

No comments:

Post a Comment