selectively sampled to validate the central category and its relationships to other categories
(i.e., the tentative theory). Selective coding limits the range of analysis, and makes it move fast.
At the same time, the coder must watch out for other categories that may emerge from the new
data that may be related to the phenomenon of interest (open coding), which may lead to
further refinement of the initial theory. Hence, open, axial, and selective coding may proceed
simultaneously. Coding of new data and theory refinement continues until theoretical
saturation is reached, i.e., when additional data does not yield any marginal change in the core
categories or the relationships.
The “constant comparison” process implies continuous rearrangement, aggregation, and
refinement of categories, relationships, and interpretations based on increasing depth of
understanding, and an iterative interplay of four stages of activities: (1) comparing
incidents/texts assigned to each category (to validate the category), (2) integrating categories
and their properties, (3) delimiting the theory (focusing on the core concepts and ignoring less
relevant concepts), and (4) writing theory (using techniques like memoing, storylining, and
diagramming that are discussed in the next chapter). Having a central category does not
necessarily mean that all other categories can be integrated nicely around it. In order to
identify key categories that are conditions, action/interactions, and consequences of the core
category, Strauss and Corbin (1990) recommend several integration techniques, such as
storylining, memoing, or concept mapping. In storylining, categories and relationships are
used to explicate and/or refine a story of the observed phenomenon. Memos are theorized
write-ups of ideas about substantive concepts and their theoretically coded relationships as
they evolve during ground theory analysis, and are important tools to keep track of and refine
ideas that develop during the analysis. Memoing is the process of using these memos to
discover patterns and relationships between categories using two-by-two tables, diagrams, or
figures, or other illustrative displays. Concept mapping is a graphical representation of
concepts and relationships between those concepts (e.g., using boxes and arrows). The major
concepts are typically laid out on one or more sheets of paper, blackboards, or using graphical
software programs, linked to each other using arrows, and readjusted to best fit the observed
data.
After a grounded theory is generated, it must be refined for internal consistency and
logic. Researchers must ensure that the central construct has the stated characteristics and
dimensions, and if not, the data analysis may be repeated. Researcher must then ensure that
the characteristics and dimensions of all categories show variation. For example, if behavior
frequency is one such category, then the data must provide evidence of both frequent
performers and infrequent performers of the focal behavior. Finally, the theory must be
validated by comparing it with raw data. If the theory contradicts with observed evidence, the
coding process may be repeated to reconcile such contradictions or unexplained variations.
Content Analysis
Content analysis is the systematic analysis of the content of a text (e.g., who says what,
to whom, why, and to what extent and with what effect) in a quantitative or qualitative manner.
Content analysis typically conducted as follows. First, when there are many texts to analyze
(e.g., newspaper stories, financial reports, blog postings, online reviews, etc.), the researcher
begins by sampling a selected set of texts from the population of texts for analysis. This process
is not random, but instead, texts that have more pertinent content should be chosen selectively.
Second, the researcher identifies and applies rules to divide each text into segments or “chunks”
that can be treated as separate units of analysis. This process is called unitizing. For example,
116 | S o c i a l S c i e n c e R e s e a r c h
assumptions, effects, enablers, and barriers in texts may constitute such units. Third, the
researcher constructs and applies one or more concepts to each unitized text segment in a
process called coding. For coding purposes, a coding scheme is used based on the themes the
researcher is searching for or uncovers as she classifies the text. Finally, the coded data is
analyzed, often both quantitatively and qualitatively, to determine which themes occur most
frequently, in what contexts, and how they are related to each other.
A simple type of content analysis is sentiment analysis – a technique used to capture
people’s opinion or attitude toward an object, person, or phenomenon. Reading online
messages about a political candidate posted on an online forum and classifying each message as
positive, negative, or neutral is an example of such an analysis. In this case, each message
represents one unit of analysis. This analysis will help identify whether the sample as a whole
is positively or negatively disposed or neutral towards that candidate. Examining the content of
online reviews in a similar manner is another example. Though this analysis can be done
manually, for very large data sets (millions of text records), natural language processing and
text analytics based software programs are available to automate the coding process, and
maintain a record of how people sentiments fluctuate with time.
A frequent criticism of content analysis is that it lacks a set of systematic procedures
that would allow the analysis to be replicated by other researchers. Schilling (2006)20
addressed this criticism by organizing different content analytic procedures into a spiral model.
This model consists of five levels or phases in interpreting text: (1) convert recorded tapes into
raw text data or transcripts for content analysis, (2) convert raw data into condensed protocols,
(3) convert condensed protocols into a preliminary category system, (4) use the preliminary
category system to generate coded protocols, and (5) analyze coded protocols to generate
interpretations about the phenomenon of interest.
Content analysis has several limitations. First, the coding process is restricted to the
information available in text form. For instance, if a researcher is interested in studying
people’s views on capital punishment, but no such archive of text documents is available, then
the analysis cannot be done. Second, sampling must be done carefully to avoid sampling bias.
For instance, if your population is the published research literature on a given topic, then you
have systematically omitted unpublished research or the most recent work that is yet to be
published.
Add Your Gadget Here
HIGHLIGHT OF THE WEEK
-
Positivist Case Research Exemplar Case research can also be used in a positivist manner to test theories or hypotheses. Such studies are ra...
-
Univariate Analysis Univariate analysis, or analysis of a single variable, refers to a set of statistical techniques that can describe the ...
-
can estimate parameters of this line, such as its slope and intercept from the GLM. From highschool algebra, recall that straight lines can...
-
Quantitative Analysis: Inferential Statistics Inferential statistics are the statistical procedures that are used to reach conclusions abou...
-
Biases in Survey Research Despite all of its strengths and advantages, survey research is often tainted with systematic biases that may inv...
-
selectively sampled to validate the central category and its relationships to other categories (i.e., the tentative theory). Selective codi...
-
Survey Research Survey research a research method involving the use of standardized questionnaires or interviews to collect data about peop...
-
Case Research Case research, also called case study, is a method of intensively studying a phenomenon over time within its natural setting ...
-
subjected to correlational analysis or exploratory factor analysis using a software program such as SAS or SPSS for assessment of convergen...
-
Non-Probability Sampling Nonprobability sampling is a sampling technique in which some units of the population have zero chance of selectio...
Sunday, 13 March 2016
Qualitative Analysis
Qualitative analysis is the analysis of qualitative data such as text data from interview
transcripts. Unlike quantitative analysis, which is statistics driven and largely independent of
the researcher, qualitative analysis is heavily dependent on the researcher’s analytic and
integrative skills and personal knowledge of the social context where the data is collected. The
emphasis in qualitative analysis is “sense making” or understanding a phenomenon, rather than
predicting or explaining. A creative and investigative mindset is needed for qualitative analysis,
based on an ethically enlightened and participant-in-context attitude, and a set of analytic
strategies. This chapter provides a brief overview of some of these qualitative analysis
strategies. Interested readers are referred to more authoritative and detailed references such
as Miles and Huberman’s (1984)17 seminal book on this topic.
Grounded Theory
How can you analyze a vast set qualitative data acquired through participant
observation, in-depth interviews, focus groups, narratives of audio/video recordings, or
secondary documents? One of these techniques for analyzing text data is grounded theory –
an inductive technique of interpreting recorded data about a social phenomenon to build
theories about that phenomenon. The technique was developed by Glaser and Strauss (1967)18
in their method of constant comparative analysis of grounded theory research, and further
refined by Strauss and Corbin (1990)19 to further illustrate specific coding techniques – a
process of classifying and categorizing text data segments into a set of codes (concepts),
categories (constructs), and relationships. The interpretations are “grounded in” (or based on)
observed empirical data, hence the name. To ensure that the theory is based solely on observed
evidence, the grounded theory approach requires that researchers suspend any preexisting
theoretical expectations or biases before data analysis, and let the data dictate the formulation
of the theory.
Strauss and Corbin (1998) describe three coding techniques for analyzing text data:
open, axial, and selective. Open coding is a process aimed at identifying concepts or key ideas
17 Miles M. B., Huberman A. M. (1984). Qualitative Data Analysis: A Sourcebook of New Methods. Newbury
Park, CA: Sage Publications.
18 Glaser, B. and Strauss, A. (1967). The Discovery of Grounded Theory: Strategies for Qualitative Research,
Chicago: Aldine.
19 Strauss, A. and Corbin, J. (1990). Basics of Qualitative Research: Grounded Theory Procedures and
Techniques, Beverly Hills, CA: Sage Publications.
114 | S o c i a l S c i e n c e R e s e a r c h
that are hidden within textual data, which are potentially related to the phenomenon of interest.
The researcher examines the raw textual data line by line to identify discrete events, incidents,
ideas, actions, perceptions, and interactions of relevance that are coded as concepts (hence
called in vivo codes). Each concept is linked to specific portions of the text (coding unit) for later
validation. Some concepts may be simple, clear, and unambiguous while others may be
complex, ambiguous, and viewed differently by different participants. The coding unit may vary
with the concepts being extracted. Simple concepts such as “organizational size” may include
just a few words of text, while complex ones such as “organizational mission” may span several
pages. Concepts can be named using the researcher’s own naming convention or standardized
labels taken from the research literature. Once a basic set of concepts are identified, these
concepts can then be used to code the remainder of the data, while simultaneously looking for
new concepts and refining old concepts. While coding, it is important to identify the
recognizable characteristics of each concept, such as its size, color, or level (e.g., high or low), so
that similar concepts can be grouped together later. This coding technique is called “open”
because the researcher is open to and actively seeking new concepts relevant to the
phenomenon of interest.
Next, similar concepts are grouped into higher order categories. While concepts may
be context-specific, categories tend to be broad and generalizable, and ultimately evolve into
constructs in a grounded theory. Categories are needed to reduce the amount of concepts the
researcher must work with and to build a “big picture” of the issues salient to understanding a
social phenomenon. Categorization can be done is phases, by combining concepts into
subcategories, and then subcategories into higher order categories. Constructs from the
existing literature can be used to name these categories, particularly if the goal of the research
is to extend current theories. However, caution must be taken while using existing constructs,
as such constructs may bring with them commonly held beliefs and biases. For each category,
its characteristics (or properties) and dimensions of each characteristic should be identified.
The dimension represents a value of a characteristic along a continuum. For example, a
“communication media” category may have a characteristic called “speed”, which can be
dimensionalized as fast, medium, or slow. Such categorization helps differentiate between
different kinds of communication media and enables researchers identify patterns in the data,
such as which communication media is used for which types of tasks.
The second phase of grounded theory is axial coding, where the categories and
subcategories are assembled into causal relationships or hypotheses that can tentatively
explain the phenomenon of interest. Although distinct from open coding, axial coding can be
performed simultaneously with open coding. The relationships between categories may be
clearly evident in the data or may be more subtle and implicit. In the latter instance,
researchers may use a coding scheme (often called a “coding paradigm”, but different from the
paradigms discussed in Chapter 3) to understand which categories represent conditions (the
circumstances in which the phenomenon is embedded), actions/interactions (the responses of
individuals to events under these conditions), and consequences (the outcomes of actions/
interactions). As conditions, actions/interactions, and consequences are identified, theoretical
propositions start to emerge, and researchers can start explaining why a phenomenon occurs,
under what conditions, and with what consequences.
The third and final phase of grounded theory is selective coding, which involves
identifying a central category or a core variable and systematically and logically relating this
central category to other categories. The central category can evolve from existing categories
or can be a higher order category that subsumes previously coded categories.
Rigor in Interpretive Research
While positivist research employs a “reductionist” approach by simplifying social reality
into parsimonious theories and laws, interpretive research attempts to interpret social reality
through the subjective viewpoints of the embedded participants within the context where the
reality is situated. These interpretations are heavily contextualized, and are naturally less
generalizable to other contexts. However, because interpretive analysis is subjective and
sensitive to the experiences and insight of the embedded researcher, it is often considered less
rigorous by many positivist (functionalist) researchers. Because interpretive research is based
on different set of ontological and epistemological assumptions about social phenomenon than
positivist research, the positivist notions of rigor, such as reliability, internal validity, and
generalizability, do not apply in a similar manner. However, Lincoln and Guba (1985)16 provide
an alternative set of criteria that can be used to judge the rigor of interpretive research.
Dependability. Interpretive research can be viewed as dependable or authentic if two
researchers assessing the same phenomenon using the same set of evidence independently
arrive at the same conclusions or the same researcher observing the same or a similar
phenomenon at different times arrives at similar conclusions. This concept is similar to that of
reliability in positivist research, with agreement between two independent researchers being
similar to the notion of inter-rater reliability, and agreement between two observations of the
same phenomenon by the same researcher akin to test-retest reliability. To ensure
dependability, interpretive researchers must provide adequate details about their phenomenon
of interest and the social context in which it is embedded so as to allow readers to
independently authenticate their interpretive inferences.
Credibility. Interpretive research can be considered credible if readers find its
inferences to be believable. This concept is akin to that of internal validity in functionalistic
research. The credibility of interpretive research can be improved by providing evidence of the
researcher’s extended engagement in the field, by demonstrating data triangulation across
subjects or data collection techniques, and by maintaining meticulous data management and
analytic procedures, such as verbatim transcription of interviews, accurate records of contacts
and interviews, and clear notes on theoretical and methodological decisions, that can allow an
independent audit of data collection and analysis if needed.
Confirmability. Confirmability refers to the extent to which the findings reported in
interpretive research can be independently confirmed by others (typically, participants). This
is similar to the notion of objectivity in functionalistic research. Since interpretive research
rejects the notion of an objective reality, confirmability is demonstrated in terms of “inter-
16 Lincoln, Y. S., and Guba, E. G. (1985). Naturalistic Inquiry. Beverly Hills, CA: Sage Publications.
I n t e r p r e t i v e R e s e a r c h | 111
subjectivity”, i.e., if the study’s participants agree with the inferences derived by the researcher.
For instance, if a study’s participants generally agree with the inferences drawn by a researcher
about a phenomenon of interest (based on a review of the research paper or report), then the
findings can be viewed as confirmable.
Transferability. Transferability in interpretive research refers to the extent to which
the findings can be generalized to other settings. This idea is similar to that of external validity
in functionalistic research. The researcher must provide rich, detailed descriptions of the
research context (“thick description”) and thoroughly describe the structures, assumptions, and
processes revealed from the data so that readers can independently assess whether and to what
extent are the reported findings transferable to other settings.
Interpretive Data Collection
Data is collected in interpretive research using a variety of techniques. The most
frequently used technique is interviews (face-to-face, telephone, or focus groups). Interview
types and strategies are discussed in detail in a previous chapter on survey research. A second
technique is observation. Observational techniques include direct observation, where the
researcher is a neutral and passive external observer and is not involved in the phenomenon of
interest (as in case research), and participant observation, where the researcher is an active
I n t e r p r e t i v e R e s e a r c h | 107
participant in the phenomenon and her inputs or mere presence influence the phenomenon
being studied (as in action research). A third technique is documentation, where external and
internal documents, such as memos, electronic mails, annual reports, financial statements,
newspaper articles, websites, may be used to cast further insight into the phenomenon of
interest or to corroborate other forms of evidence.
Interpretive Research Designs
Case research. As discussed in the previous chapter, case research is an intensive
longitudinal study of a phenomenon at one or more research sites for the purpose of deriving
detailed, contextualized inferences and understanding the dynamic process underlying a
phenomenon of interest. Case research is a unique research design in that it can be used in an
interpretive manner to build theories or in a positivist manner to test theories. The previous
chapter on case research discusses both techniques in depth and provides illustrative
exemplars. Furthermore, the case researcher is a neutral observer (direct observation) in the
social setting rather than an active participant (participant observation). As with any other
interpretive approach, drawing meaningful inferences from case research depends heavily on
the observational skills and integrative abilities of the researcher.
Action research. Action research is a qualitative but positivist research design aimed
at theory testing rather than theory building (discussed in this chapter due to lack of a proper
space). This is an interactive design that assumes that complex social phenomena are best
understood by introducing changes, interventions, or “actions” into those phenomena and
observing the outcomes of such actions on the phenomena of interest. In this method, the
researcher is usually a consultant or an organizational member embedded into a social context
(such as an organization), who initiates an action in response to a social problem, and examines
how her action influences the phenomenon while also learning and generating insights about
the relationship between the action and the phenomenon. Examples of actions may include
organizational change programs, such as the introduction of new organizational processes,
procedures, people, or technology or replacement of old ones, initiated with the goal of
improving an organization’s performance or profitability in its business environment. The
researcher’s choice of actions must be based on theory, which should explain why and how such
actions may bring forth the desired social change. The theory is validated by the extent to
which the chosen action is successful in remedying the targeted problem. Simultaneous
problem solving and insight generation is the central feature that distinguishes action research
from other research methods (which may not involve problem solving) and from consulting
(which may not involve insight generation). Hence, action research is an excellent method for
bridging research and practice.
There are several variations of the action research method. The most popular of these
method is the participatory action research, designed by Susman and Evered (1978)13. This
method follows an action research cycle consisting of five phases: (1) diagnosing, (2) action
planning, (3) action taking, (4) evaluating, and (5) learning (see Figure 10.1). Diagnosing
involves identifying and defining a problem in its social context. Action planning involves
identifying and evaluating alternative solutions to the problem, and deciding on a future course
of action (based on theoretical rationale). Action taking is the implementation of the planned
course of action. The evaluation stage examines the extent to which the initiated action is
13 Susman, G.I. and Evered, R.D. (1978). “An Assessment of the Scientific Merits of Action Research,”
Administrative Science Quarterly, (23), 582-603.
108 | S o c i a l S c i e n c e R e s e a r c h
successful in resolving the original problem, i.e., whether theorized effects are indeed realized
in practice. In the learning phase, the experiences and feedback from action evaluation are used
to generate insights about the problem and suggest future modifications or improvements to
the action. Based on action evaluation and learning, the action may be modified or adjusted to
address the problem better, and the action research cycle is repeated with the modified action
sequence. It is suggested that the entire action research cycle be traversed at least twice so that
learning from the first cycle can be implemented in the second cycle. The primary mode of data
collection is participant observation, although other techniques such as interviews and
documentary evidence may be used to corroborate the researcher’s observations.
Figure 10.1. Action research cycle
Ethnography. The ethnographic research method, derived largely from the field of
anthropology, emphasizes studying a phenomenon within the context of its culture. The
researcher must be deeply immersed in the social culture over an extended period of time
(usually 8 months to 2 years) and should engage, observe, and record the daily life of the
studied culture and its social participants within their natural setting. The primary mode of
data collection is participant observation, and data analysis involves a “sense-making”
approach. In addition, the researcher must take extensive field notes, and narrate her
experience in descriptive detail so that readers may experience the same culture as the
researcher. In this method, the researcher has two roles: rely on her unique knowledge and
engagement to generate insights (theory), and convince the scientific community of the transsituational
nature of the studied phenomenon.
The classic example of ethnographic research is Jane Goodall’s study of primate
behaviors, where she lived with chimpanzees in their natural habitat at Gombe National Park in
Tanzania, observed their behaviors, interacted with them, and shared their lives. During that
process, she learnt and chronicled how chimpanzees seek food and shelter, how they socialize
with each other, their communication patterns, their mating behaviors, and so forth. A more
contemporary example of ethnographic research is Myra Bluebond-Langer’s (1996)14 study of
decision making in families with children suffering from life-threatening illnesses, and the
physical, psychological, environmental, ethical, legal, and cultural issues that influence such
decision-making. The researcher followed the experiences of approximately 80 children with
14 Bluebond-Langer, M. (1996). In the Shadow of Illness: Parents and Siblings of the Chronically Ill Child.
Princeton, NJ: Princeton University Press.
I n t e r p r e t i v e R e s e a r c h | 109
incurable illnesses and their families for a period of over two years. Data collection involved
participant observation and formal/informal conversations with children, their parents and
relatives, and health care providers to document their lived experience.
Phenomenology. Phenomenology is a research method that emphasizes the study of
conscious experiences as a way of understanding the reality around us. It is based on the ideas
of German philosopher Edmund Husserl in the early 20th century who believed that human
experience is the source of all knowledge. Phenomenology is concerned with the systematic
reflection and analysis of phenomena associated with conscious experiences, such as human
judgment, perceptions, and actions, with the goal of (1) appreciating and describing social
reality from the diverse subjective perspectives of the participants involved, and (2)
understanding the symbolic meanings (“deep structure”) underlying these subjective
experiences. Phenomenological inquiry requires that researchers eliminate any prior
assumptions and personal biases, empathize with the participant’s situation, and tune into
existential dimensions of that situation, so that they can fully understand the deep structures
that drives the conscious thinking, feeling, and behavior of the studied participants
Benefits and Challenges of Interpretive Research
Interpretive research has several unique advantages. First, they are well-suited for
exploring hidden reasons behind complex, interrelated, or multifaceted social processes, such
as inter-firm relationships or inter-office politics, where quantitative evidence may be biased,
inaccurate, or otherwise difficult to obtain. Second, they are often helpful for theory
construction in areas with no or insufficient a priori theory. Third, they are also appropriate for
studying context-specific, unique, or idiosyncratic events or processes. Fourth, interpretive
research can also help uncover interesting and relevant research questions and issues for
follow-up research.
At the same time, interpretive research also has its own set of challenges. First, this
type of research tends to be more time and resource intensive than positivist research in data
collection and analytic efforts. Too little data can lead to false or premature assumptions, while
too much data may not be effectively processed by the researcher. Second, interpretive
research requires well-trained researchers who are capable of seeing and interpreting complex
social phenomenon from the perspectives of the embedded participants and reconciling the
diverse perspectives of these participants, without injecting their personal biases or
preconceptions into their inferences. Third, all participants or data sources may not be equally
credible, unbiased, or knowledgeable about the phenomenon of interest, or may have
undisclosed political agendas, which may lead to misleading or false impressions. Inadequate
trust between participants and researcher may hinder full and honest self-representation by
participants, and such trust building takes time. It is the job of the interpretive researcher to
“see through the smoke” (hidden or biased agendas) and understand the true nature of the
problem. Fourth, given the heavily contextualized nature of inferences drawn from interpretive
research, such inferences do not lend themselves well to replicability or generalizability.
Finally, interpretive research may sometimes fail to answer the research questions of interest
or predict future behaviors.
Characteristics of Interpretive Research
All interpretive research must adhere to a common set of principles, as described below.
Naturalistic inquiry: Social phenomena must be studied within their natural setting.
Because interpretive research assumes that social phenomena are situated within and cannot
106 | S o c i a l S c i e n c e R e s e a r c h
be isolated from their social context, interpretations of such phenomena must be grounded
within their socio-historical context. This implies that contextual variables should be observed
and considered in seeking explanations of a phenomenon of interest, even though context
sensitivity may limit the generalizability of inferences.
Researcher as instrument: Researchers are often embedded within the social context
that they are studying, and are considered part of the data collection instrument in that they
must use their observational skills, their trust with the participants, and their ability to extract
the correct information. Further, their personal insights, knowledge, and experiences of the
social context is critical to accurately interpreting the phenomenon of interest. At the same
time, researchers must be fully aware of their personal biases and preconceptions, and not let
such biases interfere with their ability to present a fair and accurate portrayal of the
phenomenon.
Interpretive analysis: Observations must be interpreted through the eyes of the
participants embedded in the social context. Interpretation must occur at two levels. The first
level involves viewing or experiencing the phenomenon from the subjective perspectives of the
social participants. The second level is to understand the meaning of the participants’
experiences in order to provide a “thick description” or a rich narrative story of the
phenomenon of interest that can communicate why participants acted the way they did.
Use of expressive language: Documenting the verbal and non-verbal language of
participants and the analysis of such language are integral components of interpretive analysis.
The study must ensure that the story is viewed through the eyes of a person, and not a machine,
and must depict the emotions and experiences of that person, so that readers can understand
and relate to that person. Use of imageries, metaphors, sarcasm, and other figures of speech is
very common in interpretive analysis.
Temporal nature: Interpretive research is often not concerned with searching for
specific answers, but with understanding or “making sense of” a dynamic social process as it
unfolds over time. Hence, such research requires an immersive involvement of the researcher
at the study site for an extended period of time in order to capture the entire evolution of the
phenomenon of interest.
Hermeneutic circle: Interpretive interpretation is an iterative process of moving back
and forth from pieces of observations (text) to the entirety of the social phenomenon (context)
to reconcile their apparent discord and to construct a theory that is consistent with the diverse
subjective viewpoints and experiences of the embedded participants. Such iterations between
the understanding/meaning of a phenomenon and observations must continue until
“theoretical saturation” is reached, whereby any additional iteration does not yield any more
insight into the phenomenon of interes
Subscribe to:
Posts (Atom)