Question sequencing. In general, questions should flow logically from one to the next.
To achieve the best response rates, questions should flow from the least sensitive to the most
sensitive, from the factual and behavioral to the attitudinal, and from the more general to the
more specific. Some general rules for question sequencing:
Start with easy non-threatening questions that can be easily recalled. Good options are
demographics (age, gender, education level) for individual-level surveys and
firmographics (employee count, annual revenues, industry) for firm-level surveys.
Never start with an open ended question.
If following an historical sequence of events, follow a chronological order from earliest
to latest.
Ask about one topic at a time. When switching topics, use a transition, such as “The next
section examines your opinions about …”
Use filter or contingency questions as needed, such as: “If you answered “yes” to
question 5, please proceed to Section 2. If you answered “no” go to Section 3.”
Other golden rules. Do unto your respondents what you would have them do unto
you. Be attentive and appreciative of respondents’ time, attention, trust, and confidentiality of
personal information. Always practice the following strategies for all survey research:
People’s time is valuable. Be respectful of their time. Keep your survey as short as
possible and limit it to what is absolutely necessary. Respondents do not like spending
more than 10-15 minutes on any survey, no matter how important it is. Longer surveys
tend to dramatically lower response rates.
Always assure respondents about the confidentiality of their responses, and how you
will use their data (e.g., for academic research) and how the results will be reported
(usually, in the aggregate).
For organizational surveys, assure respondents that you will send them a copy of the
final results, and make sure that you follow up with your promise.
Thank your respondents for their participation in your study.
78 | S o c i a l S c i e n c e R e s e a r c h
Finally, always pretest your questionnaire, at least using a convenience sample, before
administering it to respondents in a field setting. Such pretesting may uncover
ambiguity, lack of clarity, or biases in question wording, which should be eliminated
before administering to the intended sample.
Interview Survey
Interviews are a more personalized form of data collection method than questionnaires,
and are conducted by trained interviewers using the same research protocol as questionnaire
surveys (i.e., a standardized set of questions). However, unlike a questionnaire, the interview
script may contain special instructions for the interviewer that is not seen by respondents, and
may include space for the interviewer to record personal observations and comments. In
addition, unlike mail surveys, the interviewer has the opportunity to clarify any issues raised by
the respondent or ask probing or follow-up questions. However, interviews are timeconsuming
and resource-intensive. Special interviewing skills are needed on part of the
interviewer. The interviewer is also considered to be part of the measurement instrument, and
must proactively strive not to artificially bias the observed responses.
The most typical form of interview is personal or face-to-face interview, where the
interviewer works directly with the respondent to ask questions and record their responses.
Personal interviews may be conducted at the respondent’s home or office location. This
approach may even be favored by some respondents, while others may feel uncomfortable in
allowing a stranger in their homes. However, skilled interviewers can persuade respondents to
cooperate, dramatically improving response rates.
A variation of the personal interview is a group interview, also called focus group. In
this technique, a small group of respondents (usually 6-10 respondents) are interviewed
together in a common location. The interviewer is essentially a facilitator whose job is to lead
the discussion, and ensure that every person has an opportunity to respond. Focus groups
allow deeper examination of complex issues than other forms of survey research, because when
people hear others talk, it often triggers responses or ideas that they did not think about before.
However, focus group discussion may be dominated by a dominant personality, and some
individuals may be reluctant to voice their opinions in front of their peers or superiors,
especially while dealing with a sensitive issue such as employee underperformance or office
politics. Because of their small sample size, focus groups are usually used for exploratory
research rather than descriptive or explanatory research.
A third type of interview survey is telephone interviews. In this technique,
interviewers contact potential respondents over the phone, typically based on a random
selection of people from a telephone directory, to ask a standard set of survey questions. A
more recent and technologically advanced approach is computer-assisted telephone
interviewing (CATI), increasing being used by academic, government, and commercial survey
researchers, where the interviewer is a telephone operator, who is guided through the
interview process by a computer program displaying instructions and questions to be asked on
a computer screen. The system also selects respondents randomly using a random digit dialing
S u r v e y R e s e a r c h | 79
technique, and records responses using voice capture technology. Once respondents are on the
phone, higher response rates can be obtained. This technique is not ideal for rural areas where
telephone density is low, and also cannot be used for communicating non-audio information
such as graphics or product demonstrations.
Role of interviewer. The interviewer has a complex and multi-faceted role in the
interview process, which includes the following tasks:
Prepare for the interview: Since the interviewer is in the forefront of the data collection
effort, the quality of data collected depends heavily on how well the interviewer is
trained to do the job. The interviewer must be trained in the interview process and the
survey method, and also be familiar with the purpose of the study, how responses will
be stored and used, and sources of interviewer bias. He/she should also rehearse and
time the interview prior to the formal study.
Locate and enlist the cooperation of respondents: Particularly in personal, in-home
surveys, the interviewer must locate specific addresses, and work around respondents’
schedule sometimes at undesirable times such as during weekends. They should also be
like a salesperson, selling the idea of participating in the study.
Motivate respondents: Respondents often feed off the motivation of the interviewer. If
the interviewer is disinterested or inattentive, respondents won’t be motivated to
provide useful or informative responses either. The interviewer must demonstrate
enthusiasm about the study, communicate the importance of the research to
respondents, and be attentive to respondents’ needs throughout the interview.
Clarify any confusion or concerns: Interviewers must be able to think on their feet and
address unanticipated concerns or objections raised by respondents to the respondents’
satisfaction. Additionally, they should ask probing questions as necessary even if such
questions are not in the script.
Observe quality of response: The interviewer is in the best position to judge the quality
of information collected, and may supplement responses obtained using personal
observations of gestures or body language as appropriate.
Conducting the interview. Before the interview, the interviewer should prepare a kit
to carry to the interview session, consisting of a cover letter from the principal investigator or
sponsor, adequate copies of the survey instrument, photo identification, and a telephone
number for respondents to call to verify the interviewer’s authenticity. The interviewer should
also try to call respondents ahead of time to set up an appointment if possible. To start the
interview, he/she should speak in an imperative and confident tone, such as “I’d like to take a
few minutes of your time to interview you for a very important study,” instead of “May I come in
to do an interview?” He/she should introduce himself/herself, present personal credentials,
explain the purpose of the study in 1-2 sentences, and assure confidentiality of respondents’
comments and voluntariness of their participation, all in less than a minute. No big words or
jargon should be used, and no details should be provided unless specifically requested. If the
interviewer wishes to tape-record the interview, he/she should ask for respondent’s explicit
permission before doing so. Even if the interview is recorded, the interview must take notes on
key issues, probes, or verbatim phrases.
During the interview, the interviewer should follow the questionnaire script and ask
questions exactly as written, and not change the words to make the question sound friendlier.
They should also not change the order of questions or skip any question that may have b
Add Your Gadget Here
HIGHLIGHT OF THE WEEK
-
Survey Research Survey research a research method involving the use of standardized questionnaires or interviews to collect data about peop...
-
Inter-rater reliability. Inter-rater reliability, also called inter-observer reliability, is a measure of consistency between two or more i...
-
discriminant validity is exploratory factor analysis. This is a data reduction technique which aggregates a given set of items to a smalle...
-
can estimate parameters of this line, such as its slope and intercept from the GLM. From highschool algebra, recall that straight lines can...
-
Positivist Case Research Exemplar Case research can also be used in a positivist manner to test theories or hypotheses. Such studies are ra...
-
Quantitative Analysis: Descriptive Statistics Numeric data collected in a research project can be analyzed quantitatively using statistical...
-
Probability Sampling Probability sampling is a technique in which every unit in the population has a chance (non-zero probability) of being...
-
Experimental Research Experimental research, often considered to be the “gold standard” in research designs, is one of the most rigorous of...
-
Bivariate Analysis Bivariate analysis examines how two variables are related to each other. The most common bivariate statistic is the biva...
-
Case Research Case research, also called case study, is a method of intensively studying a phenomenon over time within its natural setting ...
Sunday, 13 March 2016
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment