Professional Documents
Culture Documents
Solutions Manual
Chapter 10 - Surveys
Chapter 10
Surveys
This chapter focuses on the choices a researcher must make after the communication
approach has been chosen (see Exhibit 10-1 and Exhibit 10-2).
The characteristics and applications of the various communication approaches are discussed,
as well as their individual strengths and weaknesses (summarized in Exhibit 10-5).
KEY TERMS
Key terms are shown in bold, as they appear in the text, throughout the lecture notes.
POWERPOINT
• A complete PowerPoint slide set comes with this chapter. It is organized as the
chapter is organized. Each chapter contains a complete review of chapter concepts
and issues. Each, at minimum, contains the following slides:
o Learning Objectives
o Pull Quote, used to open this chapter
o Exhibit art
o Key Terms
o Additional Discussion Opportunities: Section of slides at the end of the
chapter slide set that you can rearrange within the slide set as desired.
Suggestions for using these slides are in the notes section of each slide or in
10-1
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
the Discussion and Project Ideas section of this manual. This slide section
contains several types of slides, including but not limited to the following:
▪ Additional Pull Quotes from Research Thought Leaders
▪ PulsePoint: statistic drawn from a research project that relates to some
chapter concept
▪ Each Snapshot in the chapter: mini-case that relates to one or more
chapter concepts.
▪ Each PicProfile in the chapter: research related image that relates to
one or more chapter concepts or an emerging concept.
▪ Each CloseUp in the chapter: more in depth profile of a research
concept or project.
TEST BANK
▪ Snapshots
Gamification in Research…discusses the newest trend in obtaining increased
participation and completion rates.
Are Cell Phones and Smartphones Ready for Research…reveals studies that
discuss issues with cell phone research.
Voice Adds Depth to Survey…describes efforts by Anderson Analytics to
introduce hybrid methodology.
10-2
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
▪ PicProfiles
Graph of trending survey methodologies …this finding from a study by ADM
Arbeitskreis Deutscher Martund Sozialforschungsinstitute e.V. demonstrates how
surveys methods have changed since 1990.
Mixed-Mode Research graphs…reveals findings from a study that compares
responses across survey methodologies to address whether online surveys are
representative.
Pew Research Response Rate graph…backs up our concern about declining
response rates with the data to support that concern.
▪ CloseUp
None in this chapter.
▪ PulsePoint: Published research reveals many ways that businesses use research. You
might use such research findings to discuss a current phase of the research process or
a current issue. This PulsePoint relates to the expanding use of email—and how
attached people are to their smartphones for staying connected—personally and for
work. You might use this quote to discuss how the move from landlines to cell
phones has made phone surveying more difficult. As smartphone penetration is
increasing, you might ask students to discuss the factors influencing whether email
surveys will be well received. Refer them to Exhibit 10-4, Factors Influencing
Participant Motivation. It’s also an opportunity to discuss the use of mobile surveys.
You can use several of the Snapshots and Picprofiles in this chapter for this purpose.
▪ 45… The percent of smartphone users who check their e-mail before they get
dressed.
▪ Pull Quote
• Use each chapter’s pull quote to discuss a current issue related to the chapter.
• In this case, the quote deals with the different role of qualitative and survey
research. Having just completed a chapter on qualitative, and having at least an
experiential knowledge of survey research, you can ask students to look offer
examples of how monitoring social media and conducting surveys on the same
research question would be viable. You can also ask them whether a survey on
Facebook or Twitter is the same as a survey conducted via another channel (e.g.
phone, mall intercept, email, mobile, etc.)
o “If social media is the temperature check, surveys are the taste test to
validate that the meal is cooked properly. A good survey enables you to:
(1) tune out the noise and zero in on the opinions and comments that are
directly applicable to your most pressing questions, and (2) validate
trends and shifts in preference that you may have suspected, but weren’t
certain about.”
Reggie Aggarwal, CEO,
Cvent
10-3
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
• WWW Exercise
▪ Find a study that compares two methodologies; e.g., telephone survey and
Internet survey, OR self-administered mail and online survey. What does the
study say about the effectiveness of the research methodologies being compared?
You can find such studies profiled in whitepapers on research company websites
and government websites.
If you haven’t done so with Chapter 05, this also is a good time to introduce
students to academic articles, as academic publications are a primary source of
published comparative methodology studies. It is also an opportunity to show
them the breadth of research coverage in the business disciplines. Some they
will likely discover are the Journal of Business Research Methods, the
Journal of Business Research, Journal of Marketing Research, Journal of
Advertising Research, Qualitative Market Research: An International Journal,
Journal of Operations Research, Journal of Finance, Journal of Research in
Finance, the International Research Journal of Finance and Economics,
Journal of Accounting Research, Accounting Research Journal, Research and
Practice in Human Resource Management, and the Journal of Human
Resources.
10-4
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
CHAPTER VIGNETTE
Use this vignette to have students identify all the possible problems with the referenced
survey. You can also use this as the basis of an exercise for what changes in methodology
that students would use to improve the survey process. (Instructor Tip: Discourage
students from jumping into question construction and focus, instead, on the topics to be
addressed and the appropriate survey format to address those topics.)
• Jason and Sara are reviewing a complaint letter written Edna Kooga, attorney, to her
physician, Dr. Edith Coblenz. Coblenz and Albany Outpatient Laser Clinic, Inc. are
new clients.
In the letter, Kooga details the problems she encountered during her recent visit to
the Albany Outpatient Laser Clinic, Inc. Her complaints centered on:
o Being asked to read a poorly reproduced form, after her glasses had been
taken away.
o The poorly defined questions on the form.
o The lack of assistance from clinic personnel.
• Jason and Sara see this as an excellent opportunity to help Albany Outpatient Laser
Clinic with questionnaire development and survey methodology.
• Research designs can be classified by the approach used to gather primary data. There
are two alternatives:
We can observe conditions, behavior, events, people, or processes.
Or we can communicate with people about various topics, including participants’
attitudes, motivations, intentions, and expectations.
• The researcher determines the appropriate data collection approach by identifying the
types of information needed to answer the investigative questions.
Marketers learn about opinions and attitudes via communication-based research.
o Observation techniques are incapable of revealing such critical elements.
10-5
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-6
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
Interviewer Error
• There are many points at which the interviewer’s control of the interview process can
affect the quality of the data.
• Interviewer error, a major source of sampling error and response bias, is caused by
numerous actions:
Failure to secure full participant cooperation (sampling error).
o Bias is likely if interviewers do not obtain full participant cooperation.
o In the Albany Clinic study, one wonders whether the distributor of the survey
(the receptionist) contributed to the lack of quality data collected from Edna.
o Toward the end, there was doubt about the seriousness with which questions
were answered.
o Stressing the importance of the information for the upcoming surgery, and
having a receptionist trained to serve as question interpreter/prober could
reduce this type of error.
• Failure to record answers accurately and completely (data entry error).
Error may result from an interview recording procedure that forces the
interviewer to summarize or interpret participant answers, or that provides
insufficient space to record answers verbatim.
• Failure to consistently execute interview procedures.
The precision of survey estimates will be reduced.
There will be more error around estimates to the extent that interviewers are
inconsistent in ways that influence the data.
10-7
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-8
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
Participation-Based Errors
• Three factors influence participation:
The participant must believe that the experience will be pleasant and satisfying.
The participant must believe that answering the survey is an important and
worthwhile use of his or her time.
The participant must dismiss any mental reservations that he or she might have
about participation.
• Whether the experience will be pleasant and satisfying depends heavily on the
interviewer in personal and telephone surveys.
Typically, participants will cooperate with an interviewer whose behavior reveals
confidence and who engages people on a personal level.
o
By confidence, we mean that most participants are immediately convinced
they want to participate in the study and cooperate fully with the interviewer.
o An engaging personal style is one where the interviewer instantly establishes
credibility by adapting to the individual needs of the participant.
For the survey that does not employ human interpersonal influence, convincing
the participant that the experience will be enjoyable is the task of a prior
notification device or the study’s written introduction.
• For the participant to think that answering the survey is important and worthwhile,
some explanation of the study’s purpose is necessary.
The amount of disclosure will vary based on the sponsor’s objectives.
• In personal or phone surveys, the researcher will provide the interviewer with
instructions for discovering what explanation is needed.
The interviewer states the purpose of the study, tells how the information will be
used, and suggests what is expected of the participant.
• Participants must feel that their cooperation will be meaningful to themselves and to
the survey results in order to express their views willingly and to provide quality
information.
Potential participants often have reservations about being interviewed that must
be overcome.
o They may suspect the interviewer has an illegitimate purpose.
10-9
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
o
They may view the topic as too sensitive, and thus the interview potentially
embarrassing or intrusive.
o They may feel inadequate or fear the questioning will belittle them.
o They may have encountered previous sales people who attempted to disguise
their sales pitch or fund-raising activities as a research study.
In personal and phone interviews, participants often react more to their feelings
about the interviewer than to the content of the questions.
• The core of a survey or interview is an interaction between two people, or between a
person and a questionnaire.
In the interaction, the participant is asked to provide information, with little hope
of receiving any immediate or direct benefit from the data extracted.
Thus, participant motivation is a responsibility of the researcher and the
interviewer.
• Studies of reactions to many surveys show that participants can be motivated to
participate in personal and phone interviews, and can even enjoy the experience.
In one study, more than 90 percent of participants said the interview process was
interesting.
Three-fourths reported a willingness to be interviewed again.
• In intercept/self-administered studies, the interviewer’s primary role is to encourage
participation as participants complete the questionnaire on his/her own.
Taking away Edna’s glasses, coupled with the anxiety associated with eye
surgery, would not have encouraged her participation.
However, the “required” nature of the information guaranteed Edna’s
participation, no matter how grudgingly given.
• By failing or refusing to respond, participants create a nonrepresentative sample for
the study overall or for a particular item or question in the study.
In surveys, nonresponse error occurs when the responses of participants differ in
some systematic way from the responses of nonparticipants.
This occurs when the researcher:
o
Cannot locate the person (the predesignated sample element) to be studied, or
o Is unsuccessful in encouraging that person to participate.
This is especially problematic when using a probability sample of subjects.
• Many studies have shown that better-educated individuals, and those more interested
in the topic, participate in surveys.
A high percentage of those who reply to a given survey have usually replied to
others
A large share of those who do not respond are habitual nonparticipants.
10-10
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
• Researchers are not without actions to avoid or diminish the error discussed above.
We will explore these options in detail in Chapters 11 to 14.
• Despite the challenges, communicating with research participants and using surveys
is the principal method of business research.
Response-Based Errors
• Response error is generated in two ways:
When the participant fails to give a correct answer
When the participant fails to give a complete answer
• The interviewer can do little about the participant’s information level.
Screening questions can qualify participants when there is doubt about their
ability to answer.
• The most appropriate applications for communication research are those where
participants are uniquely qualified to provide the desired information.
Questions can be used to inquire about the characteristics of a participant, such as
household income, age, sexual preference, ethnicity, or family life-cycle stage.
Questions can also reveal information exclusively internal to the participant, such
as lifestyle, attitudes, opinions, expectations, knowledge, motivations, and
intentions.
• If we ask participants to report on events that they have not personally experienced,
we must assess the replies carefully.
If our purpose is to learn what the participant understands to be the case, it is
legitimate to accept the answers given.
If our intent is to learn what the event or situation actually was, we must
recognize that the participant is reporting secondhand data.
In the study of MindWriter’s CompleteCare program, only those individuals who
have experienced difficulty with their laptops and gone through the program have
direct knowledge of the service process.
o Associates and family members likely have secondhand knowledge of the
experience, no one but the actual laptop owner is likely to give as clear a
picture of CompleteCare service.
• In the case of Edna, answers to many questions on the patient survey might have been
known by a caregiver.
The clinic’s admissions department could have been confident that such
information was as accurate as it would have been if given by Edna herself.
• Because inaccuracy is a source of error, we should not depend on secondhand sources
if a more direct source can be found.
10-11
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-12
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
SELF-ADMINISTERED SURVEYS
10-13
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
o Intercept studies
Costs
• Self-administered surveys of all types typically cost less than surveys via personal
interviews.
This is true of mail, computer-delivered, and intercept surveys.
Telephone and mail costs are in the same general range, although in specific cases
either may be lower.
The more geographically dispersed the sample, the more likely it is that self-
administered surveys via computer or mail will be the low-cost method.
10-14
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-15
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
Anonymity
• Mail surveys are typically perceived as providing more anonymity than other
communication modes, including other methods for distributing self-administered
questionnaires.
• Computer-delivered surveys enjoy that same perceived anonymity, although
increased concerns about privacy may erode this perception in the future.
Topic Coverage
• A major limitation of self-administered surveys concerns the type and amount of
information that can be secured.
Researchers normally do not expect to obtain large amounts of information and
cannot probe deeply into topics.
Participants will generally refuse to co-operate with a long and/or complex
questionnaire unless they perceive a personal benefit.
o
Returned mail questionnaires with many questions left unanswered testify to
this problem, but there are also many exceptions.
A rule of thumb is that the participant should be able to answer the questionnaire
in no more than 10 minutes—similar to the guidelines for telephone studies.
o
On the other hand, one study of the general population delivered more than a
70 percent response to a questionnaire calling for 158 answers.
Early studies of computer-delivered surveys show that participants indicate some
enjoyment with the process, describing the surveys as interesting and amusing.
o The novelty of the process, however, is expected to decline with experience.
o Recent declines in web and e-mail survey response rates seem to support this
expectation.
10-16
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
This same technology easily transfers to other situations, where large groups of
people congregate.
• Companies now use intranet capabilities to evaluate employee policies and behavior.
Ease of access to electronic mail systems makes it possible to use computer
surveys with both internal and external participant groups.
Many techniques of traditional mail surveys can be easily adapted to computer-
delivered questionnaires.
Follow-ups to non-participants are more easily executed and are less expensive.
• Registration procedures and full-scale surveying are now being done on websites.
University sites ask prospective students about their interests.
University departments evaluating current students’ use of online materials.
Organizations also use their websites to:
o
Evaluate customer service processes
o Build sales-lead lists
o Evaluate planned promotions and product changes
o Determine supplier and customer needs
o Discover interest in job openings
o Evaluate employee attitudes
Advanced and easier-to-use software for designing web questionnaires is no
longer a promise of the future—it’s here.
• The Web-based questionnaire has the power of computer-assisted telephone
interview systems, but without the expense of network administrators, specialized
software, or additional hardware.
Whether used via Internet or intranet sites, you need only a personal computer and
web access.
Most products are browser-driven, with design features that allow custom survey
creation and modification.
• Two primary options are:
Proprietary solutions offered through research firms
Off-the-shelf software designed for experienced researchers
o With fee-based services, you are guided through problem formulation,
questionnaire design, question content, response strategy, and wording and
sequence of questions.
o The supplier’s staff generates the questionnaire HTML code, hosts the survey,
and provides data consolidation and reports.
o Off-the-shelf software is a strong alternative.
10-18
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-19
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
• The survey via telephone interview/survey is still the workhorse of survey research.
High level of telephone service penetration in the U.S. and the European Union
makes reaching participants low-cost and efficient.
o Nielsen Media Research uses thousands of calls each week to determine
television viewing habits; Arbitron does the same for radio listening habits.
o Pollsters working with political candidates use telephone surveys to assess the
power of a speech or a debate during a hotly contested campaign.
o Numerous firms field phone omnibus studies each week to capture everything
from people’s feelings about the rise in gasoline prices to the latest teenage
fashion trend.
10-20
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-21
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
If someone is present, a ringing phone is usually answered, and it is the caller who
decides the purpose, length, and termination of the call.
• There are also disadvantages to using the telephone for research:
Inaccessible households (no telephone service or no/low contact rate)
Inaccurate or nonfunctioning numbers
Limitation on interview length (fewer measurement questions)
Limitations on use of visual or complex questions
Ease of interview termination
Less participant involvement
Distracting physical environment
Inaccessible Households
• Approximately 94 percent of all U.S. households have telephone service, which
should make telephone surveys a prime methodology for communication studies.
Several factors reduce enthusiasm for the methodology.
o Rural households and households with incomes below the poverty line remain
underrepresented in telephone studies, with phone access below 75 percent.
o More households use filtering to restrict access, including caller ID, privacy
manager, Tele-Zapper, and unlisted numbers (22 to 30 percent of all
household phone numbers).
• The number of accessible individuals continues to decrease.
From 1985 to 2011, the number of U.S. wireless telecommunication subscribers
grew from 203.6 thousand to 327.6 million.
Many of these numbers are unlisted or possess screening or filtering services.
• Modem use makes household lines ring busy for long periods of time.
Recent FCC filings indicate that fewer than 15 percent of U.S. households have
second telephone lines, required for simultaneous Internet access.
• Effective May 2004, legislation made it possible for subscribers to take their wired
phone number to their wireless phone service (or the reverse) or to shift wireless
service between carriers without losing their wireless number.
Thus, the guidelines for identifying the physical location of a phone by its
number—and, in turn, the location of its owner—no longer apply.
• These causes of variations in participant availability by phone can be a source of bias.
A random dialing procedure is designed to reduce some of this bias.
Random dialing (a.k.a. random digit dialing) normally requires choosing
phone exchanges or exchange blocks and then generating random numbers
within these blocks for calling.
10-22
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-23
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
• The absence of assistance in interpreting questions in the Albany Clinic study was a
clear weakness that would have been improved by the presence of an interviewer.
Interviewers can note conditions of the interview, probe with additional questions,
and gather supplemental information through observation.
Edna was obviously in good spirits and very relaxed after she and her fellow
patients had critiqued the questionnaire. This attitude would have been observed
and noted by an interviewer.
We hope that the interviewer would correctly interpret laughter as a sign of humor
and not as a negative attitude, as did the admissions clerk.
• Human interviewers have more control than other kinds of communication studies.
They can:
Prescreen to ensure the correct participant is replying.
Set up and control interviewing conditions.
Use special scoring devices and visual materials, as is done with computer-
assisted personal interviewing (CAPI).
Adjust the interview language as they observe the effects on the participant.
• With such advantages, why would anyone want to use any other survey method?
Interviewing is costly, in terms of both money and time.
o
It may cost from a few dollars to several hundred dollars for an interview with
a hard-to-reach person.
o Costs are particularly high if the study covers a wide geographic area or has
stringent sampling requirements.
o An exception is the intercept interview that targets participants in centralized
locations such as retail malls or, as with Edna, in a doctor’s office.
Intercept interviews reduce costs associated with the need for several
interviewers, training, and travel.
Product and service demonstrations can be coordinated, further reducing costs.
Cost-effectiveness is offset when representative sampling is crucial to the study’s
outcome.
The intercept survey would have been a possibility in the Albany Clinic study,
although more admissions clerks would likely have been needed if volunteers
were not available to perform this task.
Tips on doing intercept interviews are available from the text website.
Costs have risen rapidly in recent years for most communication methods because
changes in the social climate have made personal interviewing more difficult.
o Many people today are reluctant to talk with strangers or to permit strangers to
visit in their homes.
10-26
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
o
Interviewers are reluctant to visit unfamiliar neighborhoods alone, especially
for evening interviewing.
Survey results via personal interviews can be affected adversely by interviewers
who alter the questions or in other ways bias the results.
o As Edna and her friends discussed the Albany Clinic survey, each applied
their own operational definitions to the concepts and constructs being asked.
This confusion created a bias that might have been eliminated by a well-
trained interviewer.
• To overcome interviewer and other deficiencies, we must appreciate the conditions
necessary for interview success.
SELECTING AN OPTIMAL SURVEY METHOD
10-27
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-28
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-29
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
Terms in Review
1. Distinguish among response error, interviewer error, and nonresponse error.
Response error occurs when the recorded data differ from the true data; such errors
can come from the participant in the editing, coding, or data entry stages.
Interviewer error occurs when the interviewer in some fashion corrupts the data. This
can occur as a result of inconsistent treatment of participants or questionnaires,
ineffective participant motivation and cooperation created by the interviewer, social
differences between participant and interviewer, and cheating.
Nonresponse error occurs when the researcher had difficulty in securing interviews
from participants who have been selected into the sample, and the non-participants
differ from the participants in a systematic way.
Many environmental conditions, such as the degree of urbanization in the area, the
day of the week, the time of day, the location of the interview, and the other demands
being made on the participant at the time of contact are all important factors in
determining the rate of response. For example, many urban residents feel threatened
in their neighborhoods and are reluctant to answer the door when a stranger calls.
Likewise, in a business shopping center at dinnertime it may be difficult to secure
cooperation from persons rushing home.
These problems can be only partially offset. Care in the selection and training of
interviewers is one of the best ways to lessen these problems. Some interviewers
consistently turn in better response rates. Techniques such as varying callback times,
making calls at the times of highest probability of contact, setting up interviews by
phone, interviewing other members of the family (when this is acceptable), and
seeking assistance from neighbors to learn the best time to call are also ways to
improve performance.
10-30
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
There are many ways to motivate participants in such a case. Some methods are
economic, such as cash, merchandise, or discount coupons for products sold in the
mall. Other methods are psychological, such as developing good rapport with the
participant, showing interest in the participant's thoughts and feelings, and convincing
the participant that the research project and his participation is important and
appreciated. Here it is often useful to indicate the utility of the research. In most
cases a single method is not sufficient for adequately motivating participants; a
combination of motivational approaches is necessary.
4. In recent years, in-home personal interviews have grown more costly and more
difficult to compete. Suppose, however, you have a project in which you need to
talk with people in their homes. What might you do to hold down costs and
increase response rate?
Three suggestions for decreasing personal interviewing costs while increasing the
response rates include:
(1) Develop a strategy for intermediaries at the door/participant's absence in case the
required participant is not available. This can be a system of leaving a small note and
visiting card rescheduling the interview/and giving a confirmatory telephone call.
(2) Use an incentive system to reward efficient interviewing and using the telephone
for scheduling and screening personal interviews.
(3) Use self-administered questionnaires.
Improved selection of interviewers, role playing, and other forms of training are also
effective ways to improve interview efficiency.
5. In the following situations, decide whether you would use a personal interview,
telephone survey, or self-administered questionnaire. Give your reasons.
In these examples, it is often possible to use any of the three methods.
(a) A survey of the residents of a new subdivision on why they happened to select
that area in which to live. You also wish to secure some information about what
they like and do not like about life in the subdivision.
In this scenario, it is more likely that a personal interview will be used because of the
compact study area and a topic which will be of high interest to participants. This is
especially true if there are a substantial number of questions and a certain degree of
free form to the interview. Telephone interviewing would be the second choice.
10-31
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
(c) A survey of 58 wholesale grocery companies scattered over the eastern United
States, on their personnel management policies for warehouse personnel.
Probably mail survey would be the most appropriate. It is possible that some written
material will be sent (policy statements, etc.) and this must be handled by mail.
Telephone surveys are possible if the questioning is not too complex and lengthy.
Personal interviews would be the high cost alternative and probably not used unless
this project had a substantial budget and was aimed as an in-depth study.
(d) A study of financial officers of the Fortune 500 corporations to learn their
predictions for the economic outlook in their industries in the next year.
A mail survey would probably hold costs down and improve the chances of making
contact with the special executive. One might also use a letter to inform the financial
officer of the project and then call long distance at a pre-specified time to secure the
answers to the questions.
This study was actually tested by mail survey first, but responses were incomplete and
in some instances provided confusing information. A second, more successful test
used a web-delivered instrument (to both students and supervisors) and supplemented
this with follow-up personal interviews (with supervisors) to clarify variables that
were answered inappropriately or incompletely. This is an excellent opportunity to
discuss incentives for participation; students were anxious to participate because they
perceived it was likely to bring about a new pay structure in which many of these
participants would benefit. Supervisors, on the other hand, had no such motivation.
Participant cooperation in a timely manner and organization culture were the primary
reasons cited for using personal interview rather than telephone interviews for the
follow-up with supervisors. A large pool of student volunteers was used to conduct
10-32
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
the interviews, thus eliminating the extra cost of a personal interview and providing
quick results as well.
The best way would be by random dialing (random digit dialing) within the exchange.
There are 9,999 possible numbers from which to choose a group by using a table of
random numbers or a random number generator. Record the chosen random numbers
in the order in which they appear. Use at least 70 numbers in order to have
replacements for unassigned numbers, business establishment numbers, and other
non-households. When a number does not answer, continue to call back up to 5-7
times at different times of day before replacing it with another numbered participant.
Continue the calling process until the sample of 40 families is achieved.
7. You plan to conduct a mail survey of the traffic managers of 1,000 major
manufacturing companies across the country. The study concerns their company
policies regarding the payment of moving expenses for employees who are
transferred. What might you do to improve the response rate of such a survey?
The letter and the survey should be carefully thought out and desktop published, in
order to make a strong and professional appeal.
If appropriate for the audience, an incentive could be offered. For instance, saying
that one survey drawn from all those returned wins a free vacation. However, the
incentive should not be so valuable as to encourage cheating.
(b) The purpose: fact finding, awareness, relationship building, and/or change.
Communication: On this there may be a number of perspectives. The impersonal self
administered questionnaire, the assurance of anonymity, with the survey assigned
possibly to an external agency could all contribute to frank responses and a positive
response rate. On the other hand, "expert interviewing and probing" would possibly
be better in some cases. The instructor may wish to discuss the merits of a two-stage
approach here. Phase 1 would be a survey questionnaire and Phase 2, an interviewing
stage, where experts would interview a sub sample based on responses in Phase 1.
The chapter frequently refers to the Albany case as issues are discussed. The vignette
provides lots of information, perceptions, and analyses for the student to collect prior
to defining appropriate actions. This question may be assigned as a partial out-of-
class/in-class exercise. Teams are formed to enumerate the various problems with the
study. Once they have shared the problems, teams are reformed to design an
appropriate communication study, given the measurement questions that were deemed
necessary.
To facilitate discussion, here are some quotes on the Albany study extracted from the
study:
10-34
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-35
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
• In the Albany clinic study, the researcher could have taken several actions to
improve the quality of the data. Distributing the questionnaire to the patient’s eye
doctor or to the patient (by mail) prior to arrival would have increased the
accuracy of identifying medications, diagnoses, hospitalizations, and so forth. The
patient’s eye doctor was in the best position to encourage compliance with the
collection process but was not consulted. Having the patient bring the completed
questionnaire to the admissions procedure, where the admissions clerk could
review the completed instrument for accuracy and completeness, would have
given the researcher the opportunity to clarify any confusion with the questions,
concepts, and constructs. Finally, pretesting the instrument with a sample of
patients would have revealed difficulties with the process and operational
definitions. Edna’s concerns could have been eliminated before they surfaced.
• The logical conclusions a student should reach are 1) while the study might have
elements indicating self-administration it should have interviewer contact with the
participant/patient, 2) the patient's doctor could be recruited to increase
participant motivation to participate, 3) the receptionist could be trained to
facilitate the process if a self-administered study is chosen, and 4) the
measurement questions should be evaluated to determine their critical necessity.
• This assignment might be an opportunity to discuss whether such a study—one
that distracts patients from their imminent surgery—has some value apart from an
analysis of the data collected, whether research processes should be used for such
a purpose, and the effects on the professional image of the research industry when
those untrained in research methods assume responsibility for research projects
such as this one.
10-36
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
and general health records could reveal much of what is needed, they are also
interested in the most current conditions possible, which precludes data mining.
• The study definitely needs a participation appeal, likely by the referring physician
during the initial visit that determined surgery was warranted.
• Common sources of interviewer error should have been noted and corrected
(these are described in question 9). Most question wording problems noted in the
vignette are correctable, and those that aren't can be overcome with the injection
of clarification from a trained interviewer. Since no attitudinal information is
described, interviewer bias is minimized.
• A single contact at the point of data collection (assuming the referring physician
distributed the self-administered instrument) is advisable. With so many
'authorities' providing definitions and interpretations there is bound to be bias on
any given day, not to mention over the long-term use of the instrument.
• Offering interviewer support on the self-administered instrument would have been
an error-reducing activity. This could have been accomplished by offering a
telephone number for the patient to call if the participant had questions. Or, while
the referring physician might have provided the instrument, a trained interviewer
could have called to actually collect the data by phone, enough prior to the
surgery for the data to have been useful but still current.
From the Headlines
11. As competition for a scarcer dollar increases, an increasing number of
companies are taking action by fostering customer-centric cultures that enhance
satisfaction and drive bottom-line profitability. Research reveals that 96 percent
of companies are leveraging voice-of-consumer data (VoC) in some way to
improve business performance. Companies now expect to achieve substantial
improvements in customer retention and top-line growth from these targeted
customer programs. If you wanted to know what kind of VoC programs were
being used and which were effective or ineffective, what type of survey would
you design and why?
While the students might jump to the conclusion that online is one only one true way
to conduct a survey, you should challenge them to discuss the various options for
communicating with the business practitioners who would have the information they
seek. Also, even if they determine the online survey is better than its alternatives, you
should challenge the students to discuss how they would compile a sample frame
from which to draw participants.
firms. The survey findings show that organizations hailing from a wide range of
industries and company sizes are catching on to the value of VoC.”
If you want to know more of the findings, or show them to your class, you can
download the whitepaper here:
http://www.1to1media.com/downloads/vovici_prg_voc%20white%20paper_FINAL_
021712.pdf?%E2%80%9D
10-38
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
Snapshots
10-39
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-40
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Chapter 10 - Surveys
10-41
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.
Business Research Methods Cooper 12th Edition Solutions Manual
Chapter 10 - Surveys
From CNet News and Don Reisinger’s blog we learned that iPad owners are huge
Apple fans who already own Macs, an iPhone, and at least one iPod, according to a
April 2010 survey from Piper Jaffray.
The survey of 448 iPad buyers said 74 percent of iPad owners contacted currently
own a Mac, while just 26 percent own a PC. Apple has also done a good job
attracting iPhone owners, Munster found. About 66 percent of those surveyed said
that they currently own an iPhone. A whopping 99 percent of those iPhone owners
say they will use their handset in conjunction with the iPad. Not surprisingly, 92
percent of iPad owners currently own an iPod. Out of that group, 97 percent said they
will use both products going forward.
Using these results, connecting survey findings from other related Apple products
provides a glimpse at the future success of the iPad. For example, the survey revealed
the preferences of iPad buyers: 39 percent were buying a 16GB iPad, 32 percent a
32GB model, and 28 percent a 64GB model. It also found that 74 percent plan to surf
the Web on the iPad, 38 percent plan to read books, 34 percent expect to check e-
mail, and 26 percent plan to watch video.
Although mail or web surveys to product owners, @me.com members, and through
Apple store intercepts may be used, a telephone survey is also a viable strategy.
10-42
© 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution
in any manner. This document may not be copied, scanned, duplicated, forwarded, distributed, or posted on a website, in whole or part.