Professional Documents
Culture Documents
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Chapter 4
Exploratory and Observational Research Designs
and Data Collection Approaches
1. Bulletin board
2. Case study
3. Content analysis
4. Debriefing analysis
5. Ethnography
6. Focus group moderator
7. Focus group research
8. Groupthink
9. In-depth interview
10. Listening platform/post
12. Moderator’s guide
13. Netnography
14. Observation research
15. Participant observation
16. Private communities
17. Projective techniques
18. Purposed communities
19. Purposive sampling
20. Qualitative research
21. Quantitative research
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
2
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
In business problem situations where secondary information alone cannot answer management’s
questions, primary data must be collected and transformed into usable information. Researchers
can choose between two general types of data collection methods: qualitative or quantitative.
There are many differences between these two approaches with respect to their research
objectives and goals, type of research, type of questions, time of execution, generalizability to
target populations, type of analysis, and researcher skill requirements.
Qualitative methods may be used to generate exploratory, preliminary insights into decision
problems or address complex consumer motivations that may be difficult to study with
quantitative research. Qualitative methods are also useful to understand the impact of culture or
subculture on consumer decision making and to probe unconscious or hidden motivations that
are not easy to access using quantitative research. Qualitative researchers collect detailed
amounts of data from relatively small samples by questioning or observing what people do and
say. These methods require the use of researchers well trained in interpersonal communication,
observation, and interpretation. Data typically are collected using open-ended or semistructured
questioning formats that allow for probing attitudes or behavior patterns or observation
techniques for current behaviors or events. While qualitative data can be collected quickly
(except in ethnography), it requires good interpretative skills to transform data into useful
findings. The small nonrandom samples that are typically used make generalization to a larger
population of interest questionable.
In contrast, quantitative or survey research methods place heavy emphasis on using formal,
structured questioning practices where the response options have been predetermined by the
researcher. These questions tend to be administered to large numbers of respondents.
Quantitative methods are directly related to descriptive and causal types of research projects
where the objectives are either to make more accurate predictions about relationships between
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
3
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
In-depth interviewing and focus groups are both guided by similar research objectives: (1) to
provide data for defining and redefining marketing problem situations; (2) to provide data for
better understanding the results from previously completed quantitative survey studies; (3) to
reveal and understand consumers’ hidden or unconscious needs, wants, attitudes, feelings,
behaviors, perceptions, and motives regarding services, products, or practices; (4) to generate
new ideas about products, services, or delivery methods; and (5) to discover new constructs and
measurement methods.
A face-to-face focus group is a small group of people (8–12) brought together for an interactive,
spontaneous discussion. Focus groups can also be conducted online. The three phases of a focus
group study are planning the study, conducting the actual focus group discussions, and analyzing
and reporting the results. In the planning of a focus group, critical decisions have to be made
regarding whether to conduct face-to-face or online focus groups, who should participate, how to
select and recruit the appropriate participants, what size the group should be, what incentives to
offer to encourage and reinforce participants’ willingness and commitment to participate, and
where the group sessions should be held.
Purposed communities are online social networks that may be specific to marketing research, or
they may be broader brand communities whose primary purpose is marketing but are also used to
provide research insights. Private communities are purposed communities whose primary
purpose is research. Consumers and customers are recruited for the purpose of answering
questions and interacting with other participants within the private community. Participant
samples are usually handpicked to be representative of the relevant target market, or they are
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
4
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
devoted fans of the brand. Private communities may be short or long term, and may involve
small or large numbers of participants, from 25 in small groups up to 2,000 for larger groups.
Discuss other qualitative data collection methods such as ethnography, case studies, projective
techniques, and the ZMET.
There are several useful qualitative data collection methods other than IDIs and focus groups.
These methods include ethnography and case studies, which both involve extended contact with
research settings. Researchers may also use projective techniques such as word association tests,
sentence completion tests, and the ZMET, which use indirect techniques to access consumers’
feelings, emotions, and unconscious motivations. These techniques are less frequently used than
are focus groups but are considered useful approaches for understanding more emotional and less
rational motivations.
Discuss observation methods and explain how they are used to collect primary data.
Observation methods can be used by researchers in all types of research designs (exploratory,
descriptive, causal). The major benefits of observation are the accuracy of collecting data on
actual behavior, reduction of confounding factors such as interviewer or respondent biases, and
the amount of detailed behavioral data that can be recorded. The unique characteristics that
underline observation data collection methods are their (1) directness, (2) subject’s awareness,
(3) structure, and (4) observing mechanism. The unique limitations of observation methods are
lack of generalizability of the data, inability to explain current behaviors or events, and the
complexity of observing the behavior.
Social media monitoring is research based on analyzing conversations in social media, for
example, Facebook, Twitter, blogs, and product review sites. The monitoring provides marketing
researchers with a rich source of existing, authentic information, and organic conversations in
social networks online. The data from these conversations may be analyzed qualitatively and
quantitatively. One strength of social media monitoring is that researchers can observe people
interacting with each other unprompted by the potential bias of interviewers and questions.
Another advantage of social media monitoring is individuals who may not fill out surveys or
agree to focus groups might nevertheless share their experiences with online social networks.
Weaknesses include expense, accuracy of automatic categorization, and the non-
representativeness of online posts. However, expenses are forecasted to fall, while the accuracy
and depth of categorization tools is expected to increase over time.
Chapter Outline
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
5
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
The opening vignette in this chapter puts light on Customer Territoriality. In recent decades,
businesses such as Starbucks and Panera Bread have provided space for customers to socialize
and work, sometimes lingering long past when food and beverages have been consumed. These
spaces have been called “third places,” a place in addition to work and home where individuals
may spend extended time working or studying. An ethnographic study of Starbucks noted
territorial behavior at the café, pointing out that almost all patrons keep to themselves, rarely
conversing with other customers that they do not know, creating a “virtual gated community”
around themselves when they spend time at Starbucks.
There are implications for cafes that are positioned as third places. Territorial behavior can both
promote and inhibit the approach behavior of customers. Customers of third space businesses
cocreate their experiences, but in doing so, they affect the experiences of other customers. Some
cafes may want to create a “fourth space” for customer groups looking primarily for a
semistructured workplace.
Qualitative research often is used in exploratory research designs when the research objectives
are to gather background information and clarify the research problems and to create hypotheses
or establish research priorities. Quantitative research may then be used to follow up and quantify
the qualitative findings.
Qualitative research results may be sufficient for decision making in certain situations. For
example, if the research is designed to assess customer responses to different advertising
approaches while the ads are still in the storyboard phase of development, qualitative research is
effective. Qualitative research may also be sufficient when feedback in focus groups or in-depth
interviews (IDI) is consistent, such as overwhelmingly favorable (or unfavorable) reactions
toward a new product concept. Some topics are more appropriately studied using qualitative
research. This is particularly true for complex consumer behaviors that may be affected by
factors that are not easily reducible to numbers, such as consumer choices and experiences
involving cultural, family, and psychological influences that are difficult to tap using quantitative
methods.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
6
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
The three major types of research designs are exploratory, descriptive, and causal. Each type of
design has a different objective as follows.
The objective of exploratory research is to discover ideas and insights to better understand
the problem.
The objective of descriptive research is to collect information that provides answers to
research questions.
o This type of research enables companies to identify trends, to test hypotheses about
relationships between variables, and ultimately to identify ways to solve previously
identified marketing problems.
The objective of causal research is to test cause-and-effect relationships between
specifically defined marketing variables.
o To do this, the researcher must be able to explicitly define the research question and
variables.
Depending on the research objective, marketing researchers use all three types of research
designs.
III. Overview of Qualitative and Quantitative Research Methods (PPT slides 4-6 to 4-8)
There are differences in qualitative and quantitative approaches. The factors listed in Exhibit 4.1
summarize the major differences (PPT slide 4-7).
Quantitative research methods are most often used with descriptive and causal research
designs but are occasionally associated with exploratory designs. Quantitative analysis
techniques may be applied to qualitative data (e.g., textual, image, or video). These projects
may be exploratory as they seek to detect and measure early problems or successes with
products, services, or marketing communication efforts for example.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
7
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
validate relationships
test hypotheses
Qualitative research is the collection of data in the form of text or images using open-ended
questions, observation, or “found” data (PPT slide 4-6). Qualitative data may be analyzed
qualitatively or quantitatively. While qualitative research data collection and analysis can be
careful and rigorous, most practitioners regard qualitative research as being less reliable than
quantitative research. Qualitative research often uncovers unanticipated findings and
reactions. Therefore, one common objective of qualitative research is to gain preliminary
insights into research problems.
Qualitative research probe more deeply into areas that quantitative research may be too
superficial to access, such as subconscious consumer motivations. Qualitative research
enables researchers and clients to get closer to their customers and potential customers than
does quantitative research.
Qualitative researchers usually collect detailed data from relatively small samples by asking
questions or observing behavior. Data analysis typically involves content analysis and
interpretation. To increase the reliability and trustworthiness of the interpretation, researchers
follow consistent approaches that are extensively documented.
The semistructured format of the questions and the small sample sizes limit the researcher’s
ability to generalize qualitative data to the population. Nevertheless, qualitative data have
important uses in identifying and understanding business problems. Qualitative research can
be superior for studying topics that involve complex psychological motivations not easily
reduced to survey formats and quantitative analyses.
Qualitative research methods have several advantages that are given below. Exhibit 4.2
summarizes the major advantages and disadvantages of qualitative research (PPT slide 4-8).
Except for ethnography, data can be collected relatively quickly or may already exist as
naturally occurring conversations on the Internet
Richness of the data
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
8
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
A number of approaches can be used to collect qualitative data. Focus groups are the most
frequently used qualitative research method (Exhibit 4.3).
A unique characteristic of in-depth interviewing is that the interviewer uses probing questions
to elicit more detailed information on the topic. The general rule is that the more a subject
talks about a topic, the more likely he or she is to reveal underlying attitudes, motives,
emotions, and behaviors.
The major advantages of in-depth interviewing over focus groups are given below.
Rich detail that can be uncovered when focusing on one participant at a time
Lower likelihood of participants responding in a socially desirable manner because
there are no other participants to impress
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
9
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Less cross talk that may inhibit some people from participating in a focus group
The most widely used qualitative research method in marketing is the focus group, sometimes
called the group depth interview. Focus group research involves bringing a small group of
people together for an interactive and spontaneous discussion of a particular topic or concept
(PPT slides 4-11). Focus groups typically consist of 8 to 12 participants who are guided by a
professional moderator through a semistructured discussion that most often lasts about two
hours. The fundamental idea behind the focus group approach is that one person’s response
will spark comments from other members, thus creating synergy among participants.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
10
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
In addition to the traditional face-to-face method, focus groups are now conducted online as
well. These groups can be either text- or video based. Text-based groups are like chat rooms,
but with some enhancements. Online focus groups are especially appropriate for web-based
advertising of products and services because they can be tested in their natural environment.
Online focus groups can be conducted relatively quickly because of the ease of participation
and because the focus group transcript is produced automatically during the group. While
body language cannot be assessed with text-based online focus groups and asking follow-up
questions is somewhat more difficult than it is in 3D or traditional offline focus groups, there
are advantages to online focus groups.
A variation of online focus groups is the bulletin board format (PPT slide 4-11). In the
bulletin board format, 10–30 participants agree to respond over a period of three to seven
days. The moderator posts questions and manages the discussion that unfolds over several
days. This format enables people to participate who might otherwise not be able to and is
especially useful for specific groups that are difficult to recruit, such as purchasing agents,
executives, or medical professionals.
The primary disadvantage of text-based online focus groups is they lack face-to-face
interaction. Thus, some online focus group providers are now offering video formats.
There is no single approach used by all researchers. But focus group interviews can be
divided into the following three phases (Exhibit 4.5; PPT slide 4-11).
Planning the study
Conducting the focus group discussions
Analyzing and reporting the results
The planning phase is important to the success of focus groups. In this phase, researchers and
decision makers must have a clear understanding of the purpose of the study, a definition of
the problem, and specific data requirements. The purpose of the focus groups ultimately
determines whether face-to-face or online focus groups are the most appropriate. Other
important factors in the planning phase relate to decisions about who the participants should
be, how to select and recruit respondents, and where to have the focus group sessions.
Focus group participants: The objective is to choose the type of individuals who will
best represent the target population of interest. The number of groups conducted usually
increases with the number of participant variables. Most research issues can be covered
with four to eight groups.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
11
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Selection and recruitment of participants: To select participants for a focus group, the
researcher must first develop a screening approach that specifies the characteristics
respondents must have to qualify for participation. Researchers also must choose a
method for contacting prospective participants. Because small samples are inherently
unrepresentative, it is usually not possible to recruit a random sample for qualitative
methods. Therefore, researchers select sample members purposively or theoretically.
Purposive sampling involves selecting sample members because they possess
particular characteristics (PPT slide 4-12). A stratified purposive sample may be
chosen so that various target group members are included or to provide comparisons
between groups (PPT slide 4-12). Theoretical sampling occurs when earlier interviews
suggest potentially interesting participants not initially considered in the sampling plan
(PPT slide 4-12).
Size of the focus group: Most experts agree that the optimal number of participants in
face-to-face focus group interviews is from 10 to 12. Any size smaller than eight
participants is not likely to generate synergy between participants. In contrast, having
too many participants can easily limit each person’s opportunity to contribute insights
and observations.
Focus group locations: Face-to-face focus groups can be held in the client’s conference
room, the moderator’s home, a meeting room at a church or civic organization, or an
office or hotel meeting room, to name a few.
The success of face-to-face focus group sessions depends heavily on the moderator’s
communication, interpersonal, probing, observation, and interpretive skills. The focus group
moderator must be able not only to ask the right questions but also to stimulate and control
the direction of the participants’ discussions over a variety of predetermined topics (PPT slide
4-13). The moderator is responsible for creating positive group dynamics and a comfort zone
between himself or herself and each group member as well as among the members
themselves.
To ensure that the actual focus group session is productive, a moderator’s guide must be
prepared. A moderator’s guide is a detailed outline of the topics and questions that will be
used to generate the spontaneous interactive dialogue among group participants. (PPT slide 4-
13). Moderator’s guides must be developed and used for both face-to-face and online focus
group sessions. Questions should be asked in different ways and at different levels of
generality.
When using face-to-face focus groups, after the participants sit down there should be an
opportunity (about 10 minutes) for sociable small talk, coupled with refreshments. The
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
12
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Using the moderator’s guide, the first topic area is introduced to the participants. It should be
a topic that is interesting and easy to talk about. As the discussion unfolds, the moderator
must use probing questions to obtain as many details as possible. If there is good rapport
between group members and the moderator, it should not be necessary to spend a lot of time
merely asking selected questions and receiving answers. In a well-run focus group,
participants interact and comment on each others’ answers.
The most common problem that inexperienced moderators have is insufficient depth of
questioning. Moderators may give participants exercises to help stimulate conversation.
Moderators for face-to-face focus groups must have excellent listening skills. Participants are
more likely to speak up if they think they are being heard and that their opinion is valued.
Moderators should try to see the topic of discussion from the participants’ point of view.
When a participant gives feedback that is useful, but which may be uncomfortable for the
participant, moderators should support the disclosure by saying something like “thanks so
much for bringing that up,” or “that’s really helpful for us to know.”
After all of the prespecified topics have been covered, participants should be asked a closing
question that encourages them to express final ideas or opinions. The moderator may present a
final overview of the discussion and then ask the participants, “Have we missed anything?” or
“Do you think we’ve missed anything in the discussion?” Participants should be thanked for
participating and given the promised incentive gift or cash.
The researchers and the sponsoring client’s representatives should conduct debriefing and
wrap-up activities as soon as possible after focus group members leave the session.
Debriefing analysis gives the researcher, client, and moderator a chance to compare notes.
Individuals that have heard (or read) the discussion need to know how their impressions
compare to those of the moderator (PPT slide 4-14). Debriefing is important for both face-to-
face and online focus groups.
Qualitative researchers use content analysis to create meaningful findings from focus group
discussions. Content analysis requires the researcher to systematically review transcripts of
individual responses and categorize them into larger thematic categories (PPT slide 4-14).
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
13
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
The major weaknesses of focus groups are inherently similar to all qualitative methods (PPT
slide 4-15).
The findings lack generalizability to the target population.
The reliability of the data is limited.
The trustworthiness of the interpretation is based on the care and insightfulness of
researchers.
There is a possibility that group dynamics may contaminate results.
While the interaction between participants can be a strength of focus group research,
groupthink is possible as well. Groupthink happens when one or two members of the focus
group state an opinion and other members join the bandwagon (PPT slide 4-15). Groupthink
is most likely when participants do not have a previously well-formed opinion on issues
discussed in the group.
Purposed communities are online social networks that may be specific to marketing
research, or they may be broader brand communities, the primary purpose of which is
marketing but are also used to provide research insights (PPT slide 4-16).
Private communities are purposed communities, the primary purpose of which is research
(PPT slide 4-16). Consumers and customers are recruited for the purpose of answering
questions and interacting with other participants within the private Community. In online
communities, most people participate because they think they can improve products and
marketing communication for a brand or product about which they care.
Ethnography is a distinct form of qualitative data collection that seeks to understand how
social and cultural influences affect people’s behavior and experiences (PPT slides 4-17).
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
14
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Ethnography records behavior in natural settings, often involves the researcher in extended
experience in a cultural or subcultural context, called participant observation, produces
accounts of behaviors that are credible to the persons who are studied, and involves
triangulation among multiple sources of data (PPT slide 4-20). In nonparticipant observation,
the researcher observes without entering into events.
A case study is an exploratory research technique that intensively investigates one or several
existing situations that are similar to the current problem/opportunity situation (PPT slide 4-
17). It is particularly useful in studying business-to-business purchase decisions because they
are made by one or only a few people. Case study research tracks thinking by the same
individual, group, or organization using multiple interviews over several weeks and can
therefore obtain subconscious thinking and study group interaction over time as problems,
projects, and processes are defined and redefined.
A word association test is a projective technique in which the subject is presented with a list
of words or short phrases, one at a time, and asked to respond with the first thought [word]
that comes to mind (PPT slide 4-18). Researchers study the responses to word association
tests to “map” the underlying meaning of the product or brand to consumers.
A sentence completion test is a projective technique where subjects are given a set of
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
15
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
incomplete sentences and asked to complete them in their own words (PPT slide 4-19). When
successful, sentence completion tests reveal hidden aspects about individuals’ thoughts and
feelings toward the object(s) studied. From the data collected, researchers interpret the
completed sentences to identify meaningful themes or concepts.
The Zaltman Metaphor Elicitation Technique (ZMET) is a visual research technique used
in in-depth interviewing that encourages research participants to share emotional and
subconscious reactions to a particular topic (PPT 4-19). It is the first marketing research tool
to be patented in the United States. It is based on the projective hypothesis, which holds that a
good deal of thought, especially thought with emotional content, is processed in images and
metaphors rather than words. In contrast to surveys and focus groups, the most widely used
techniques in marketing research, which rely heavily on verbal stimuli, the ZMET uses a
visual method.
Several steps are followed in the ZMET. When recruited, participants are told the topic of the
study, for example, Coke. Participants are asked to spend a week collecting 10 to 15 pictures
or images that describe their reaction to the topic (in this case, Coke) and to bring the pictures
to their interview. Each participant is asked to compare and contrast pictures and to explain
what else might be in the picture if the frame were to be widened. Then, participants construct
a “mini-movie,” which strings together the images they have been discussing and describes
how they feel about the topic of interest. At the end of the interview, participants create a
digital image, which is a summary image of their feelings.
Researchers use observation methods to collect primary data about human behavior and
marketing phenomena regardless of the nature of research designs (e.g., exploratory, descriptive,
or causal). Observation research can involve collection of either qualitative or quantitative data
and may result in qualitative or quantitative summaries and analyses of the collected information.
The primary characteristic of observational techniques is that researchers must rely on their
observation skills rather than asking participants predetermined questions.
Information about the behavior of people and objects that can be observed are given below.
Physical actions (e.g., consumers’ shopping patterns or automobile driving habits)
Expressive behaviors (e.g., tone of voice and facial expressions)
Verbal behavior (e.g., phone conversations)
Temporal behavior patterns (e.g., amount of time spent shopping online or on a particular
website)
Spatial relationships and locations (e.g., number of vehicles that move through a traffic
light or movements of people at a theme park)
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
16
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Physical objects (e.g., which brand name items are purchased at supermarkets or which
make/model SUVs are driven)
Behavior patterns are recorded using trained human observers or devices such as video cameras,
cameras, audiotapes, computers, handwritten notes, radio frequency identification (RFID) chips,
or some other recording mechanism. The main weakness of nonparticipant observation methods
is they cannot be used to obtain information on attitudes, preferences, beliefs, emotions, and
similar information. A special form of observational research, ethnography, involves extended
contact with a natural setting and can even include researcher participation. However, because of
the time and expense involved, true ethnographies are rarely undertaken by marketing
researchers.
Exhibit 4.6 is an overview of these characteristics and their impact (PPT slide 4-20).
The type of observation method refers to how behaviors or events will be observed.
Researchers can choose between the following two devices.
Human observers
Technological devices
With human observation, the observer is either a person hired and trained by the researcher or
is a member of the research team. To be effective, the observer must have a good
understanding of the research objectives and excellent observation and interpretation skills.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
17
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
In many situations, the use of mechanical or electronic devices is more suitable than a person
in collecting the data. Technology-mediated observation uses a technology to capture
human behavior, events, or marketing phenomena (PPT slide 4-21). Devices commonly used
include video cameras, traffic counters, optical scanners, eye tracking monitors, pupilometers,
audio voice pitch analyzers, psychogalvanometers, and software. The devices often reduce the
cost and improve the flexibility and accuracy of data collection.
Advances in technology are making observation techniques more useful and cost effective.
The fastest growing observational research approaches involve the Internet. Online
merchants, content sites, and search engines all collect quantitative information about online
behavior. These companies maintain databases with customer profiles and can predict
probable response rates to ads, the time of day and day of week the ads are likely to be most
effective, the various stages of potential buyers in the consideration process for a particular
product or service, and the type and level of engagement with a website. Extensive qualitative
data from social media is increasingly being harvested on the Internet. The data involves
online conversations about products, services, brands, and marketing communications that
occur in social media.
The first step in selecting the observation method is to understand the information
requirements and consider how the information will be used later. Without this understanding,
selecting the observation method is significantly more difficult. First researchers must answer
the following questions.
What types of behavior are relevant to the research problem?
How much detail of the behavior needs to be recorded?
What is the most appropriate setting (natural or artificial) to observe the behavior?
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
18
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Then the various methods of observing behaviors must be evaluated. Issues to be considered
include the following:
Is a setting available to observe the behaviors or events?
To what extent are the behaviors or events repetitious and frequently exhibited?
What degree of directness and structure is needed to observe the behaviors or events?
How aware should the subjects be that their behaviors are being observed?
Which observation method is most appropriate: in-person or technology-mediated?
The researcher can now determine the proposed method’s ability to accurately observe and
record the behavior or activity. The costs involved—time, money, and manpower—also must
be determined and evaluated. Finally, potential ethical issues associated with the proposed
observation method must be considered.
Observation methods have strengths and weaknesses (Exhibit 4.7; PPT slide 4-25). Among
the major benefits is that observation enables collection of actual behavior or activities rather
than reported activities. This is especially true in situations where individuals are observed in
a natural setting using a disguised technique. In addition, observation methods reduce recall
error, response bias, and refusal to participate, as well as interviewer errors. Finally, data can
often be collected in less time and at a lower cost than through other types of procedures.
E. Social Media Monitoring and the Listening Platform (PPT slides 4-26 and 4-27)
The difference between social media monitoring and private communities (covered
previously) is that in social media research, the data (text, images, and video) already exists
and is not created by interaction with researchers. Thus, one strength of social media
monitoring is that Researchers can observe people interacting with each other unprompted by
the potential bias of interviewers and questions. Another advantage of social media
monitoring is individuals who may not fill out surveys or agree to focus groups might
nevertheless share their experiences with online social networks.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
19
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Listening platforms are in their infancy and are ripe for a large number of research
innovations in coming years. The qualitative data available from social media monitoring can
be analyzed qualitatively, quantitatively, or both. Currently, most social media monitoring
tools seek to seamlessly mix qualitative and quantitative analyses. The earliest application of
quantitative methods is simple counts of mentions of keywords. Another emerging, but
controversial, quantitative tool is sentiment analysis, also called opinion mining (PPT slide
4-26). Sentiment analysis relies on the emerging field of natural language processing (NLP)
that enables automatic categorization of online comments into positive or negative categories.
Initial research applied sentiment analysis tools to product, movie, and restaurant reviews.
Quantitative measures of sentiment are still limited as a large amount of data is currently
unclassifiable or incorrectly classified with current automation tools. But more advanced
sentiment analysis tools are being developed to go beyond grouping by category and enable
classification by emotions such as sad, happy, or angry. Thus, in the next few years, sentiment
analysis methods are likely to be improved substantially, with their use becoming more
pervasive.
In addition to quantitative metrics, online conversations are typically mined for qualitative
insights as well. Online conversations about the topic of interest may be too numerous to
efficiently analyze manually. But qualitative researchers can sample comments for intensive
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
20
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
analysis. Sampling can be random or can involve oversampling among especially active and
connected web posters. In addition to being useful as an independent tool to provide in-depth
opinions, qualitative analysis of conversations provides relevant categories of issues and
opportunities for automated tools to follow up and quantify.
Netnography is an observational research technique that requires deep engagement with one
or more social media communities (PPT slide 4-27). What differentiates netnography from the
other social media research techniques is the extensive contact and analysis of online
communities and the use of participant observation. These online communities are often
organized around interests in industries, products, brands, sports teams, or music groups, and
contain fanatic consumers who are lead users or innovators. Rob Kozinets, who developed
netnography, used the technique to study an online community of “coffeephiles.” Kozinets
concluded that devotion to coffee among the members of the community was almost
religious: “Coffee is emotional, human, deeply and personally relevant—and not to be
commodified . . . or treated as just another product.”
Before gaining entrée, researchers develop research questions and search to identify online
forums that will provide the answers to their research questions. Generally, researchers prefer
to collect data from higher traffic forums with larger numbers of discrete message posters and
greater between-member interactions.
Reaching Hispanics through Qualitative Research (PPT slides 4-28 and 4-29)
More than 55.4 million (17.4 percent of the U.S. population) are classified as Hispanic. The
Hispanic/Latino population is diverse as it flows from many Spanish-speaking countries around
the world characterized by different levels of acculturation. When Hispanics become
acculturated, they often strongly identify with both America and their country of origin, an effect
that persists across generations. A minority of Hispanics use Spanish as their primary language,
with most Hispanics preferring to speak both Spanish and English. Vice president of
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
21
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Traditional marketing research among Hispanics has often focused too heavily on classifying the
marketplace in terms of language, acculturation, and generation. Perhaps this is because of
overreliance on quantitative research approaches. One strength of qualitative research is the
ability to tap deeper contextual, psychological, and cultural issues. As the Latino marketplace
continues to grow, marketing researchers will need to adjust their research approach, continually
identifying “culturally relevant ways to interact.”
Yes, qualitative research could be used to improve quantitative methods such as surveys.
Qualitative research is usually conducted as a follow-up to quantitative research. This
happens when quantitative findings are contradictory or ambiguous and do not answer
research questions. Qualitative research probes more deeply into areas that quantitative
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
22
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
3. What challenges do researchers face in conducting research with the Latino marketplace
online? How can researchers minimize the effects of these difficulties?
One of the main challenges that researchers face in conducting research with the Latino
marketplace online is in identifying culturally relevant ways to interact with them. There is
a need for researchers to approach the population differently to make the research useful.
Making use of qualitative research can help minimize these difficulties. Qualitative
research will look more into discovery/identification of new ideas, validation of facts,
understanding of hidden psychological and social processes, and contextual and cultural
issues.
4. Think of one or two cultures or subcultures with which you are at least somewhat familiar.
Would qualitative research be especially useful for these cultures? Why, or why not?
Students’ answers to this question will vary depending on the culture or subculture they
choose.
1. What are the major differences between quantitative and qualitative research methods?
What skills must a researcher have to develop and implement each type of design?
There are several characteristics which can be used to compare the two research methods
mentioned above. As an example, the “type” of research done by a researcher in the
qualitative arena normally consists of exploratory designs, whereas quantitative methods
focus on descriptive and causal frameworks. The types of questions used in quantitative
methodologies are mostly structured, whereas qualitative research methods use open-
ended, unstructured, semi-structured queries with deep probing techniques. To develop and
implement qualitative methodologies, a researcher needs to respect the research objectives,
possess desired interpersonal communication skill, and be willing to open themselves (and
their management team) to interpretation. Finally, the information collected from in-depth
interviews, ZMET sessions, and focus groups tends to be metaphorical and subjective.
Therefore, the analysis associated with any qualitative project is more protracted and
complex than quantitative data analysis.
Quantitative methods require a researcher to “be on the same page” as management when
developing and implementing the design since the problems and opportunities are well
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
23
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
defined. Communication and interpretation take center stage with qualitative research;
survey design and administration are more critical for the researcher with quantitative
research. Quantitative researchers need to be skilled in statistical data analysis, sampling,
construct development, and scale measurement. Finally, qualitative researchers need to
provide managers with something of “value” and therefore need to be able to translate
complex data structures into a meaningful narrative a decision maker can use to address a
strategic problem or opportunity.
Focus group and in-depth interviews have some characteristics in common. First, it’s
important to note that both focus groups and in-depth interviewing techniques make use of
probing questions as a mechanism to get more information from the subject(s). In addition,
in-depth interviews and focus groups are similar in that researchers can collect attitudinal
and behavioral data that spans the past, present, and future. Interpersonal communication
skills and the ability to be able to “listen well” are characteristics shared by interviewers
whether the questions are raised in an in-depth interview or focus group. The setting for the
focus group, however, is often different than an in-depth interview. An in-depth interview
may take place in a manager’s office or over the phone. Focus groups, on the other hand,
may occur in seminar rooms in a hotel, online, or in a facility equipped with pivot cameras
and microphones. Finally, focus groups can include 8–12 people (4–6, if conducted
online), whereas an in-depth interview is always “one-on-one.” The main objective of in-
depth interviews is to have a respondent communicate as much detail as possible about his
or her knowledge and behavior toward a given object or topic. The pros of in-depth
interview techniques are their flexibility and the possibility of collecting large amount of
data. A focus group enjoys an added advantage in that participant interaction may act as a
catalyst bringing unique and fresh ideas to the surface—an outcome which might not
happen in a conversation between a researcher and subject. The downside is largely similar
with both focus groups and in-depth interview techniques: an inability to generalize results,
the reliability of the data, a protracted process when it comes to recruiting participants, and
a complex and detailed approach to analyzing the results.
3. Explain the pros and cons of using qualitative research in each of the following situations:
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
24
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
b. Finding new consumption usages for Arm & Hammer baking soda
A focus group might be argued to be a costly and less efficient use of management
time and resources since a number of “other” uses are already known in the
marketplace (e.g., removing stains, drawing stingers to the surface of the skin after a
hornet, or wasp attack). Still, the dynamics of group members in a focus group
environment may bring other “out of the box” considerations to the surface,
especially if participants are encouraged to demonstrate uses with the actual product
in a focus group session.
d. Advising a travel agency that wants to enter the cruise ship vacation market
In this case, it’s not clear if a focus group, in-depth interview, or questionnaire is
necessary. The concern here surrounds the use of the word “advising.” The
objectives of in-depth and focus group interviewing lean more in the direction of
discovery and clarifying problems and opportunities for future research endeavors.
Management of the travel agency may have already made up their minds on this one
(due to industry trends, local competitive forces, and the need for a repositioning
strategy to bolster their image), and therefore the cost-to-value ratio might be the first
thing to conduct before proceeding with any research method.
4. What are the characteristics of a good focus group moderator? What is the purpose of a
moderator’s guide?
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
25
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
Having this group size is beneficial for group dynamics. If there are a few people, the
moderator may find himself or herself providing too much direction to participants. Or,
people who love to hear the sound of their own voice may begin to dominate the session. A
session with too many participants can get bogged down causing the moderator to rush
through critical questions and probes to the extent that the outcome of the session is
superficial. The primary difficulty in meeting the objective stems from the recruitment of
participants for focus group sessions. The recruitment of participants for a focus group can
be argued to be the most difficult aspect of the set-up process. This stems not only from the
screening criteria but also from a disinterest in taking part in focus groups on the part of the
buying population. Variables such as the location of the group, the size of the incentive,
and the number of groups play an important role in encouraging participation. The
recruitment of participants is a key success factor for a beneficial session—so much so that
some marketing research firms have begun to “contract out” these recruitment duties to
firms who specialize in fulfilling this aspect of focus group research.
6. Why are the screening activities so important in the selection of focus group participants?
Develop a screening form that would allow you to select participants for a focus group on
the benefits and costs of leasing new automobiles.
Screening activities, as noted above, are a key success factor in orchestrating and
completing a focus group. For instance, if the people recruited to a group are too diverse
(e.g., according to income, use of a particular product in question, and age or stage in the
family life cycle), it will be increasingly difficult to achieve objectives such as generating
new ideas about products, services, and delivery methods and capturing data for defining
and redefining marketing problems and opportunities specific to the client. A request to
develop a screening form to recruit participants for a group on the benefits and costs of
leasing new automobiles should proceed after a detailed discussion of the desired
characteristics of participants. The screener might ask for income level, intent to lease a
new car in the next two years, and past leasing or purchasing behavior.
7. What are the advantages and disadvantages of online focus group interviews compared to
face-to-face group interviews?
Advantages associated with online focus groups are that it shortens the time required for
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
26
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
data collection, analysis, and reporting of results. Participants can be physically located
anywhere in the world so long as they have a computer and Internet access. The primary
disadvantage is the lack of face-to-face contact which limits observation of non-verbal cues
and body language. The two methods are somewhat the same in their planning,
identification of participants’ characteristics, sample selection and recruitment, and
administrative procedures.
9. Develop a word association test that will provide some insight to the following information
research question: What are college students’ perceptions of their university’s student
union?
In word association tests, participants are exposed to a preselected list of words and asked
to respond with the first thought [word] that comes to mind regarding that word. The
researcher looks for obvious and hidden meanings associated with important concepts
represented by the original word list. The objective is to gain insight into how to
communicate more effectively with the target audience. In the case of the student union,
words might include the following: comfortable, attractive, convenient, fun, desirable,
friends, food, study, meet, affordable, and date.
a. A jewelry retailer wants to better understand why men buy jewelry for women and
how they select what they buy.
A focus group would be a good approach for this situation. A group of men who
have recently shopped for women’s jewelry could explore the motivations for
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
27
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
A “usability lab” of sorts would be a good approach for choosing play equipment. An
assortment of equipment could be assembled with children in the target age range
invited to play for an afternoon. Observational measurements could be taken of the
children’s interactions with each piece of equipment.
d. The senior design engineer for the Ford Motor Company wishes to identify
meaningful design changes to be integrated into the 2018 Ford Taurus.
e. Apple wants to better understand how teenagers discover and choose popular music
to download.
A focus group is appropriate for this project. Teenagers could be asked to keep a log
of music they download for a period of time prior to the discussion along with how
they heard about each song.
2. Develop a moderator’s guide that could be used in a focus group interview to investigate the
following question: What does “cool” mean to teens, and how do teens decide what products
are “cool”?
Responses will vary, to some extent, depending upon the students’ own perceptions of
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
28
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
3. Apple hires you to study Apple’s brand image with college students on your campus. Draft a
list of ten questions you would ask in a focus group. Make sure you think of alternative ways
to ask questions instead of simply asking direct questions.
Students’ responses to this question will vary. The list of questions might include the
following: “How long have you been using your Apple product?”, “Have you ever had
problems with it?”, etc.
4. Thinking about how most participants are recruited for focus groups, identify and discuss
three ethical issues the researcher and decision maker must consider when using a focus
group research design to collect primary data and information.
The first ethical issue which surfaces in recruiting for a focus group is what’s referred to as
the problem of retreads. Retreads are individuals who make “a living” bouncing from focus
group to focus group to earn an income. Care must be taken when the task of recruitment is
“farmed out” to an outside source. Some of these recruiting agencies have a number of
individuals (friends, relatives, and business associates) who get placed into the group
regardless of their familiarity with the topic.
Another critical issue is to insure that the individuals who are recruited for the group
conform the needs and specifications of the client-research team. All too often, the people
entrusted with the recruiting task choose to initiate the sessions when the groups are held. If
the focus group is held online, no more than 4–6 participants are required, since the protocol
associated with probing and the presentation of people’s comments (on a screen which flows
“up”, not “down”) can be difficult, if not impossible to manage when 10–12 participants are
struggling to have their “say.” Even in a traditional situation, there is nothing more
disconcerting to participants than not being part of a group because there aren’t enough
chairs at the table.
Finally, when recruiting for a focus group, care should be taken not to mix participants who
are too diverse. People who attend focus groups need to feel as if they’re part of a gathering
where it’s okay to express their feelings honestly, and with conviction. Sometimes
recruiters, researchers, and clients adopt a “mix-it-up and let’s see what happens” mentality
toward focus groups. The results are often awkward and sometimes downright threatening
for the all parties concerned. As an example, be cautious about mixing customers and
prospects, representatives from large corporations and small independent businesses, and
members from different levels in the “pecking order” when designing and implementing a
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
29
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
business-to-business focus group. In the same vein, groups comprised of ultimate consumers
should steer clear of mixing participants with wide age and income ranges.
5. Conduct an in-depth interview, and write a brief summary report that would allow you to
address the following decision question: What do students want from their educations?
Students’ responses will vary as students experience the process of conducting an in-depth
interview. Students should begin with selecting an appropriate subject, setting up the
meeting, and developing appropriate questions to discern what is it that the subject wants
from his or her education. The summary report should be organized by themes from the
transcript.
6. Outback Steak, Inc., is concerned about the shifting attitudes and feelings of the public
toward the consumption of red meat. Chris Sullivan, CEO and cofounder of Outback Steak,
Inc., thinks that the “red meat” issues are not that important because his restaurants also
serve fish and chicken entrées. Select any two “projective interviewing” techniques that you
think would be appropriate in collecting data for the above situation. First, defend your
choice of each of your selected projective interviewing techniques. Second, describe in
detail how each of your two chosen techniques would be applied to Sullivan’s research
problem at hand.
The list of possible choices for this problem includes word association tests, sentence
completion tests, picture tests, Thematic Apperception Test (TAT), cartoon/balloon tests,
and role playing activities. Two techniques that seem to offer the greatest promise in this
case are the cartoon and role-playing exercises. Both of these techniques lead subjects to
project their attitudes and opinions without a social desirability bias.
The issue in this case is to determine customers’ attitudes toward offering “red meat” on a
menu that also offers the choice of other types of meat. In a cartoon test, the subject would
be asked to furnish a customer’s comments when he or she sees a menu item that contains
“red meat.” Then, what is the waitperson’s response? In the role-playing exercise, one
subject might take the place of a customer and another subject might play the waitperson.
They could discuss the menu choices that include “red meat.” For these exercises, if you are
careful to select subjects that are truly Outback customers, you will probably get different
results than that would come from the general population. Almost everyone knows that
Outback’s specialty is “red meat.” If that causes a huge problem, don’t go there.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.
30
Chapter 04 – Exploratory and Observational Research Designs and Data Collection Approaches
The video diary technique very well may be superior to text-based online focus groups. The
video diary format used by QualVu enables one to experience the participants’ nonverbal
cues as well as their direct answers. It eliminates or minimizes one of the primary barriers
for text-based online focus groups, which is the need to type as fast as one could speak. It
also enhances privacy perceptions and reduces the effects of groupthink.
This website has several studies posted based on identity, shopping and the holidays,
consumerism, attitudes toward the news, and more. The studies investigate consumer
psychology and in that regard are appropriate for ethnographic research. However, it would
be possible to study these topics using other methods. The key is for the researchers to
determine their needs. The ethnographic studies provide deep insight into these complex
issues.
Students may have differing opinions on this question. Mining social media is not really
similar to conducting a focus group, but it can be somewhat similar to analyzing the data
resulting from a focus group. Mining media means content analyzing text, images, and
sounds in a specific context. It can actually result in more realistic and accurate data
compared with that from a focus group. It can also result in a vast amount of data, so a
researcher would need to be prepared to manage the complex and large files.
10. Visit Communispace at Communispace.com. Read their information about what they do and
some of the news or case histories at their site. After reviewing the website, evaluate
whether and to what extent private communities might replace focus groups.
Students may have differing responses to this question. Students should be able to compare
the advantages and disadvantages of focus groups and private communities. They can then
give their opinion on to the extent they think the private communities might replace focus
groups and give reasons for the same.
Copyright © 2017 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill
Education.