Professional Documents
Culture Documents
RESEARCH
Jagrook Dawra
• What does a manager do?
• What is the most important skill he should have?
• Why MR?
• Why not to take decisions in absence of information?
• Shooting from the Hip – Lee Iacocca
WHAT IS MR?
• Information
• Information processing
• Tools and techniques
• SWOT
• Observation
• One-on-one interviews
• Complex statistical tools and techniques – Regression, Factor, Cluster, etc.
FROM MARKETING RESEARCH TO MARKETING ANALYTICS…
MR MA
• Focus is on analysis of survey-based carefully • Focus is on analysis of existing data obtained from
collected data. past behavior.
• Data size typically in a few hundreds. • Data size enormous.
• Focus on prediction from consumer’s psychological • Focus is on prediction from past occurrences.
aspects – perceptions/ attitudes.
• Data collection efforts are directed towards obtaining
• Data collection is automatic and often mechanical.
a representative sample
4
• Evolution of an organization and its information needs.
• As an organization grows, its information needs also grow.
• Is there a real need for marketing research?
• Research takes time and costs money.
• Value of information vs. Cost of information?
Examples of failure:
Examples of successes
• Numerous
DEFINITION – AMA
• Marketing research: the function that links the consumer, customer, and public
to the marketer through information – information used to identify and define
marketing opportunities and problems; generate, refine, and evaluate
marketing actions; monitor marketing performance; and improve the
understanding of marketing as a process.
Business problem/
Business objective Research objective Research method Interpretation Recommendations
symptom
PROCESS
DETAILED PROCESS
Quantitative Qualitative
• Type of data: numbers • Type of data: verbose and media rich
• Method: Mostly deductive • Method: mostly inductive
• Relationship with the researcher: Researcher is • Relationship with the researcher: Researcher is very
withdrawn, unbiased observer. much a part of the research environment and is
difficult to remain unbiased
• Results involve giving thick descriptions.
• Results involve statistical description (mean, SD, etc.),
causal relationships between variables, etc.
QUALITATIVE VS.
QUANTITATIVE TOOLS
• Types of Research
• Exploratory Research: collecting information in an unstructured and informal
manner.
• Descriptive Research refers to a set of methods and procedures describing marketing
variables
• Causal Research (experiments): allows isolation of causes and effects.
SOURCES OF DATA
• Survey instrument
• Asking the right question in the right way
DESIGN DATA
COLLECTION QUESTIONNAIRE
• Data analysis involves entering data into computer files, inspecting data for
errors, and running tabulations and various statistical tests.
• SPSS
• Excel
• Any other software
• Knowledge of Software
• Knowledge of Statistical Tool
• It is important to master the method and not the software!
RESEARCH AND ETHICS
• A research company decides to leave a message on prospective respondents’
answering machines telling them that if they call back in the next 24 hours,
they will receive a valuable prize if they take part in a survey.
• Ethical as long as true
• Upon completion of an interview, the respondent is asked to provide the
names and telephone numbers of others he or she thinks should take part in
the survey.
• Ethical - snowball sampling, referral sampling
• A door-to-door salesman finds that by telling people that he is conducting a
survey, they are more likely to listen to his sales pitch.
• Unethical – sugging
• Selling under the guise of research
• What is frugging?
• Fund-raising under the guise of research
• The cover letter of a mail questionnaire says that it will "only take a few
minutes to fill out." But pretests have shown that at least fifteen minutes are
needed to fill it out.
• Unethical as “few” is vague
• Telephone interviewers are instructed to assure the respondent of
confidentiality only if the respondent asks about it.
• Ethical as long as confidentiality is true
• A client insists on inspecting the completed questionnaires to assess their
validity, but the researcher suspects that the client is really interested in
finding out what specific respondents said about the client.
• Unethical if the survey is confidential or anonymous.
• A client insists on inspecting the completed questionnaires to assess their
validity, but the researcher suspects that the client is really interested in
finding out what specific respondents said about the client.
• Unethical if the survey is confidential or anonymous.
• Respondents get a gift by Lottery.
• Considered unethical by some – Gambling.
• Institutional Review Board
• Reviews/ Scrutinizes research to ensure ethical practices and protect respondent
rights.
• Code of Ethics
• CASRO: www.casro.org
• MRA: www.mra-net.org
• ESOMAR: www.esomar.org
• PMRS: www.pmrs-aprm.com
PANELS
• I have developed a schedule of cold calling. Students who are present in a session, can
expect me to call them any number of times during the session.
• I shall pose them with any specific question with regards to the session that is ongoing.
Any delay in answering or inability to appropriately answer shall warrant a negative mark
(-1).
• If I am satisfied with the answer, you get a +1 and if your name is not called in that session
you get a 0.
• I shall try my best to ensure everyone is called equal number of times in the term.
DISCUSSION – ‘WARM’ CALLING
• You can also contribute as many times as you want to the class discussions.
• Response to a question I put to the class
• Your intelligent questions/ queries that leave the class wiser.
• Every time that I feel your points/ queries/ concerns add value to the class, you
get a +1. [An occasional +2 may also be given to deserving contributions]
• If you make a point just for the ‘sake’ of it, you get a 0.
•
COOP MARKET
RESEARCH
Converting
this P to K Instruments
The world
Knowledge
Converting P to K
APPROACH 1: INTERPRETIVISM APPROACH 2: POSITIVISM
Convert P to K Convert P to K
Jaane bhi do
yaaron…
Interpret
Analyze data to verify if the
predictive statement is true
Convert P to K Convert P to K
Research RQ: What differential effect does HiLo promotion strategy (over
Question EDLP) have on customers behavior towards a store?
Approach 1: Interpretivism
Conduct an experiment:
◦ Subject one group of people to EDLP strategy over a period of time.
◦ Subject another group of people to HiLo strategy
◦ Collect data on several aspects of customer’s behavior towards each store.
◦ Conclude after exploration that customers trust an EDLP store more than a HiLo one. [this is assuming you had
taken ‘trust’ as one of the items to be studied in the broad ‘consumer behavior’.
Approach 2: Positivism
Studies show that people hate uncertainty. (Source: Theory)
Walmart that follows EDLP is more successful than Macey’s that follows HiLo. (Source: Newspaper article)
Humans do not ‘trust’ an entity that is the source of uncertainty. (Source: Theory)
Conduct an experiment:
◦ Subject one group of people to EDLP strategy over a period of time.
◦ Subject another group of people to HiLo strategy
◦ Collect data on how much they trust each store.
◦ Accept or reject H0.
Basic paradigms in research
POSITIVISM INTERPRETIVISM
Last year, around the same time, in India, murmurs started to rise in the popular media about testing
methodology.
India’s apex disease control body ICMR, however, adopted a methodology called ‘contact tracing’
(convenience sampling).
Who was right? Why? What are the pros and cons of the two methods for disease detection?
Qualitative Research
Forms of data
Written replies to open ended questions. Magazine articles
52
“Every animate and inanimate object on earth will soon be generating data, including our homes, our
car, and yes, even our bodies.”
◦ Anthony D. Williams, Author – ‘Wickinomics’
An average person today processes more data in a single day than a person in 1500s did in an entire
lifetime.
Much of this data is qualitative, though the analysis done on it may sometimes be quantitative.
53
Process of conducting qualitative research
Discussion guide/ Interview Guide
FGG/ Interview
◦ Sample size: How many?
◦ Sampling method:
Discussion/ Interview
Transcribe data
Analysis
Ethnography Case study
Types of
qualitative
research Action Grounded
research theory
Sampling and sample size
• Information saturation
Triangulation
Issues
Analysis
Analysis
Sampling method
Type of Sampling Purpose Example
Maximum Document diverse variation and common patterns – Actively looking for parting-off
variation involves looking for outliers to see if patterns still hold. ceremonies of private vs. public
Search actively for confirming, disconfirming and typical companies.
cases.
Homogeneous Focusses, reduces, simplifies finding patterns Focus on a homogeneous set of
companies.
Critical case Permits logical generalization and maximum application of
information to other cases.
Theory based Finding examples of a theoretical construct and thereby Need for special treatment – “How
elaborate and examine it. does a store/ retailer make you feel
special?
Confirming and Elaborating initial analysis, seeking exceptions, looking for Actively looking for the exceptions
disconfirming variation. in a study.
cases
58
Triangulation
Confirmation bias – Researcher’s bias
Multiple analysts
Create a discussion guide for the following business problem:
◦ Retail stores have their own brands called private labels or store brands.
How do consumers perceive these brands? Are private label brands
perceived different from national brands?
◦ How do they perceive its quality? Manufacturers of Jeans (Jeans brands)
define quality in terms of threads per inch or weight (in ounces). Do
Exercise – in consumers also perceive quality of jeans as such?
groups Rules:
◦ Create the guide in groups.
◦ Please take no more than 15 minutes to create this guide. Feel free to
refer secondary sources if necessary.
◦ Submit the discussion guide by email to the CR in pdf format only. Name
of the file must be Ex_01_<group no>.pdf
Analysis of Qualitative
Data
61
Common software that help in qualitative
data analysis
NviVo
Atlas Ti
62
Using NVIVO
Helps organize qualitative data.
Basically gives a ‘structure’ to qualitative data and makes the analysis more scientific.
63
Word clouds
Using sentiment analysis software
Capture and code adjectives like – ‘good’, ‘better’ and ‘excellent’ and code them as +1, +2 and +3
respectively.
•Review •Key ideas
•Merge •Reflect
•Refine •Link
Coding Memoing
Visuals Queries
70
Hermeneutics
Hermeneutics focusses on the meaning of the qualitative data.
71
Historicity and Hermeneutics
Understanding of a topic/ quote/ concept in a particular historical context.
◦ For e.g. We note that ‘profits of a company have been going down’. One would be tempted to think that there
is something wrong with the company or its management.
◦ But if the context was put in place – for instance: The state of the economy was bad and that recession had
set in, the interpretation changes.
72
The Hermeneutic circle
It refers to the idea that one's understanding of the text as a whole is established by reference to the
individual parts and one's understanding of each individual part by reference to the whole.
73
Hermeneutics and prejudice
Interpretation of a text needs the researcher to have some prior knowledge. For instance, she needs
to know the language, its vocabulary and social conventions.
The more poetic a person is, more cryptic is his/ her language and interpretation is less mechanical.
◦ Mark Twain: “I don’t let my school interfere with my education”
74
Written vs. verbal text vs. visual interpretation
Written text (written by respondents) comes after due deliberation and a certain ‘caution’ exercised
by the respondent, while verbal data is not so much.
Emotions associated with the statements can be captured only in verbal/ visual text and not
otherwise.
75
Example – Attitude towards Sony
HSC 300
Attitude towards the brand Whose attitude – is there a
difference between groups?
Attitude towards the product
◦ Men vs. women
Attitude towards the performance ◦ Classification as per other
demographics.
Attitude towards the attributes ◦ Amateur vs. professional
photographer.
Attitude towards the aftersales
◦ Usage – heavy vs. light user.
service
◦ Usage – purpose (wildlife/ friends
Attitude towards the ease of use and family/ scenery/ etc.)
Etc.
76
Advertisement deconstruction – understanding the explicit
and implicit messages in an ad. A further analysis could be
done to reconcile the difference between the intended
positioning strategy and the perceived positioning of brands.
77
Brand failures: using the cases in the book on
brand failures (and also perhaps the same author’s
book on brand successes) build a generalized
theory around what causes brands to succeed/ fail.
See if your emerging theory conforms to the ones
that already exist in the theory.
Potential
exercises
What type of comments/ content diffuse faster
over social media?
78
Measurement in
Management
Issue of reliability and validity
Two extremely important aspects of a good research.
How many of you had questions vis-à-vis reliability and validity built into your SIP questionnaires?
What is Reliability?
◦ Validity?
The degree to which
a measurement
instrument
Validity
accurately reflects
what it is designed to
measure.
The degree to which a
measurement
Reliability instrument is
consistent in what it
measures.
Valid and Reliable
Valid but not Reliable
Not Valid but Reliable
Not Valid and not Reliable
A good instrument should have:
Objectivity: Definition of the task at hand – “Objective of playing darts is to hit the bulls eye”
◦ “Siddarth’s ability to hit the bulls eye”
◦ What is being measured? Siddarth? Ability?
Practicability: Online questionnaire may not be the right instrument for a study on Indian Kirana
store shoppers.
Reliability
Validity
True score test theory
Types of reliability…
Test-Retest: stability of the instrument – test it 2-3 times after a span of time.
Alternate form reliability: in test-retest reliability, the same instrument is given the second time. In
alternate form, the form of the questions may change.
Split half reliability: if an instrument has six questions that measure ‘loyalty’, compare the results
of first three with the next three.
… Types of Reliability…
Internal consistency – Several questions are often used to measure one
construct. E.g. ‘Price consciousness’ is measured using the statements below:
… Types of Reliability
Internal consistency is said to be achieved when scores of items are highly correlated.
◦ Cronbach’s alpha is used to calculate internal consistency.
◦ Internal consistency is also called inter-item reliability.
Inter rater reliability: more than two judges judging a boxing match.
◦ Three faculty members judging your SIP presentations.
Types of Validity…
Face validity: There is prima facie evidence to say that the results are accurate. E.g. the study
predicts a market share of 45%. Secondary sources also confirm this.
…Types of Validity…
Construct validity: Are we measuring the construct as it was defined?
◦ E.g. Brand Loyalty:
◦ Behavioral angle: A customer is loyal to a brand if (s)he buys the brand often.
◦ How often did you buy toothpaste in the last one year?
◦ Of these purchases, how often did you buy ‘Colgate’?
◦ Attitudinal angle: A customer is loyal to a brand if (s)he has a positive disposition towards it.
◦ Please rate the following brands on a scale 1 to 5 (I = dislike, 5= like)
◦ Colgate
◦ Pepsodent
◦ Close-up
◦ Etc.
Brand equity
…Types of Validity…
Content validity: Are we measuring the construct fully?
◦ Trust has three dimensions: Ability, Benevolence and Integrity.
Qualitative research
Questionnaire Design
Constructs developed by
management scientists
•Repurchase intention, Brand equity,
customer loyalty, service quality, etc.
Challenge of measurement
in management
In physical sciences, measurement is almost always additive.
◦ Length: Ruler, cms.
◦ Weight: Scale, kgs.
◦ Time: Clock, minutes.
◦ The problem is complicated further because the various constructs interact with each other.
Multi-item scale
Instructions
Likert scale,
interval scale
Scale items
Scales and dimensionality
Purchase Intention is a unidimensional scale
◦ I would buy Lewis jeans in my next purchase. (1=strongly disagree to 7 = strongly agree)
◦ Next time I buy jeans, I would buy Lewis (1=strongly disagree to 7 = strongly agree)
◦ Lewis is my first preference to buy when I go buying Jeans (1=strongly disagree to 7 = strongly agree)
Benevolence
Integrity
Creating a reliable and valid
construct
Specify the domain of •Literature Search
the construct
Collect data
Collect data
Adopted from
Assess reliability •Coefficient alpha, split-half, etc. Churchill GA
(1979), “A
CFA, SEM Paradigm for
Developing a Better
Assess Validity •Criterion Validity, Discriminant Validity, etc.
Measure of
Marketing
Constructs”, JMR,
Develop norms •Methods of summarizing distribution of scores pp. 64-73
Factor
Analysis
The Math
behind Factor
Analysis
method
Factor Analysis
A simple example
◦ 3 courses – Finance, Marketing and Business Policy
◦ If 𝑋1 , 𝑋2 , 𝑋3 are marks (out of 10) obtained by the students,
1 3 6 5
2 5 3 3
3 9 4 8
4 4 5 7
5 7 9 5
These grades are functions of two underlying factors 𝐹1 [quantitative ability] and
𝐹2 [Verbal ability]
Variable 𝑋𝒊 Loading on
𝐹𝑄𝐴 , 𝑙𝑋,𝑄𝐴 𝐹𝑉𝐴 , 𝑙𝑋,𝑉𝐴
Finance 𝑋𝐹𝐼𝑁 + 0
Marketing 𝑋𝑀𝑘𝑡 0 +
Business Pol 0 +
𝑋𝐵𝑃
Factor Analysis
𝑋𝐹𝑖𝑛 = 𝑙𝐹𝑖𝑛,𝑄𝐴 𝐹𝑄𝐴 + 𝑙𝐹𝑖𝑛,𝑉𝐴 𝐹𝑉𝐴 + 𝜀1
𝑿= 𝑳 𝑭 + 𝜺
3×1 3×2 2×1 3×1
𝐹1 , 𝐹2 , …, 𝐹𝑚 , 𝜀1 , 𝜀2 , … , 𝜀𝑝 are unobservable.
Factor Analysis
Can you calculate variance?
Can you calculate covariance?
1 3 6 5
2 5 3 3
3 9 4 8
4 4 5 7
5 7 9 5
Variance – covariance matrix from
the data
4.64 0.16 1.64
Var-Cov matrix calculated from the data = 0.16 4.24 −0.04
1.64 −0.04 3.04
It can be shown that
2 2 2
𝑉𝑎𝑟 𝑋𝑖 = 𝑙𝑖1 + 𝑙𝑖2 + … + 𝑙𝑖𝑚 + 𝜎𝑖2
Specific
Communality Variance
Communality: Sum of square of loadings (from before). Defined as: Amount of variance that the
factors explain in the variables.
While all the above are orthogonal rotations, sometimes, oblique rotation
provides a better explanation of the factors. But this method is rarely used. They
may be used when one expects the factors to be slightly correlated.
Key Takeaways up until now
While Quantitative research has the power of confirmation, Qualitative research has the power of
exploration.
Jennifer L Aaker (1997), “Dimensions of Brand Personality”, JMR, pp. 347 – 356.
Behavioral Research:
through
experimentation
Experiments marked the
emergence of modern science
in the 16th and 17th century. An experiment is a way of
• ‘Bodies That Stay Atop Water or Move systematically observing a
Within It.’ (Galileo, 1612) phenomenon.
• ‘On loadstone and magnetic bodies.’
(William Gilbert, 1600)
Early scientists like Aristotle based their scientific findings merely by
observation.
observation Modern scientists emphasize the need to ‘control’ for all extraneous
influences that might bias or limit observation.
Used to study an extremely well defined ‘focused’ phenomenon.
Experiments ◦ Do consumers prefer concept A/B/C
◦ What is more attractive – 10% off or 10% more
and causation ◦ What is the psychological impact of pricing a product as Rs. 79.00 vs. Rs.
in management 80.00?
“Control condition”
Does the demand for Colgate increase if it is at a discount of 10%?
◦ Have observations (Sales) for non-discount periods.
◦ Take observations for discount period.
◦ Can the increased sales be attributable to the discount?
◦ What about extraneous factors?
◦ Are the consumers same in both the instances?
◦ It is not possible to simultaneously give and not give discounts to the
10% off same consumers.
Video 2: Does size of a plate make you obese? [1:16 – 4:38; 17:36].
Correlation does not prove
causation
Income and education are correlated.
◦ Do you need to have high income to have good education or do you
need to have good education to have high income?
◦ There may be a correlation, but no causation
◦ There may be a unidirectional causation –
◦ High income –> high education OR
◦ High education –> high income .
◦ There may be a bi directional causation
◦ High income –> high education –> high income
◦ The relationship may not be causal at all, but due to a third variable
(often called a Confound).
◦ Wisdom causes bot income and education to be high.
Manipulable Manipulable
◦ Dosage, extent of discount, format of discount, color and type of
and non- packaging, etc.
manipulable Non – manipulable
causes ◦ Age, gender, number of times they have bought a particular brand, etc.
After an experiment
B
Casual Description
◦ A affects C.
A C
◦ B also affects C.
◦ A affects C by a larger amount as compared to B.
◦ B moderates the relationship between A and C [A*B have a significant effect on C]
◦ Or B mediates the relation between A and C
Casual explanation
Some terms and definitions
Experiment: a study in which an intervention is deliberately introduced to observe its
effects.
While experiments are used in practical applications, they are also widely used in
theory construction.
What happened when the ‘naïve’ respondent got an ally in the group?
Treatments
Observations
External validity generalizations - inferences about whether casual relationship holds over variations
in persons, settings, treatment and measurement variables.
Videos
Video 1: Does brand have an effect on evaluation of a product?
Video 3: Creative and innovative people buy ‘Apple’. But does buying the brand ‘Apple’ make you
creative?
A spa wants to offer a discount coupon for its treatments. It is wondering whether to give a coupon
that can be redeemed on any of the treatments or to give one that can be redeemed on a specific
treatment?
Consumers may consume the same products Goal: Hedonic vs. Utilitarian
or services with different goals, for example,
Choice: Self-chosen vs. Externally determined
for their own pleasure—a hedonic goal—or to
achieve some higher level purpose—a
utilitarian goal. This study investigates
whether this difference in goals influences
satisfaction with an outcome that was either
self-chosen or externally determined.
Consumption goals
HEDONIC UTILITARIAN
Eating out for pleasure Eating out to better understand local culture
Visiting a museum for fun Visiting the museum for collecting material for
class project.
Locus of choice
Internal – when a consumer chooses something herself.
◦ individuals perceive themselves to be meaningful agents in what they will experience and attribute outcomes
to their own actions.
However, when participants were driven by the utilitarian goal of writing a thesis, they liked the
personally chosen museum visit only as much as the curator-chosen one.
Alternate explanations
In study 1 the no choice condition involved an expert making the choice on behalf of the consumer.
The mitigation in satisfaction observed in the utilitarian condition could then be explained with
participants’ belief that the curator was at least as qualified as they were in selecting the most
pedagogically effective alternative.
The aim of the study was to tie the results to personal causation and not to expertise.
Study 1: 2 by 2 design
Imagine that you have been working suffering
Choice, Choice,
Utilitarian Hedonic really
mild back
hardpains
duringandthea semester
general soreness.
and
Your doctor
achieved important
tells youacademic
that thesesuccesses.
are just
symptoms
You think that
of overall
a professional
body fatigue
massage
and at
arecommends
local spa renowned
a professional
for themassage
quality ofat a
No No local spa
their massage
renowned
treatments
for thewould
quality of
choice, choice, represent
their massage
a great
treatments.
way to reward
Imagineyourself.
Utilitarian Hedonic having a having
Imagine gift certificate
a gift certificate
to spendto atspend
the
spathe
at that
spaoffered
that offered
four types
four of
types
massage
of
massage
treatment.treatment
treatment.
The
Youcertificate
are allowed is valid only forany
to select massage
of
#3 (of
the themassages.
four four massages)
massages
Study 2 results
Y1 = + 1X 1 + 2 X 2
Books Attend Books Attend
Grade
Grade Grade
X Y
Enjoy Read
Income (Rs.) D1 D2 D3
10000 and less 0 0 0
10000-20000 1 0 0
20000-30000 0 1 0
30000 and more 0 0 1