You are on page 1of 96

Chap - 8 Measurement in Marketing Research

Measurement in Marketing Research


Measurement is the assignment of numbers or
other symbols to characteristics of objects according
to certain prespecified rules.
A measurement is a number that reflects some
characteristics of an object
Note that what we measure is not the object, but
some characteristics of it.
Thus, we do not measure consumers- only their
perceptions, attitudes, preferences, or other relevant
characteristics.
03/14/24 Measurement In research 1
• In marketing research, numbers are usually
assigned for one of two reasons.
• First, numbers permit statistical analysis of the
resulting data.
• Second, numbers facilitate the
communication of measurement rules and
results.
• Scaling: is the generation of a continuum
upon which measured objects are located.

03/14/24 Measurement In research 2


• To illustrate consider a scale from 1 to 100 for
locating consumers according to the
characteristics “attitude toward department
stores.” Each respondents is assigned a number
from 1 to 100 indicating the degree
(un)favorableness, with 1 = extremely
unfavorable, and 100 = extremely favorable.
• Measurement is the actual assignment of a
number from 1 to 100 to each respondent.
• Scaling is the process of placing the respondents
on a continuum with respect to their attitude
toward department stores.

03/14/24 Measurement In research 3


• In the opening example of most admired
companies, the assignment of numbers to
reflect the annual revenue was an example of
measurement.
• The placement of individual companies on the
annual revenue continuum was scaling.

03/14/24 Measurement In research 4


Primary Scales of Measurement

• There are four primary scales of


measurement: nominal, ordinal, interval, and
ratio. The four primary types of scales may be
described by the Acronym FOUR.
• F figurative: Nominal
• O rdinal scale
• U unconstructed zero point: interval scale
• R atio scale
03/14/24 Measurement In research 5
• The different comparative and non
comparative scales may be represented by the
acronym SCALES
– S semantic differential scale
– C nstant Sum scale
– A rranged in order: rank order scale
– L ikert scale
– E nagaged : paired comparison scale
– S taple scale

03/14/24 Measurement In research 6


The four scales briefly discussed here in under.
Nominal Scales
• Is defined as a scale whose numbers serve only as
labels or tags for identifying and classifying objects
with a strict one-to-one correspondence between
the numbers and the objects.
• For example, the numbers assigned to the
respondents in a study constitute a nominal scale is
used for the purpose of identification, there is a strict
one-to-one object and each object has only one
number and the objects.

03/14/24 Measurement In research 7


• Each number is assigned to only one object and each
object has only one number assigned to it.
• Common examples include social security numbers
and numbers assigned to football players.
• In marketing research, nominal scales are used for
identifying respondents, brands, attributes, stores, and
other objects.
• When used for classifying purposes, the nominally
scaled numbers serve as labels for classes or categories
.
• For example, you might classify the control group 1
and the experimental group as group 2.
• The classes are mutually exclusive and collectively
exhaustive.

03/14/24 Measurement In research 8


• The objects in each class are viewed as equivalent
with respect to the characteristics represented by
the nominal number.
• All objects in the same class have the same
number and no two classes have the same
number.
• The numbers in a nominal scale do not reflect the
amount of the characteristics possessed by the
objects.
• For example, a high school security number does
not imply that the person is in some way superior
to those with lower social security or vice versa.
03/14/24 Measurement In research 9
03/14/24 Measurement In research 10
• The object ranked first has more of the characteristics
as compared to the object ranked second, but
whether the object ranked second is a close second or
a poor second is knot known.
• Common examples of ordinal scale include quality
rankings, ranking of teams in a tournament,
socioeconomic class, and occupational status.
• In marketing research, ordinal scale is used to measure
relative attitudes, opinions, perceptions, and
preferences.

03/14/24 Measurement In research 11


Sample Ordinal –Scaled Questions

Please rank each brand in terms of your


preference. Place a “I” by your first choice, a “2”
by your second choice, and so on.
• ____________ Pepsi
• ___________ Seven Up
• ____________Coca Cola
For each pair of shoes, circle the one you would
be more likely to patronize.
• Loyal Versus Hadya
• Bambis versus Tana

03/14/24 Measurement In research 12


• In your opinion , would you say the prices at
Bambis are
• _____________higher than Hadya
• ______________about the same as she Solomon Haile
• _______________Lower than Loyal
Interval Scales
• Is defined as a scale in which the numbers are
used to rate objects such that numerically
equal distances on the scale represent equal
distances in the characteristics being
measured.

03/14/24 Measurement In research 13


• The difference between any two adjacent scale
values is identical to the difference between any
other two adjacent values of an interval scale.
• There is a constant or equal interval between scale
values.
• The difference between 1 and 2 is the same as the
difference between 2 and 3, which is a
temperature scale.
• In marketing research, attitudinal data obtained
from ratings scales are often treated as interval
data.
03/14/24 Measurement In research 14
• In the interval scale, the location of the zero
point is not fixed.
• Both the zero point and the units of
measurement are arbitrary.
• Hence, any positive linear transformation of
the form y= a +bx preserve the properties of
the scale.
• Here, x is thus the original scale value, y is the
transformed scale value, b is a positive
constant, and is any constant.
03/14/24 Measurement In research 15
• Therefore, two interval scales that rate objects A,
B, C, and D as 1, 2, 3, and 4, or as 22, 24, 26, and
28, are equivalent.
• Note that the latter scale can be derived from the
former by using a=20 and b=2 in the transforming
equation.
• Because the zero point is not fixed, it is not
meaningful to take ratios of scale values.
• As can be seen, the ratio of D to B values changes
from 2: 1 to become 7:6 when the scale is
transformed.
03/14/24 Measurement In research 16
• Yet ratios of differences between scale values
are permissible.
• In this process, the constants a and b in the
transforming equation drop out in the
computations.
• The ratio of the difference between D and B to
the difference between C and B is 2: 1 in both
the scales.

03/14/24 Measurement In research 17


Sample Interval –Scaled Questions

• Please rate each brand in terms of its overall


performance.

Very poor Very good


• Lacoste 1 2 3 4 5
• Parker 1 2 3 4 5
• Sony 1 2 3 4 5

03/14/24 Measurement In research 18


• Indicate your degree of agreement with the
following statements by encircling the
appropriate number.
S/N Statement Strongly Disagree Strongly Agree
1 2 3 4 5
1 I always look 1 2 3 4 5
for bargains
2 I enjoy being 1 2 3 4 5
outdoors
3 I love to cook. 1 2 3 4 5

03/14/24 Measurement In research 19


Ratio
• Is defined as the highest scale. It allows the
researcher to identify or classify objects, rank
order the objects, and compare intervals or
differences.
• It is also meaningful to compute ratios of scale
values.
• Not only is the difference between 2 and 5 the
same as the difference between 14 and 17,
but also 14 is seven times as large as two in an
absolute sense.

03/14/24 Measurement In research 20


• Common examples of ratio scales include height,
weight, and money.
• In marketing, sales, costs, market share, and
number of customers are variables measured on
a ratio scale.
• Ratio scales allow only proportionate
transformations of the form Y= bx, where b is a
positive constant.
• One can not add arbitrary constant, as in the case
of an interval scale.
• An example of this transformation is provided by
the conversion of yards to feet (b=3).

03/14/24 Measurement In research 21


• The comparison between the objects is
identical whether made in yards or feet.
• All statistical techniques can be applied to
ratio data.
• These include specialized statistics such as
geometric Mean, harmonic mean, and
coefficient of variation.

03/14/24 Measurement In research 22


Sample Ratio –Scaled Questions

Please indicate your age. ___________years.


• Approximately how many times in the last week have
you purchased anything over birr 5 in value at Tele Bar?
• 0 1 2 3 4 5 more
(specify__________)
• How much do you think a typical purchase of a birr 100,
000 term life insurance policy pays per year for that
policy? Birr__________
• What is the probability that you will use a lawyer‘s
services when you are ready to make a will?
_______________percent.
03/14/24 Measurement In research 23
A Comparative Scaling Technique

• Comparative scale s is one of the two types of


scaling techniques in which there is direct
comparison of stimulus objects with one
another.
• For example, respondents might be asked
whether they prefer Coke or Pepsi.
• Comparative scale data must be interpreted in
relative terms and have only ordinal or rank
order properties.

03/14/24 Measurement In research 24


• The major benefit of comparative scaling is that
small differences between stimulus objects can
be detected.
• As they compare the stimulus objects,
respondents are forced to choose between them.
• The major disadvantages of comparative scaling
include the ordinal nature of the data and the
inability to generalize beyond the stimulus
objects scaled.
• For example to compare RC cola to coke and
Pepsi, the researcher would have to do a new
study.

03/14/24 Measurement In research 25


• The previous study comparing coke and Pepsi would not
be of much use.
• These disadvantages are substantially overcome by non
comparative scaling techniques.
Non-Comparative Scales
• Is defined as one of two types of scaling techniques in
which each stimulus object is scaled independently of
the other objects in the stimulus set.
• The resulting data are generally assumed to be interval
or ratio scaled.

03/14/24 Measurement In research 26


• For example, respondents may be asked to
evaluate coke on a 1-to- 6 preference scale
(1=not at all preferred, 6 =greatly preferred).
• Similar evaluations would be obtained for Pepsi
and RC cola.
• Non - comparative scales can be further
classified as likert, semantic differential or
staple scales.
• Non - comparative scaling is the most widely
used technique in marketing research.
03/14/24 Measurement In research 27
Comparative Scaling Techniques
Comparative scales can be divided into the following:
Paired Comparison
• Paired Comparison is defined as comparative scaling
techniques in which a respondent is presented with two
objects at a time and asked to select one object in the pair
according to some criterion. The data obtained are ordinal in
nature.
• Paired comparison scales are frequently used when the
stimulus objects are physical products.
• Coca-Cola is reported to have conducted more than 190,000
paired comparison s before introducing New Coke.

03/14/24 Measurement In research 28


• Comparative comparison scaling is the most widely
used comparative scaling technique.
• The most common method of taste testing is paired
comparison.
• The consumer is asked to sample two different
products and select the one with the most appealing
taste.
• Transitivity of preference: is defined as an
assumption made in order to convert paired
comparison data to rank order data. It implies that if
brand A is preferred to brand B and brand B is
preferred to brand C, then brand A is preferred to
brand C.
03/14/24 Measurement In research 29
Rank Order
• Is defined as a comparative scaling technique in
which respondents are presented with several
objects simultaneously and asked to order or rank
them according to some criterion.
• For example, respondents may be asked to rank
brands of toothpaste according to overall
preference.
• These rankings are typically obtained by asking the
respondents to assign a rank of 1 to the most
preferred brand, 2 to the second most preferred
brand, and so on, until a rank of n is assigned to
the least preferred brand.

03/14/24 Measurement In research 30


• Rank order scaling is commonly used to measure
preference for brands as well as attributes.
• Rank order data are frequently obtained from
respondents in conjoint analysis , because rank
order scaling forces the respondents to
discriminate among the stimulus objects.
Advantages
• It takes less time and process eliminates
intransitive responses.
• If there are n stimulus objects, only (n-1) scaling
decisions need be made in rank order scaling.

03/14/24 Measurement In research 31


– However, in paired comparison scaling, [n (n-1)/2]
decisions would be required.
– Most respondents easily understand the instructions
for ranking.
Disadvantages
– This technique produces only ordinal data.
Preference for Toothpaste Brands Using Rank and
Order Scaling
– Rank the various brands of toothpaste in order of
preference. Begin by picking out the one brand that
you like most and assign it a number 1.

03/14/24 Measurement In research 32


• Then find the second most preferred brand
and assign it a number 2. Continue this
procedure until you have ranked all the brands
of toothpaste in order of preference. The least
preferred brand should be assigned a rank of
10.
• No two brands should receive the same rank
number.
• The criterion of preference is entirely up to
you.
03/14/24 Measurement In research 33
There is no right or wrong answers. Just try to be consistent.

S/N Brand Rank order


1 crest
2 Colgate
3 aim
4 gleam
5 sensodyne
6 ultra brite
7 Close up
8 pepsiodent
9 plus white
10 stripe

03/14/24 Measurement In research 34


Constant Sum Scaling
• Is defined as a comparative scaling techniques
in which respondents are required to allocate
a constant sum of units such as points , dollars,
chits, stickers, or chips among a set of stimulus
objects with respect to some criterion.
• Respondents may be asked to allocate 100
points to attributes of toilet soap in a way that
reflects the importance they attach to each
attribute.

03/14/24 Measurement In research 35


• If an attribute is unimportant, the respondent
assigns it zero points.
• If an attribute is twice as important as some
other attribute, it receives twice as many points.
The sum of all the points is 100.
• Hence, the name of the scale.
• The attributes are scaled by counting the points
assigned to each one by all the respondents and
dividing by the number of respondents.

03/14/24 Measurement In research 36


Importance Of Toilet Soap Attributes Using A Constant Sum Scale.

Instructions
• Below are eight attributes of toilet soaps. Please
allocate 100 points among the attributes so that
your allocations reflect the relative importance
you attach to each other. The more points an
attribute receives, the more important that
attribute is. If an attribute is not at all important,
assign it zero points. If an attribute is twice as
important as some other attributes, it should
receive twice as many points.

03/14/24 Measurement In research 37


S/N Average Responses of Three Segments
Attributes Segment I Segment II Segment III
1 Mildness 8 2 4
2 Lather 2 4 17
3 Shrinkage 3 9 7
4 Price 53 17 9
5 Fragrance 9 0 19
6 Packaging 7 5 9
7 Moisturizing 5 3 20
8 cleaning power 13 60 15

Sum…………………… 100 100 100

Measurement In research
03/14/24 38
Analysis
• Segment I attaches overwhelming importance to price.
• Segment II considers basic cleaning power to be of a
prime importance.
• Segment III values lather, fragrance, moisturizing, and
cleaning power.
• Such information can not be obtained from rank order
data unless they are transformed into interval data.
• Note that the constant sum also has an absolute zero-
10 points are twice as many as 5 points, and the
difference between 5 and 2 points is the same as the
difference between 57 and 54 points.

03/14/24 Measurement In research 39


• For this reason, constant sum scale data are
sometimes treated as metric.
• Although this may be appropriate in the limited
context of this stimuli scaled, these results are
not generelizable to other stimuli not included
in the study.
• Hence strictly speaking, the constant sum
should be considered an ordinal scale because
of its comparative nature and the resulting lack
of generizablity.
03/14/24 Measurement In research 40
Advantages
– It allows for fine discrimination among stimulus objects without
requiring too much time.
Disadvantages
– Respondents may allocate more or fewer units than
those specified.
• For example a respondent may allocate 108 or 94
points.
• The researcher must modify such data in some way
or eliminate this respondent from analysis.
– Rounding error if too few units are
used.
• The use of a large number of units may be too taxing
on the respondent and cause confusion and fatigue.
03/14/24 Measurement In research 41
Q-Sort And Other Procedures
• is defined as a comparative scaling techniques
that uses rank order procedure to sort objects
based on similarity with respect to some
criterion.
• This technique uses a rank order procedure in
which objects are sorted into piles based on
similarity with respect to some criterion.
• For example, respondents are given 100 attitude
statements on individual cards and asked to
place them into 11 piles , ranging from “ most
highly agreed with “ to “ least highly agreed
with.”
03/14/24 Measurement In research 42
• The number of objects to be sorted should not
be less than 60 nor more than 140; 60 to 90
objects is a reasonable range.
• The number of objects to be placed in each
pile is prespecified, often to result in a roughly
normal distribution of objects over the whole
set.
• For example , respondents may be asked to
indicate whether they agree or disagree with
each of a series of statements measuring
attitude toward department stores.

03/14/24 Measurement In research 43


• Then they assign a number between 0 to 100
to each statement to indicate the intensity of
their agreement or disagreement.
• Providing this type of number imposes a
cognitive burden on the respondents.
• Finally, mention must be made of Guttmann
scaling, or scalogram analysis, which is a
procedure for determining, whether a set of
objects can be ordered into an internally
consistent, uni dimensional scale.
03/14/24 Measurement In research 44
Non Comparatives Scaling Techniques
• is defined as one of two types of scaling
techniques in which each stimulus object is scaled
independently of the other objects in the
stimulus set.
• Non comparative techniques consist of continuous
and itemized rating scales.
i) Continuous Rating Scale
• Is referred to as a graphic rating scale , this
measurement scale has the respondents rate the
object by placing a mark at the appropriate
position on a line that runs from one extreme of
the criterion variables to the other.

03/14/24 Measurement In research 45


• Thus, the respondents are not restricted to
selecting form marks previously set by the
researcher.
• The form of the continuous scale may vary
considerably.
• For example, the line may be vertical or
horizontal; scale points, in the form of
numbers or brief descriptions, may be
provided; and, if provided, the scale points
may be few or many.
03/14/24 Measurement In research 46
Three version of a continuous rating scale are illustrated below.

How would you rate Tana Department store?

Version 1

• Probably the Worst…………I…………………………………Probably the Best


Version 2

• Probably the Worst…………I…………………………………Probably the Best


10 20 30 40 50 60 70 80 90 100
Version 3
• Probably the Worst……………I………………………………..Probably the Best
0 10 20 30 40 50 60 70 80 90 100

03/14/24 Measurement In research 47


– Once the respondent has provided the ratings, the
researcher divides the line into as many categories
as desired and assigns scores based on the
categories into which the ratings fall.
Advantages
– They are easy to construct.
Disadvantages
– Scoring is cumbersome and unreliable.
– Continuous scales provide little new information.
– Hence, their use in marketing research has been
limited.

03/14/24 Measurement In research 48


Itemized Rating Scale (IRS)
• IRS is a measurement scale having numbers
and/ or brief descriptions associated with each
category. The categories are ordered in terms
of scale position and the respondents are
required to select the specified category that
best describes the object being rated.
• Itemized rating scales are widely used in
marketing research and form the basic
components of more complex scales , such as
multi-item ratings scales.
03/14/24 Measurement In research 49
• The most commonly used rating scales are
the likert, semantic differential and staple
scales, and then examine the major issues
surrounding the use of these scales.
Likert Scale (LS)
• LS is a measurement scale with five response
categories ranging from “ strongly disagree”
to “ strongly agree” , which requires the
respondents to indicate a degree of
agreement or disagreement with each of a
series of statements related to the stimulus
objects.
• A likert scale can be used for evaluating
attitudes towards Tana department store.
03/14/24 Measurement In research 50
Project Research Using Likert Scale

Instructions
Listed below are different opinions about Tana department stores. Please
indicate how strongly you agree or disagree with each by using the
following scale:
1= strongly disagree
2= Disagree
3= neither agree nor disagree
4= agree
5= strongly agree

03/14/24 Measurement In research 51


Strongly Disagree Neither agree Agree Strongly
S/N Attributes
Disagree nor disagree agree
1 Tana sells high quality
1 2 3 4 5
merchandise

2 Tana has poor in-store 1 2 3 4 5


service
3 I like to shop at Tana 1 2 3 4 5

4 Tana does not offer 1 2 3 4 5


good mix different
brands within a product
category.
5 The credit policies at 1 2 3 4 5
tana are terrible.

6 Tana is where shops. 1 2 3 4 5

7 I do not like the 1 2 3 4 5


advertising done by
Tana.
8 Tana sells a wide variety 1 2 3 4 5
of Merchandise.

9 Tana charges fair prices. 1 2 3 4 5

03/14/24 Measurement In research 52


Analysis
• To conduct the analysis, each statement is assigned
a numerical score, ranging either from -2 to +2 or 1
to 5 .
• The analysis can be conducted on an item-by-item
basis (profile analysis), or a total (summated) score
can be calculated for each respondent by summing
across items.
• LS is also called the summated scale.
• Note that for a negative statement, an agreement
reflects an unfavorable response, whereas for a
positive statement, agreement represents a
favorable response.
03/14/24 Measurement In research 53
• Accordingly, a “strongly agree” response to a
favorable statement and a “strongly disagree”
response to an unfavorable statement would both
receive scores of 5.
• In the scale shown above, if a higher score is to
denote a more favorable attitude, the scoring of
items 2, 4, 5, and 7 will be reversed.
• Thus the respondent in the department store project
example has an attitude score of 22.
• Each respondent’s total score for each store is
calculated.
• A respondent will have the most favorable attitude
toward the store with the highest score.

03/14/24 Measurement In research 54


Advantages
– It is easy to construct and administer.
– Respondents readily understand how to use the scale, making it suitable
for mail, telephone, or personal interviews.
Disadvantages
– It takes longer to complete than other itemized rating scales because
respondents have to read each statement.
Semantic Differential (SD)
– SD is a 7 –point rating scale with endpoints associated with bipolar labels
that have semantic meaning.
– In a typical application, respondents rate objects on a number of itemized,
7-point scales bounded at each end by one of two bipolar adjectives, such
as “cold” and “warm.”

03/14/24 Measurement In research 55


Project Research on Semantic Differential Scale

Instructions
• This part of the study measures what certain
department stores mean to you by having you judge
them on a series of descriptive scales bounded at
each end by one of two bipolar adjectives.
• Please Mark (X) the blank that best indicates how
accurately one or the other adjectives describes
what the store means to you. Please be sure to
mark every scale; do not omit any scale.
03/14/24 Measurement In research 56
Form
Tana is:
Powerful ____/_____/_____ /_____/__X___/_________/_______/ Weak
Unreliable ____/_____/_____ /_____/__X___/_________/_______/Reliable
Modern ____/_____/_____ /_____/_____/_________/___X____/ Old
fashioned
Cold ____/_____/_____ /_____/_____/_____X____/_______/ Warm
Careful ____/__X__/_____ /_____/__ __/_________/_______/ Careless

A Semantic Differential Scale For Measuring Self-concepts, Person Concepts,


And Product Concepts.

Rugged /___/____/____/____/_____/_____/_____/ Delicate


Excitable /___/____/____/____/_____/_____/_____/ Calm
Uncomfortable /___/____/____/____/_____/_____/_____/ comfortable
Dominating /___/____/____/____/_____/_____/_____/ submissive
Thrifty /___/____/____/____/_____/_____/_____/ Indulgent
Pleasant /___/____/____/____/_____/_____/_____/ unpleasant
Contemporary /___/____/____/____/_____/_____/_____/Non contemporary
03/14/24 Measurement In research 57
• Organized /___/____/____/____/_____/_____/_____/ Unorganized
• Rational /___/____/____/____/_____/_____/_____/ Emotional
• Youthful /___/____/____/____/_____/_____/_____/ Mature
• Formal /___/____/____/____/_____/_____/_____/Informal
• Orthodox /___/____/____/____/_____/_____/_____/ liberal
• Complex /___/____/____/____/_____/_____/_____/ simple
• Colorless /___/____/____/____/_____/_____/_____/ colorful
• Modest /___/____/____/____/_____/_____/_____/ Vain

03/14/24 Measurement In research 58


Analysis
• Individual items on a semantic differential scale may be
scored on a -3 to + 3 or a 1-to-7 scale. The resulting data are
commonly analyzed through profile analysis.
• In profile analysis, means or median values on each rating
scale are calculated and compared by plotting or statistical
analysis.
• This helps determine the overall differences and similarities
among the objects.
• To assess differences across segments of respondents, the
researcher can compare mean responses of different
segments.
• Although the mean is most often used as a summary
statistics, there is some controversy as to whether the data
obtained should be treated as an interval scale.

03/14/24 Measurement In research 59


• On the other hand, in cases when the researcher
requires an overall comparison of objects, such as
to determine store preference, the individual item
scores are summed to arrive at a total score.
• Its versatility makes the semantic differential a
popular rating scale in marketing research.
• It has been widely used in comparing brand,
product, and company images.
• It has also been used to develop advertising and
promotion strategies and in new product
development studies.
• Several modifications of the basic scale have been
proposed.

03/14/24 Measurement In research 60


Staple Scales (SS)
• SS is a scale for measuring attitudes that consists of
single adjectives in the middle of an even –numbered
range of values, from -5 to +, without a neutral point
(Zero).
• This scale is usually presented vertically.
• Respondents are asked to indicate how accurately or
inaccurately each term describes the object by
selecting an appropriate numerical response category.
• The higher the number, the more accurately the term
describes the object, as shown in the department
store project.
• Several modifications of the basic scale have been
proposed.

03/14/24 Measurement In research 61


Project Research on Staple Scale
Instructions
• Please evaluate how accurately each word or
phrase describes each of the department
stores. Select a plus number for the phrases
you think describe the store accurately. The
more accurately you think the phrase describes
the store, the larger the plus number you
should choose. You should select a minus
number for phrases you think do not describe
it accurately.

03/14/24 Measurement In research 62


+5 +5
+4 +4
+3 +3
+2 +2
+1 +1
+5 +5
+4 +4
+3 +3

03/14/24 Measurement In research 63


• The less accurately you think the phrase
describes the store, the larger the minus
number you should choose. You can select
any number, from + 5 for phrases you think
are very accurate, to – 5 for phrases you think
are very inaccurate.

03/14/24 Measurement In research 64


High Quality
Poor Service
-

-1 -1

-2 -2

-3 -3

-4 -4

-5 -5

03/14/24 Measurement In research 65


The Number of Scales Categories to Use.
• Two conflicting considerations are involved in
deciding the number of scales categories.
• The greater the number of scale categories, the
finer the discrimination among stimulus objects
that is
• On the other hand, most respondent can not
handle more than a few categories.
• Traditional guidelines suggest that appropriate
number of categories should be seven plus or
minus two: between five and nine.

03/14/24 Measurement In research 66


• Yes there is single optimal number of categories.
Several factors should be taken into account in
deciding on the number of categories.
• If the respondents are interested in the scaling
task and are knowledgeable about the objects, a
larger number of categories may be employed.
• On the other hand, if the respondents are not
very knowledgeable or involved with the task,
fewer categories should be used.
• Likewise, the nature of the objects is also
relevant. Some objects do not lend themselves to
fine discrimination, so a small number of
categories is sufficient.
03/14/24 Measurement In research 67
• Another important factor is the mode of data collection.
• If telephone interviews are involved, many categories
may confuse the respondents.
• Likewise, space limitations may restrict the number of
categories in mail questionnaires.
• How the data are to be analyzed and used should also
influence the number of categories.
• In situations where several scale items are added together
to produce a single score for each respondent, five
categories are sufficient.
• The same is true if the researcher wishes to make broad
generalizations or group comparisons.
• The same is true if the researcher wishes to make broad
generalizations or group comparisons.
03/14/24 Measurement In research 68
Balanced Versus Unbalanced Scale.
• Balanced scale is a scale with an equal number
of favorable and unfavorable categories.
• Examples of balanced and unbalanced scales
are given below:

03/14/24 Measurement In research 69


Balanced and Unbalanced Scales
Balanced Scale Unbalanced Scales

Musk For Men is : Musk for men is :

Extremely Good _______________ Extremely Good ________________

Very Good ________________ Very Good __________________

Good ________________
Good

Bad __________________
Very Bad ___________________ _____________________
Very Bad

Extremely Bad _____________________ Extremely Bad ____________________

03/14/24 Measurement In research 70


• In general the scale should be balanced in
order to obtain objective data.
• However, if the distribution of responses is
likely to be skewed, either positively or
negatively, an unbalanced scale with more
categories in the direction of skewness may
be appropriate.
• If an unbalanced scale is used, the nature and
degree of unbalance in the scale should be
taken into account in data analysis.
03/14/24 Measurement In research 71
Odd or Even Number Categories.

• With an odd number of categories, the middle scale


position is generally designated as neutral or impartial.
• The presence, position, and labeling of a neutral
category can have a significant influence on the
response.
• The likert scale is balanced rating scale in the scale
should be taken into account in data analysis.
• The decision to use an odd or even number of
categories depends on whether some of the
respondents may be neutral on the response being
measured.

03/14/24 Measurement In research 72


• If, on the other hand , the researcher wants to
force a response or believes that no neutral or
indifferent responses exists , a rating scale
with an even number of categories no neutral
or indifferent response exists , a rating scale
with an even number of categories should be
used.
• A related issue is whether the scale should be
forced or non forced.

03/14/24 Measurement In research 73


Forced Versus Non Forced Choice.
• A forced scale is a rating scale that forces the
respondents to express an opinion because
“no opinion” or “no knowledge “option is not
produced.
• In such a case, respondents without an
opinion may mark the middle scale position.
• If a sufficient proportion of the respondents
do not have opinions on the topic , marking
the middle position will distort measures of
central tendency and variance.

03/14/24 Measurement In research 74


• In institutions where the respondents are
expected to have no opinions, as opposed to
simply being reluctant to disclose it, the accuracy
of data may be improved by a non-forced scale
that includes a “no opinion” category.
• The Nature and Degree of the Verbal
Description.
• The nature and degree of verbal description
associated with scale categories varies
considerably and can have an effect on the
responses
• Scale categories may have verbal, numerical, or
even pictorial descriptions.
03/14/24 Measurement In research 75
• Furthermore, the researcher must decide whether
to label every scale category, some scale
categories, or only extreme scale categories.
• Surprisingly, providing a verbal description for
each category may not improve the accuracy or
reliability of the data.
• Yet an arrangement can be made for labeling all or
many scale categories to reduce scale ambiguity.
• The category descriptions should be located as
close to the response categories as possible.
• The strength of adjectives used to anchor the scale
may influence the distribution of the responses.
03/14/24 Measurement In research 76
• With strong anchors (1= completely disagree, 7 =
completely agree), respondents are less likely to
use the extreme scale categories.
• This results in less variable and more peaked
response distributions.
• Weak anchors (1= generally disagree, 7=
generally agree), in contrast, produce uniform or
flat distributions.
• Procedures have been developed to assign values
to category descriptors so as to result in balanced
or equal –interval scales.

03/14/24 Measurement In research 77


The Physical Form of the Scale.

• A number of options are available with respect


to scale form or configuration.
• Scales can be presented vertically or
horizontally.
• Categories can be expressed by boxes , discrete
lines, or units on a continuum and may or may
not have numbers assigned to them
• If numerical values are used, they may be
positive, negative, or both.
03/14/24 Measurement In research 78
03/14/24 Measurement In research 79
• ___ ____ _____ _____ _____ _____ ______ _________
• very harsh Somewhat Neither harsh somewhat Gentle Very gentle
• harsh harsh nor gentle gentle

• -3 -2 -1 O + 1 +2 +3
Neither harsh very gentle
• nor gentle

03/14/24 Measurement In research 80


The following table summarizes the six decisions in designing
rating scales.
Summary of itemized
1 Number of categories Aalthough Rating scales
there is no single ,Decisions
optimal number traditional
guidelines suggest that there should be between five and nine
categories.
2 balanced versus unbalanced In general, the scale should be balanced to obtain objective data.

3 odd or even number categories If a neutral or indifferent scale response is response is possible
from at least some of the respondents, an odd number of
categories should be used.

4 forced versus nonforced In situations where the respondents are expected to have
opinion, the accuracy of data may be improved by a nonforced
scale.
5 verbal description An argument can be made for labeling all or many scale
categories. The category descriptions should be located as close to
the response categories as possible.

6 Physical form A number of options should be tried and the best one selected.

03/14/24 Measurement In research 81


• The following table presents some commonly
used scales.
• These scales as having five categories, the
number of categories can be varied depending
upon the judgment of the researcher.

03/14/24 Measurement In research 82


Some Commonly Used Scales in Marketing
Construct
Scale Descriptors

Attitude Very Bad Bad Neither Bad Nor Good Very Good
Good

Importance Not At All Not Important Neutral Important Very Important


Important

Satisfaction Very Dissatisfied Neither Satisfied Very Satisfied


Dissatisfied Dissatisfied Nor
Satisfied

Purchase Intent Definitely Will Probably Not Buy Might Or Might Probably Will Buy Definitely Will
Not Buy Not Buy Buy

Purchase Never Rarely Sometimes Often Very Often


Frequency

03/14/24 Measurement In research 83


Multi-Item Scale
• The development of multi-item scales requires
considerable technical expertise. The figure is
a paradigm for constructing multi-item scales.

03/14/24 Measurement In research 84


Development of a Multi Item Scale

Develop a Theory

Generate An Initial Pool Of Items:
Theory, Secondary Data, and Qualitative Research

Select A Reduced Set Of Items Based On Qualitative Judgment

Collect Data from a Large Pretest Sample


Perform Statistical Analysis 

Develop a Purified Scale

Collect More Data from A Different Sample

Evaluate Scale Reliability, Validity, and Generalizablity

Prepare the Final Scale

03/14/24 Measurement In research 85


• The characteristics to be measured are frequently called a
construct.
• Scale development begins with an underlying theory of the
construct being measured.
• A theory is necessary not only for constructing the scale but
also for interpreting the resulting scores.
• The next step is to generate an initial pool of scale items.
• Typically, this is done based on theory, analysis of
secondary data, and qualitative research.
• From this pool, a reduced set of potential scale items is
generated by the judgment of the researcher and other
knowledgeable individuals.
• Some qualitative criterion is adopted to aid their judgment.
• The reduced set of items is still too qualitative criterion is
adopted to aid their judgment.

03/14/24 Measurement In research 86


• The reduced set of items is large to constitute a scale.
• Thus, further reduction is achieved in a quantitative
manner.
• Data are collected on the reduced set of potential scale
items from a large pretest sample of respondents.
• The data are analyzed using techniques such as
correlations, factor analysis, cluster analysis,
discriminant analysis.
• As a result of this statistical analysis, several more items
are eliminated, resulting in a purified scale.
• The purified scale is evaluated for reliability and validity
by collecting more data from a different sample.
• One the basis of these assessments, a final set of scale
items is selected.

03/14/24 Measurement In research 87


• Measuring technical sophistication with a technically
sophisticated scale.
• The following multi-item scale measures the technical
sophistication of a product line.
1 Technical 1 2 3 4 5 6 7

2 Low Engineering 1 2 3 4 5 6 7
Content

3 Fast Changing 1 2 3 4 5 6 7

4 Unsophisticated 1 2 3 4 5 6 7

5 Commodity 1 2 3 4 5 6 7

6 Unique 1 2 3 4 5 6 7

7 Complex 1 2 3 4 5 6 7

03/14/24 Measurement In research 88


• Item 1, 3, 6, and 7 are reversed when scoring. This
scale can be used in industrial marketing to measure
the technical sophistication of a customer‘s product
line and suggest changes to improve technical quality.
Scale Evaluation
• A multi-item scale should be evaluated for accuracy
and applicability.
• Scale evaluation involves an assessment of reliability,
validity, and generalizablity of the scale.
• Approaches to assessing reliability include test-retest
reliability, alternative –forms reliability, and internal
consistency reliability.

03/14/24 Measurement In research 89


• Reliability: refers to the extent to which a scale
produces consistent results if repeated
measurements are made on the characteristics.
• Test-re-test reliability : is an approach for assessing
reliability in which respondents are administered
identical sets of scale items at two different items under
as nearly equivalent conditions as possible.
• Alternative –Forms of Reliability: is an approach for
assessing reliability that requires two equivalent forms of
the scale to be considered and then the same
respondents are measured at two different times.

03/14/24 Measurement In research 90


• Internal consistency reliability: is an approach for
assessing the internal consistency of the set of items
when several items are summated in order to form a
total scores are correlated.
• Split-half-reliability: is a form of internal consistency
reliability in which the items constituting the scale are
divided into two halves and the resulting half scores
are correlated.
• Coefficient alpha / Cronbach’s alpha is a measure of
internal consistency reliability that is the average of all
possible split-half coefficients resulting from different
splitting the scale items.
• This coefficient varies from 0 to 1, and a value of 0.6 or
less generally indicates unsatisfactory internal
consistency reliability.

03/14/24 Measurement In research 91


• Validity: is the extent to which differences in observed
scale scores reflect true differences among objects on
the characteristics being measured, rather than
systematic or random errors.
• Content validity: a type of validity, sometimes called
face validity that consists of a subjective but
systematic evaluation of the representativeness of the
content of a scale for the measuring task at hand.
• Criterion validity: is a type of validity that examines
whether the measurement scale performs as expected
in relation to other variables selected as meaningful
criteria.

03/14/24 Measurement In research 92


• Construct validity: is a type of validity that
addresses the question of what construct or
characteristics the scale is measuring. An
attempt is made to answer theoretical
questions of why a scale works and what
deductions can be made concerning the
theory underlying the scale.
• Convergent validity: is the extent to which
the scale correlates positively with other
measures of the same construct. It is not
necessary that all these measures be obtained
by using conventional scaling techniques.

03/14/24 Measurement In research 93


• Discriminant validity: is the extent to which a
measure does not correlate with other
constructs from which it is supposed to differ.
• Nomological validity: a type of validity that
assesses the relationship between theoretical
constructs. It seeks to confirm significant
correlations between the constructs as
predicted by theory.
• Generalizablity: refers to the extent /degree
to which one can generalize from the
observations at hand to a universe of
generalizations.
03/14/24 Measurement In research 94
Measurement Accuracy
– Measurement error is the variation in the information
sought by the researcher and the information
generated by the measurement process employed.
– A measurement is not the true value of the
characteristics of interest but rather an observation of
it.
Potential Sources of Error
– Other relatively stable characteristics of the individual
that influence the test score, such as intelligence,
social desirability, and education.
– Short-term or transient personal factors, such as
health, emotions, fatigue.

03/14/24 Measurement In research 95


• Situational factors, such as the presence of other
people, noise, and distraction.
• Sampling of items included in the scale addition,
deletion, or changes in the scale items.
• Lack of clarity of the scale, including the
instructions or the items themselves.
• Mechanical factors, such as poor printing
overcrowding of items in the questionnaires and
poor design.
• Administration of the scale, such a differences
among interviewers.
• Analysis factors, such as differences in scoring
and statistical analysis.

03/14/24 Measurement In research 96

You might also like