You are on page 1of 3

Monetary Inducements and

Mail Questionnaire Response


THOMAS R. WOTRUBA *

> Nonresponse and incomplete response are two mail questionnaire problems. This article
describes how two different monetary inducements meet these problems, as compared
with no inducement.

The purpose of this study was to investigate the effects less expensive, depending on the rate of return from
of two types of monetary inducements, as well as no various alternatives, the promised reward was chosen
inducement, on the percentage and completeness of re- as one alternative in the present study.
sponse to a mail questionnaire. The study was carried Finally, no major evidence was found which showed
out as a pretest to a major mail questionnaire sampling how different types of inducements affected complete-
study requiring 750 completed returns from urban ness of responses. Since the major study questionnaire
household residents. contained over 100 questions including scales, rankings,
and a few open questions, and many cross-tabulations
BACKGROUND were planned, responses had to be reasonably complete
to be of much value. Certainly a high rate of response
The study was needed for three reasons: First, the is a weak justification for recommending an inducement
results of previous studies on this subject might have if the responses are incomplete.
lost significance over time. Second, evidence from pre-
vious studies was somewhat conflicting and incomplete.
Third, the completeness of responses from various in- THE PRESENT STUDY
ducements was neglected in the literature but was im- These pretest samples were chosen from the popula-
portant in most mail questionnaire studies. These rea- tion which was eventually to be sent the major question-
sons are discussed further below. naire mailing. One hundred and fifty names were
Previous significant studies on this subject were pre- chosen by a random process, and divided systematically
sented in 1948 [1], 1951 [5], 1958 [3], 1960 [2], 1961 into three groups of 50 names each.
[4], and 1965 [7]. If the monetary aspect of the induce- The members of the first group were sent a quarter
ment was most important, it was possible that some (25¢) with a cover letter and the questionnaire. The
specific amount, say 25 cents, was no longer regarded as second group received the same cover letter except that
valuable as it was even a few years ago, and, thus, was it promised 50¢ to everyone who responded with a
not as effective in evoking responses. If, on the other completed questionnaire. The third group received a
hand, the importance of the inducement came from cover letter with no promise and no inducement. Six
its psychological effect on the respondent.' the possible weeks were allowed to ensure that all possible returns
decline in real value of the money might have been far were in. The questionnaire was sent by first-class mail
less important. to allow for returns in case the addressee could not be
Although most previous studies' conclusions on the reached; actually none was returned and no follow-ups
effectiveness of 25 cents as a minimum amount were were sent.
consistent, one study concluded differently [4]. Further,
little evidence was generally available on the effective-
RESULTS
ness of promising a monetary reward for a completed
response." Since such an approach might be considerably There were 20 responses from the first group, 10
* Thomas R. Wotruba is associate professor of marketing, from the second, and 9 from the third. The difference
San Diego State College. The author wishes to acknowledge in response percentages between the first and second
Richard D. Darley Associates who provided the opportunity to groups was significant at the 3 percent level. No sig-
do this study, and H. Christine Boland and Robert W. Wilbur nificant difference occurred between the response per-
for their assistance. centages in the second and third groups.
1 This psychological effect is discussed in [5, p. 420].

• The only discussion of this point is found in [6, p. 177], There were also differences in the completeness of
in which a promised reward of 25¢ provided little improvement responses received. When over half the total number of
in response rate when compared with no reward. questions were not answered, the response was con-
398

Journal of Marketing Research,


Vol. III (November 1966),398-400
MONETARY INDUCEMENTS AND MAIL QUESTIONNAIRE RESPONSE 399

COMPARISON OF MAJOR STUDY COSTS USING DIFFERENT INDUCEMENTS

25¢ sent 50¢ promised No inducement

Expected percent response 40 20 18


Necessary to mail 1875 3750 4167
Costs:
Postage out (@ 5¢) $93.75 $187.50 $208.35
Materials, printing, addressing, stuffing (est. @ 15¢) 281.25 562.50 625.05
Return postage (750 @ 7¢) 52.50 52.50 52.50
Inducement 469.00 412.50 0.00
(25¢ X 1875) (50¢ + 5¢ postage X 750)

Total costs without considering completeness $896.50 $1,215.00 $885.90


Percentage of incomplete replies 5 30 22
Additional necessary to mail- 94 1125 917
(1875 X .05) (3750 X .30) (4167 X .22)
Costs:
Postage out (@ 5¢) $3.70 $56.25 $45.85
Materials, etc. (est. @ 15¢) 14.10 168.75 137.55
Return postage 2.66 15.75 11.55
(38 X 7¢) (225 X 7¢) (165 X 7¢)
Inducement 23.50 123.75 b 0.00

Total costs for additional completed responses $44.96 $364.50 $194.95


Total costs for all completed responses $941.46 $1,579.50 $1,080.85
a Does not consider that an equivalent percentage of these will be incomplete.
b Would not be included if no reward were sent to original respondents whose returned questionnaire was incomplete.

sidered to be incomplete. The first group produced the Three further points should be noted. First, the total
lowest percentage of incomplete replies, which was 5 cost differences between the inducement approaches
percent (1 out of 20). The second group produced 30 became greater as the cost per questionnaire sent in-
percent incomplete replies (3 out of 10), and the third creased. For example, the cost of materials, printing,
group's replies were 22 percent incomplete (2 out of 9). etc., was estimated at 15¢ per questionnaire. If a
The difference between the percentage of incomplete higher cost were really correct, especially when consider-
replies in the first and second groups was nearly sig- able labor and special printing costs were necessary, the
nificant at the 5 percent level. total cost difference between the 25¢ and the two other
approaches would be greater. This was true because the
ANALYSIS other two approaches required sending a greater number
of questionnaires than did the 25¢ approach. A similar
Since the major study required 750 completed re- result occurred if postage costs of sending out the
sponses for the desired degree of precision, the following questionnaire were higher than the 5¢ used here.
analysis was performed to determine which of these Conversely, if any of these costs declined, there was a
three approaches should be used. Using response per- point at which no inducement became the least costly
centages from the pretest study as the best estimate of
of the three approaches.
percentage response in the major study, it was deter-
The second point concerns why the 25¢ inducement
mined that 1,875 questionnaires would have to be
mailed if the 25¢ inducement were used, 3,750 question- produced more complete responses. This seems to give
naires would have to be mailed if the promise of 50¢ weight to the argument that the inducement had greater
inducement were used, and 4,167 questionnaires would psychological rather than monetary motivation. It
have to be mailed if no inducement were used. After would seem that if respondents viewed this situation in
determining or estimating other costs pertinent to the only an economic sense, there should be more complete
mailing, a cost comparison of each of the three ap- and a greater rate of responses with a higher induce-
proaches was computed, and appears in the table. The ment. From these data, however, it seems more likely
top of the table does' not take into consideration the that respondents who received the inducement before
completeness of responses, but only the total number. replying not only felt obligated to return their question-
The bottom of the table indicates the additional costs naire, but felt obligated to do a better job in filling out
covering additional questionnaires needed to provide their responses. Perhaps it could be concluded that the
the desired number of complete replies. The results immediacy of the inducement was more important than
show that the approach using the 25¢ inducement its amount when the amount was not unreasonably
would incur the least expense when completeness of small, such as 1 or 5¢.
responses is important to the study. Finally, it is possible that various types of induce-
400 JOURNAL OF MARKETING RESEARCH, NOVEMBER 1966

ments affect in different ways the importance of other disregarded, the no inducement approach was least expen-
factors which influences the response rate. Such factors sive. Further, the differences in total cost among the
as the length and difficulty of the questionnaire, the various approaches could change, depending on the amount
nature of the population being sampled, and its interest of cost per questionnaire mailed.
in the subject affected the response rate. An immediate 4. Validity of this study was supported when the major
inducement might counteract negative factors of length questionnaire mailing, using the 25¢ inducement, produced
and difficulty and reinforce any positive factors, such as a response rate of 40.7 percent, with the percentage of
interest, more than would the delayed inducement. Such incomplete replies being even less than the 5 percent in
i.nteractions were not studied, however. In addition, dif- the pretest.
ferent types of inducements might produce different
types of bias by influencing different kinds of people REFERENCES
to respond, although no bias was obviously apparent in 1. J. C. Bevis, "Economic Incentives Used for Mail Ques-
this study when the demographic characteristics in the tionnaires," Public Opinion Quarterly, 12 (Fall 1948), 492-
three response groups were compared. 3.
2. L. R. Frankel, "How Incentives and Subsamples Affect the
Precision of Mail Surveys," Journal of Advertising Research,
CONCLUSIONS 1 (September 1960), 1-5.
3. W. M. Kephart and Marvin Bressler, "Increasing the Re-
1. Previous work on this subject has probably not lost sponse to Mail Questionnaires: A Research Study," Public
much value because of the passage of time. The psycho- Opinion Quarterly, 22 (Summer 1958), 123-32.
logical value of an immediate inducement seemed to be 4. A. E. Kimball, "Increasing the Rate of Return in Mail
stronger than the larger monetary value of a delayed in- Surveys," Journal of Marketing, 25 (October 1961), 63-4.
ducement, as long as the immediate inducement was not 5. R. A. Robinson and Phillip Agisim, "Making Mail Surveys
unreasonably small. More Reliable," Journal of Marketing, 15 (April 1951), 415-
2. Promise of a reward in return for a completed re- 24.
6. Christopher Scott, "Research on Mail Surveys," Journal of
sponse produced no significant difference from the no in- the Royal Statistical Society, Series A, 124 (Part 2, 1961),
ducement approach. 143-95.
3. When completeness of response was considered, the 7. J. J. Watson, "Improving the Response Rate in Mail Re-
desired number of responses was obtained at least-total cost search," Journal of Advertising Research, 5 (June 1965),
using the 25¢ inducement. However, if completeness were 48-50.

You might also like