Professional Documents
Culture Documents
REFERENCES
Linked references are available on JSTOR for this article:
http://www.jstor.org/stable/41426663?seq=1&cid=pdf-reference#references_tab_contents
You may need to log in to JSTOR to access the linked references.
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
http://about.jstor.org/terms
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted
digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about
JSTOR, please contact support@jstor.org.
Springer is collaborating with JSTOR to digitize, preserve and extend access to Journal of Business
Ethics
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
J Bus Ethics (2012) 106:149-160
DOI 10.1007/S10551-01 1-0986-7
Received: 18 July 2011 /Accepted: 20 July 2011 /Published online: 7 August 2011
© Springer Science+Business Media B.V. 2011
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
150 D. С. Frechtling, S. Boo
Background on Management
The "instrument of public opinion" referred to here is
the scientific opinion poll defined by three characteristics:
Relatively little has been publis
1. Designed to measure the views of a specific group of
agement research. Rau and Kan
humans;
issues that can arise in marketi
2. Respondents are chosen according to explicit criteria
that the establishment of "code
in order to ensure representation of the group;
keting research practice" (p. 14
3. Survey questions are "worded in a balanced way"
ation. Payne (2000) explores
(ESOMAR 2008, p. 5).
ideologies, and other influences
business researchScientific opinionpractice,
polls, also called probability sample ofte
(2005) discusses duties
surveys, gather information for dealing withof a number ofscient
tourism research and concludes that researchers must act management issues, such as market segmentation, cus-
tomer satisfaction, and product planning (Groves et al.
with honesty and integrity while pursuing justice. Perdue
2009).
(1991) examines the field of visitor surveys to determine
the economic impact of tourists on a geographic area and
Structure of the WAPOR Code
provides a list of potential ethical problems. He suggests
that presenting results from a convenience sample of visi-
The WAPOR Code of Professional Ethics and Practices
tors as being the same as those derived from a probability
sample is unethical behavior. "prescribes principles of ethical practices for the guidance
of its members, and a framework of professional standards
Chia (2002) observes that management researchers are
"governed by a code of practice established by a com-that should be acceptable to users of research and to the
munity of scholars" (p. 4). While some such codes maypublic
be at large" (World Association for Public Opinion
implicitly understood, others take the form of formal Research
pro- 2010, p. 1). Employing the classification scheme
fessional codes of ethical conduct (Groves et al. 2009;
proposed by Gaumnitz and Lere (2004), the WAPOR Code
Korac-Kakabadse et al. 2002). contains 44 statements in five thematic areas:
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
On the Ethics of Management Research 151
it is overwhelmingly positive ("thou shalt" = 35 state- researchers - procedures directly affecting survey respon-
ments) rather than negative ("thou shalt not" = 9 state- dents - is not addressed here. Researchers' ethical obliga-
ments). Finally, it appears to be aspirational rather than tions to respondents are often embodied in law
legal since the words "enforceable" do not appear and no (Institutional Review Boards and other procedures) and
mechanism is stated for reporting and investigating alleged deal with minimizing potential harm to respondents and
violations (in contrast to Skubik and Stening 2009 and maximizing benefits to them, including respect for persons
Academy of Management, n.d., p. 6). and informed consent of respondents before their
WAPOR Code Article П, section C, specifies 14 "Rules participation.
of Practice Regarding Reports and Survey Results," stat- Groves et al. (2009) maintain that a broad aspect of
ing, "Every complete report on a survey should contain an ethical practice in survey research regards general stan-
adequate explanation of the following relevant points" dards of scientific conduct. These standards include fol-
(p. 3). These points are listed verbatim in Table 1. lowing procedures that yield valid conclusions, as well as
The WAPOR Code specifies the ethical obligations of avoiding "plagiarism, falsification or fabrication in pro-
survey researchers toward the public, including their cli- posing, performing, reviewing research or on reporting
ents. This appears to be congruent with one of the "two research results" (p. 372). This area of ethical survey
broad aspects of ethical practice especially relevant for practice also requires disclosure of certain information
survey research" that academic and professional survey about a survey and its conduct when the findings are
researchers recognize (Groves et al. 2009, p. 371). The publicly released.
other aspect of ethical practice required from survey The overall objective of this ethical practice is to
encourage transparency in survey research, that is, com-
plete disclosure of survey methods. This objective derives
Table 1 WAPOR Rules of Practice Regarding Reports and Survey
Results from what biologist Glass (1965) calls "the ought of sci-
ence": "a full and true report is the hallmark of the sci-
Every complete report on a survey should contain an adequate
explanation of the following relevant points:
entist, a report as accurate and faithful as he can make it in
For whom the survey was conducted and by whom it was carried
every detail. The process of verification depends upon the
out ability of another scientist who wishes to repeat a proce-
The purpose of the study dure and to confirm an observation" (p. 83). It is note-
The universe or population to which the results of the survey are worthy that the Academy of Management Code of Ethics
projected "Professional Principles" for research and publications
The method by which the sample was selected, including both state similar objectives (Academy of Management, n.d.,
the type of sample (probability, quota, etc.) and the specific p. 4). Moreover, Michalos (1991, p. 416), in a different
procedures by which it was selected
context, proposes eight characteristics that publishers of
Steps taken to ensure that the sample design would actually be
carried out
results of public opinion polls of the electorate during
election campaigns should provide so as "to maintain and
The degree of success in actually carrying out the design,
including the rate even increase the benefits of public opinion polling while
Of non-response and a comparison of the size and characteristics significantly reducing the costs."
of the actual and anticipated samples To provide a focus for our research, and to build upon
A full description of the estimating procedure used for all results the knowledge of a distinct field of management that we
that are reported, including the sample size on which it was have acquired, we focus on sample surveys as management
based and weighting procedures used to adjust raw data
research in tourism, hospitality, recreation, and related
A full description of the method employed in the survey
fields. We investigate compliance with the WAPOR rules
The time at which the survey, if any, was done, and the time span of a set of articles published in specific academic journals
covered in collecting data
in these fields in recent years. We do so by defining
The findings obtained
Research Questions that indicate compliance with the
(Where the nature and the research demands it) the
WAPOR rules and applying them to the set of articles
characteristics of those employed as interviewers and coders
and the methods of their training and supervision through content. After careful consideration of the con-
A copy of the interview schedule or questionnaire and
sensus of the content coders, we determine whether and
instructions how the articles comply with the WAPOR principles. We
Which results are based on parts of the sample, rather than the draw conclusions from these findings and recommend
whole sample approaches that can improve the compliance of manage-
A description of the precision of the findings, including, ment research articles and reports with ethical principles.
if applicable, estimates of sampling error
"Compliance" relating to codes of ethics includes
Source World Association for Public Opinion Research (2010) auditing, verification, and enforceability (Kolk and van
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
152 D. С. Frechtiing, S. Boo
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
On the Ethics of Management Research 153
^ (Pa-Pc)
"Intercoder reliability"
(1 is
"Pc) the term widely used
extent to which independent coders evaluating a c
teristic of a where к is Cohen's
message reach the kappa, /?a is the proportion
same of agreed on
conclusion (Ko
judgments, and pc(2002)
Burnett 1991). Neuendorf is the proportion suggests
of agreement one that
would expect
human coders are used inby content
chance. analysis, int
reliability quantifies the Although Cohen's kappa has drawbacks,
amount it is considered
of agreement am
or more coders. Although intercoder of
to be one of the most reliable and useful measures in-
reliability
perceived as a standardtercoder reliability by researchers
measure of (Lombard
researchet al. 2002; quality
Neuendorf 2002).
and Burnett 1991), researchers have noted Kappa is generally used only for mea- that mo
suring intercoder
cles using content analysis do reliability
not for nominal
provide level variables informa
(Lombard et al. 2002).
intercoder reliability clearly or We have
inchosen to use Cohen's
significant deta
and Freitag 1997). kappa as a measure of agreement because the content to
which codinghave
Nevertheless, researchers was applied consists of nominally scaled
emphasized the im
tance of measuring variables (i.e., compliance
intercoder or non-compliance within
reliability the conten
sis. For example, WAPOR standards, or non-applicability)
Neuendorf (2002) and it notes
is designed that
analysis exercises to measure
are the agreement of a pairing
useless without of coders. Kappa a mea
â Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
154 D. С. Frechtling, S. Boo
coefficients will
for produce
this study few
wer
tistical Package for
atively the Socia
inexperie
Our intent is to
Coding ance,
Categories "the assessm
other stated cri
Creating Through
categories is a content
core fe
Categories Regarding
may be Repor
thought of a
content units"Code
areof Professional Ethics and Practices" (World
placed. Holsti
inition of Association for Public Opinion Research
categories requires2010) to identify t
the elements compliance the
of and non-compliance of specific articles pub-
investigato
evant to the lished in the top threecan
study academic journals
be in the fields
classi
categories in related to tourism and hospitality. Table 2 shows
conjunction withhow w
Table 2 WAPOR "Rules of Practice Regarding Reports and Survey Results" and criteria for coders
Coding categories from WAPOR "Rules of Practice Regarding Criteria for coders
Reports and Survey Results": reports must state
(a) For whom the survey was conducted and by whom it was carried (a.l) Compliance = names of those who carried out the survey
out are stated
Sources World Association for Public Opinion Research (2010), and authors
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
On the Ethics of Management Research 155
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
156 D. С. Frechtling, S. Boo
Coding criteria from "Rules Compliance Non- Not Coding criteria from Cohen's kappa between
of Practice Regarding compliance applicable "Rules of Practice Regarding coders
Reports and Survey Reports and Survey Results"
A and A and В and
Results"
В С С
b. Purpose of the study is 100 0 - b. Purpose of the study is specified 1.00 1.00 1.00
specified j. Findings obtained are shown 1.00 1.00 1.00
j. Findings obtained are 100 0 - a.2. Sponsor or client indicated but not 1.00 1.00 1.00
shown identified
a.2. Sponsor or client - - 100% g. Weighting procedures to adjust 1.00 1.00 1.00
indicated but not identified raw data explained
g. Weighting procedures to - - 100 f.l. Survey conduct differs from survey plan 1.00 1.00 1.00
adjust raw data explained c. Target population is specified 0.604 0.823 0.454
f.l. Survey conduct differs - - 100 d.i. Sampling frame is defined 0.817 0.602 0.532
from survey plan
f.2. Response rate or initial 0.862 0.632 0.749
c. Target population is 87 13 - and effective sample sizes is presented
specified
i. Time period of the survey is stated 0.955 0.865 0.821
d.i. Sampling frame is 75 25 -
defined
d.2. Sampling selection method is identified 0.794 0.645 0.460
k. Interviewer characteristics, training, 0.788 0.775 0.773
f.2. Response rate or initial 66 34 -
and supervision are presented
and effective sample sizes
is presented n. Estimates of sampling error are presented 0.890 0.743 0.709
i. Time period of the survey 61 39 - 1. Copy of the data collection 0.786 0.841 0.637
is stated instrument and instructions
are presented or web
d.2. Sampling selection 45 56 -
method is identified
source provided
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
On the Ethics of Management Research 157
(i.e., coder A-coder C, or coder B-coder C). Table 4 the precision of the survey results in describing the target
indicates that for the 42 possible kappas, 73% exceeded population (Dillman et al. 2009). Without this informa-
0.75, the threshold for excellent agreement. The other 37% tion, survey precision cannot be assessed. Only one in
of the kappa scores all exceeded 0.40, placing in the fair to eight articles displayed the data collection instrument or
good agreement range. Therefore, we conclude that this provided an address where it could be examined. While
study indicates that the answer to Research Question 1 is not all the journals may be able to devote space to pre-
yes, it is practicable to determine compliance of published senting data collection instruments, some do (Byrd et al.
management research survey articles with WAPOR rules to 2009). As an alternative, when space is unavailable, an
an acceptable degree of reliability. article may report the URL for a website displaying the
Before discussing the results regarding Research Ques- instrument.
tions 2, 3, and 4, we note that wherever intercoder dis- In sum, we note that there is a substantial degree of
agreement was found in this study regarding a particular Specific Compliance for five of the WAPOR rules but less
WAPOR criteria in a particular journal article, we jointly than two-thirds compliance with six of them. We find that
examined the disagreement and jointly settled on a single the answer to Research Question 2 is yes, there is a sub-
code for the instance. Therefore, the following discussion stantial variety of compliance among the WAPOR rules.
covers all the 187 articles assessed on all the 14 WAPOR Some are widely recognized and reported, while others
criteria without disagreement. appear unknown among the majority of authors.
Research Question 2: Do a majority of these articles Research Question 4: Does the degree of compliance
address all of the WAPOR rules (addresses General differ significantly among the three journals (addresses
Compliance )1 None of the 187 articles examined adhered Publication Compliance To examine differences in
to all the eleven of the WAPOR standards examined here, compliance across the journals, chi-square tests were
indicating there is no General Compliance with the conducted. The chi-square test is useful for determining if
WAPOR standards in this population. Therefore, the there is a statistical difference between groups of nominal
answer to Research Question 2 is an unconditional nega- variables (Easterby-Smith et al. 2002). The critical level of
tive. Indeed, there is no evidence that the authors or journal statistical significance was set at 0.05, and the statistical
editors have any familiarity with WAPOR' s rules or any test was two-tailed. This test found significant differences
set of standards regarding presentation of probability for only three out of the 14 rules:
sample survey methodologies.
• d.2. Sampling selection method is identified
Research Question 3: Are there some WAPOR rules that
(x2 = 6.729, df = 2 ,p< .05);
are widely observed in the articles while others are not
• i. Time period of the survey is stated {y2 = 6.216,
(addresses Specific Compliance )? As indicated in Table 4,
df = 2, p < .05);
all the 187 probability sample survey articles analyzed
• n. Estimates of sampling error are presented
observed three of the WAPOR rules: who carried out the
О2 = 18.470, df = 2, p < .0001).
survey, the purpose of the survey, and presentation of
Among the three rules, "Estimates of sampling error are
findings. Eighty-seven percent defined the target popula-
presented" shows the largest difference in compliance
tion. Failure to do so prevents generalization of the survey
findings to a known population. Three-quarters ofacross the the three journals. In each case Annals of Tourism
Research showed a significantly higher degree of compli-
articles defined the sampling frame, the list of all members
of the survey population, or rules for simulating such ance
a list.than Journal of Travel Research or Tourism Man-
agement. Between the latter two, the Journal of Travel
Definition of the sampling frame is essential for assessing
Research
survey coverage error, that is, to what extent, members of shows compliance statistically greater than
Tourism
the target population were excluded from being selected for Management on two of these three, while falling
the survey (Dillman et al. 2009). behind Tourism Management on one.
We conclude that this study answers Research Question
Nearly two-thirds of the articles reported response rates
4 with
or the information necessary to compute response rates, or a qualified affirmative. There is weak evidence that
Annals of Tourism Research shows significantly higher
designated the time period of the survey. A low response
compliance in applying the WAPOR rules, but only for
rate suggests the presence of nonresponse bias in survey
results (Groves et al. 2009). Almost as many articlesthree of the 1 1 criteria applied. From our studies, we cannot
reported the time period the survey was carried out. conclude that this difference is because of to a conscious
Nearly one half of the studies reported the sample policy on the part of the editors of that journal. Rather, this
difference may be due to randomness in the amount of
selection method for the survey. A minority of articles
survey information authors chose to submit with their
reported interviewer characteristics and training or repor-
articles in our sample.
ted estimates of sampling error. Sampling error indicates
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
158 D. С. Frechtling, S. Boo
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
On the Ethics of Management Research 159
professional business organizations in the United States. Journal Marketing in Asia Group. (2009). The MAG scholar journal ranking
of Business Ethics, 35(1), 35-49. list 2009. Accessed September 9, 2009 from http://www.mag
Gaumnitz, B. R., & Lere, J. C. (2004). A classification scheme for scholar.com/news.htm.
codes of business ethics. Journal of Business Ethics, 49(4), McKercher, В., Law, R., & Lam, T. (2006). Rating tourism and
329-335. hospitality journals. Tourism Management, 27(6), 1235-1252.
Glass, B. (1965). Science and ethical values. Chapel Hill, NC: Michalos, A. C. (1991). Ethical considerations regarding public
University of North Carolina Press. opinion polling during election campaigns. Journal of Business
Grayson, K., & Rust, R. (2001). Interrater reliability. Journal of Ethics, 10, 403-422.
Consumer Psychology, 10( 1&2), 71-73. Murphy, L. (2001). Exploring social interactions of backpackers.
Groves, R. M., Fowler, F. J., Jr., Couper, M. P., Lepkowski, J. M., Annals of Tourism Research, 28(1), 50-67.
Singer, E., & Tourangeau, R. (2009). Survey methodology (2nd Neuendorf, K. A. (2002). The content analysis guidebook. Thousand
ed.). Hoboken, NJ: Wiley. Oaks, CA: Sage Publications.
Groves, B. W., Kucharewski, R., & Longsdorf, E. L. (2006). EthicalPan, В., MacLaurin, T., & Crotts, J. C. (2007). Travel blogs and the
issues in recreation research as perceived by recreation, park implications for destination marketing. Journal of Travel
resources, and leisure services faculty. In J. G. Peden & R. Research, 46(1), 35-45.
M. Schuster (Eds.), Proceedings of the 2005 northeastern Pater, A., & Van Gils, A. (2003). Stimulating ethical decision-making
recreation research symposium (pp. 120-129). Newtown Square, in a business context: Effects of ethical and professional codes.
PA: U.S. Forest Service. European Management Journal, 21(6), 762-772.
Hayes, A. F., & Krippendorff, К. (2007). Answering the callPayne,
for S.
a L. (2000). Challenges for research ethics and moral
standard reliability measure for coding data. Communication knowledge construction in the applied social sciences. Journal of
Methods and Measures, 1 , 77-89. Business Ethics, 26(4), 307-318.
Pechlaner,
Holsti, O. R. (1969). Content analysis for the social sciences and H., Zehrer, A., Matzler, K., & Abfalter, D. (2004). A
humanities. Menlo Park, CA: Addison Wesley. ranking of international tourism and hospitality journals. Journal
Howey, M., Savage, K. S., Verbeeten, M. J., & Van Hoof, H. of B.
Travel Research, 42(4), 328-332.
Perdue, R. R. (1991). Ethical issues in tourism accountability
(1999). Tourism and hospitality research journals: Cross-cita-
tions among research communities. Tourism Management, 20(1),research: Some case studies. In Proceedings of the travel and
133-139. tourism research association twenty-first annual conference,
â Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms
160 D. С. Frechtling, S. Boo
Ô Springer
This content downloaded from 132.174.255.223 on Wed, 03 Aug 2016 13:22:01 UTC
All use subject to http://about.jstor.org/terms