Professional Documents
Culture Documents
An Evaluation of Two Qualitative Methods
An Evaluation of Two Qualitative Methods
An evaluation of two qualitative methods (focus group interviews and cognitive maps) for conducting
research into entrepreneurial decision making
Tony Hines
Article information:
To cite this document:
Tony Hines, (2000),"An evaluation of two qualitative methods (focus group interviews and cognitive maps) for conducting
research into entrepreneurial decision making", Qualitative Market Research: An International Journal, Vol. 3 Iss 1 pp. 7 - 16
Permanent link to this document:
http://dx.doi.org/10.1108/13522750010310406
Downloaded on: 31 January 2016, At: 04:34 (PT)
References: this document contains references to 28 other documents.
To copy this document: permissions@emeraldinsight.com
The fulltext of this document has been downloaded 4985 times since 2006*
Users who downloaded this article also downloaded:
Antonio Armillotta, (2006),"Assessment of surface quality on textured FDM prototypes", Rapid Prototyping Journal, Vol. 12
Iss 1 pp. 35-41 http://dx.doi.org/10.1108/13552540610637255
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
(2002),"Corrosion Inhibitors: Principles and Applications", Anti-Corrosion Methods and Materials, Vol. 49 Iss 3 pp. - http://
dx.doi.org/10.1108/acmm.2002.12849cae.001
Jose Arturo Garza-Reyes, (2015),"Green lean and the need for Six Sigma", International Journal of Lean Six Sigma, Vol. 6
Iss 3 pp. 226-248 http://dx.doi.org/10.1108/IJLSS-04-2014-0010
Access to this document was granted through an Emerald subscription provided by emerald-srm:368748 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for Authors service
information about how to choose which publication to write for and submission guidelines are available for all. Please
visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company manages a portfolio of
more than 290 journals and over 2,350 books and book series volumes, as well as providing an extensive range of online
products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee on Publication
Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive preservation.
specifically, it helps the researcher in a examined such that measures taken are
number of ways: objective. Researchers focus on facts and
. to determine whether or not their own search for cause and effect.
research design is appropriate to the
questions being asked;
. to create designs beyond past experience Phenomenology
(Easterby-Smith et al., 1994); and
. to provide grounding in research methods Phenomenologists recognise that the world in
located within an accepted which we live is socially constructed (Berger
epistemological paradigm. Houldsworth and Luckman, 1967). Observations are prima
(1995) remarks that this distinguishes facie subjective and the observer is a part of
academic work from lay knowledge. what is being observed. Research focus is on
understanding meaning, context and
Researchers often take two diametrically
complexity. Ideas are developed through
opposing philosophical stances (positivism
inductive reasoning. The task of social
and phenomenology) and they may be
scientists is ``to appreciate different
regarded as two poles on a methodological
constructions and meanings that people place
continuum. Each one is discussed briefly
upon their experience'' (Easterby-Smith et al.,
before justifying the stance taken by this
1994). Easterby-Smith et al. (1994, p. 27)
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
time
Source: Easterby-Smith et al. (1994)
In the context of this study access was team from a larger company that had at one
achieved through personal contacts known to time been a listed company on the London
the researcher. In both cases during Stock Exchange. In effect this was a firm in a
discussions in a social context potential declining industry that had become a small
benefits for both parties (researcher and firm as a result of the management buy-out.
researched) were explored. Agreement was There were three owner-managers who
reached following the discussions and access looked after functional areas for sales and
was secured to the owner-managers in each of marketing; production and sourcing; and
the two firms. Follow-up after the initial finance and information systems. These
discussions was by letter, telephone, facsimile managers were selected as the subjects of the
and e-mail to confirm the agreements and to study. Although classified as a small firm, it is
agree specific details regarding the protocols typical of the majority (99 per cent) of all
and dates. It was important to keep the clothing manufacturing firms in the UK.
project live through regular contact with each
Their customers are large retailing groups
company until the research was completed.
with multiple stores. In contrast, a second
People need to be reminded of agreements
small firm was selected from a different
and benefits but should not feel pestered to
industry ± publishing. This firm also had
such an extent that they become annoyed and
three owner-managers who were responsible
access is subsequently denied. All four criteria
for sales and marketing, production and print,
listed by Remenyi et al. (1998, p. 109) were
and editorial. In addition each firm had a
met.
managing director with overarching
responsibility. Despite a growing
concentration of large publishing groups in
The study
the UK, this firm is typical of the many
The particular work conducted was trying to smaller publishing firms that comprise 97 per
establish how owner-managers in the two cent of the industry. It operates in specialist
small firms being examined made decisions educational markets and is located in the
relating to organisational strategies. north of England. The company was founded
20 years ago by two of the current
Context management team who themselves had been
One firm was a small clothing manufacturer lecturers. The third member of the company
based in the north-west of England. The firm joined later, as the company grew, and he had
had been bought out by the management experience in publishing and distribution.
9
An evaluation of two qualitative methods Qualitative Market Research: An International Journal
Tony Hines Volume 3 . Number 1 . 2000 . 7±16
prescriptive approaches that are so often which in turn will depend on the purpose of
observed in positivist research. Having the research and the philosophical stance
previously used cognitive mapping techniques taken. Therefore, the researcher's notion of
in one-to-one interviews, to explore what a focus group is will influence the quality
management decisions, I was aware of how and therefore the utility of responses received.
useful the technique might be in relation to Focus groups have traditionally been used in
this work. The work could have been marketing research as follows:
conducted in other ways using flip charts or . Phenomenological interaction-centred
alternative recording devices. However, it is focus groups
important not simply to record but also to . Clinical focus groups
analyse the meanings and it seemed . Exploratory research.
appropriate, therefore, to use a cognitive
mapping program to record and analyse The types of focus group explained
evidence in relation to their meanings. The phenomenological focus group is
Furthermore, it is important not to overlook designed to share the experience of a group of
the power of the ``gizmo''. The cognitive maps people and to participate in that shared
were drawn in the presence of managers who understanding. The researcher therefore
could revise the maps as the discussions attempts to experience the view of the world
progressed. Maps were projected on to a large from the point of view of the managers or
screen as discussions progressed. The entrepreneurs being observed. It is a way of
participants were also able to take away copies experiencing their experiences through
of the maps and analysis in the form of print- discussion. In discussing decision-making
outs. The ``gizmo'' effect seemed definitely to approaches the researcher gains some
encourage participation and commitment. understanding of the issues, processes and
experiences of the people involved. This is
Nature of the problem essentially the type of focus group that this
The research issue in both cases was to research focused upon. Interaction between
determine the major factors that have a the participants is an essential feature of the
bearing on strategy decisions in small firms. interview to identify and report the ``true
The purpose was to find out the views and feelings'' of the group.
experiences of the management teams in each The other two reported types have been
case. Interpretation of the focus group used more often in a marketing research
interviews and the maps is discussed later. context, exploratory research being most
common to examine a topic quickly and at
Research questions low cost before conducting follow-up survey
The research was designed to find out how work. Clinical focus groups are used to obtain
managers made decisions together in their a deeper understanding of individual
10
An evaluation of two qualitative methods Qualitative Market Research: An International Journal
Tony Hines Volume 3 . Number 1 . 2000 . 7±16
work may simply reflect the decision-making was not appropriate (Kelly, 1955). There
process in the organisation. This could mean were three specific reasons for rejecting this
that a particular member of the management type of approach in the current research; these
team or an owner of the firm may have more were:
say in the group and in the reality of a (1) The time required conducting individual
decision-making process. Therefore, the interviews before mapping and during
experience being reported and observed, mapping. Group interviews and interactive
rather than obscuring realities, may reveal development of maps were preferred to
them. Similarly the weakness of conducting individual interviews and any preliminary
research into sensitive issues is not as shaping. The preliminary shaping may have
important if the team being interviewed agree destroyed the spontaneity and creative
confidentiality and are the people who need to development of the cognitive maps.
work together to set the agenda for the whole Mapping is an iterative process and
business. preliminary interviewing may inhibit this.
11
An evaluation of two qualitative methods Qualitative Market Research: An International Journal
Tony Hines Volume 3 . Number 1 . 2000 . 7±16
(2) It would not have been possible to gain constructs that impose a personal order on
unlimited access to the groups for the our life. Other constructs are subordinate to
purpose of preliminary interviews nor was the core constructs. Fransella and Dalton
it considered appropriate to the (1990) referred to personal constructs as
phenomenological stance taken by this being capable of anticipating future actions
research. The group dynamics were more but raise concerns that in so doing individuals
important to the development of the become prisoners of the biography that they
maps. However, each member of the construe. This concern, although important
focus group had been briefed verbally by in a wider context, is not so important to the
telephone and supported by email current work, where an examination of how
documentation as to the purpose and and why decisions are being made rather than
protocols. any investigation of specific problems or
(3) Perhaps most importantly, the purpose of constraints applied to those individuals
the mapping in this research was to allow making the decision.
owner-managers the opportunity to Ackerman et al. (1993, p. 2) suggest that
construct a map of their collective cognitive mapping can be used for note-
decision-making processes. In this taking at interviews with the problem owner.
context it was constructs rather than It may also be used to record transcripts of
concepts that were important to the interviews or other documentary evidence in a
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
process of decision making in these small way that promotes analysis, questioning and
firms. In particular the personal understanding. In addition I have used
constructs of the owner-managers. This cognitive maps on other occasions to
was achieved by reporting the issues interrogate transcripts of individual interviews
during a focus group interview to reveal with the aim of analysing and mapping causal
how and why the managers did what they relationships.
did.
Describing the detail
Cognitive mapping as a personal The mapping meetings lasted approximately
construct approach two hours for each firm. Diary dates for the
Cognitive mapping is based on personal meeting were fixed well in advance, as it was
construct theory developed by Kelly (1955). essential that the participants could all attend.
The theory suggests that people make sense of The managing directors of each organisation
their world in order to predict how that world recognised the importance of the meeting in
will be in the future. It is also regarded as helping them to formulate their new
more than a theory by some and they refer to strategies. The meetings were therefore given
it as an approach to conducting research work sufficient priority to ensure attendance.
(Jahoda, 1988, p. 2). Therefore, its place in Furthermore, because the mapping meetings
the current work is as an approach using the were seen as an important senior management
computer program as a tool and cognitive development process, individuals were keen
mapping as a method. It enables actors to take part. This is an important point that
involved to shape their world through relates back to access discussed earlier.
intervention. It is suggested that researchers Research is important to participants when
begin their work not with theories but with they can see personal benefit. Often
involvement in the life situation of the people researchers are the only people who think the
they have chosen to study (Kelly, 1986, p. 1). research is important and they fail to sell the
``Only when man [sic] attunes his ear to benefits to the participants.
recurrent themes in the monotonous flow During the interviews, the focus groups
does his universe begin to make sense to him'' were guided by the researcher and invited to
(Kelly, 1955, p. 53). Personal constructs, as discuss freely issues relating to the small
Kelly refers to our personal frameworks, are firm's strategy. The discussion points were
made up of a large number of similarity- recorded on the computer and projected onto
difference dimensions or bi-polar constructs. a large screen for all participants to see. As
Each individual construes the world in which discussions developed, so too did the map.
they live both systematically and uniquely to The combination of the focus group interview
the individual. There are constructs that are in conjunction with the cognitive mapping
central to our existence and they are core allowed individuals in the groups to reflect
12
An evaluation of two qualitative methods Qualitative Market Research: An International Journal
Tony Hines Volume 3 . Number 1 . 2000 . 7±16
and moderate their views as the discussion ``The customer's perceived view of the
progressed. Probing was also possible to organisation''.
clarify meanings and interpretations of the Figure 2 shows the influences on decisions
owner-manager comments. It was also taken by the management team in a small
possible to record different maps by saving educational publishing company. Once again,
versions at different stages of the interview. the group of four managers began their
One advantage of this is that key changes can discussions by identifying key influences on
be examined later after the meeting. This can their strategy formulations. For example,
give the researcher further insight into the Number 3 ± ``The demise of the net book
dynamic nature of decision-making processes. agreement'' had the effect of reducing the
After the meetings, the researcher is able to publisher's profit margin. Larger book
analyse the map and explore the relationship retailing groups became more demanding
between different aspects of it. This can be regarding trade discounts for shelf space,
while at the same time they raised the prices
done using the analysis clustering tools in the
charged in the stores. To get the same
program. It is possible to identify some
volumes through the supply chain to retailers
further relationships that may have been
it became necessary to increase the trade
overlooked during the meeting. These items
discounts. Order sizes tended to diminish
can then be further examined in a new
after the net book agreement was abandoned,
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
13
An evaluation of two qualitative methods Qualitative Market Research: An International Journal
Tony Hines Volume 3 . Number 1 . 2000 . 7±16
(Glaser and Strauss, 1967). This was so that the decision-making processes can be
the views given remain those experienced by examined with the aim of either eliminating
the managers themselves without too much them or alternatively modifying the cognitive
interference from the researcher who was maps. External validity is achieved by
bringing different knowledge and experiential pursuing a general analytic strategy that rules
influences to the scenario. Strauss and Corbin out alternative interpretations (Yin, 1994,
(1990, p. 17) provide a useful definition of the p. 103).
term ``qualitative research'' as any kind of
research that produces findings not arrived at Developing theories from this type of
by means of statistical procedures or other research
means of quantification. They go on to Theoretical frameworks, developed from
explain that this could be research about qualitative work adopting a phenomenological,
people's lives, stories, behaviour, social constructive perspective employing
organisational functioning, social movements multiple methods, recognise that there are
and, most interestingly, interactional different versions of the world (Goodman,
relationships. The type of research being 1978), where there are continuous revision
explained here is just that ± interactional and reconstruction. The combination of focus
relationships related to future strategy group interviews and cognitive mapping allows
decisions. Strauss and Corbin (1990, p. 18) those different perspectives to emerge and fit
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
list the skills for doing qualitative research as: well with a grounded theoretical approach.
. An ability to step back and critically The interactive approach of focus group
analyse situations. interviews together with the dynamic process
. To recognise and avoid bias. of cognitive mapping is in stark contrast to the
. To obtain valid and reliable data. static approaches that many quantitative
. To think abstractly. researchers adopt to investigate decision
making by examining data relating to the
The authors go on to explain that to do this a consequences of decision making rather than
researcher needs to have: ``theoretical and the processes (Bagozzi, 1994).
social sensitivity, the ability to maintain
analytical distance while at the same time
being able to draw on past experience and
Summary
theoretical knowledge to interpret what is
seen; astute powers of observation and good In summary, the work set out to explain the
interactional skills''. utility of mixed method research using two
The skills of the researcher are therefore particular techniques in a qualitative study. A
essential to the successful implementation of phenomenological use of focus group
this type of work. It may be important to interviews was explained combined with
practise some of these skills before entering cognitive mapping to reveal the key concepts
the field. A useful way is to work with fellow that managers hold in their heads when
researchers and research students to refine exploring decisions relating to an
your skills before subjecting unsuspecting organisation's future strategy. The work was
managers to your inadequacies. This will save interpreted using a social constructionist
time in the conduct of the real research and perspective.
help avoid any pitfalls with the tools and
techniques that can be ``ironed out'' through
preliminary practice. Conclusions
Construct validity is achieved by
participants being able to contribute as The two methods combined seemed to offer a
individuals in a team context through the way of making science through the
focus group interviews. Participants are also participation of managers in a research
able to modify and remodel constructs and process. This is not simply passive
concepts as the discussion progresses. observation, recording, analysis and
Internal validity is achieved through the interpretation but enables the whole research
identification and confirmation of causal process to be live. It is most appropriate to
relationships in the group discussions. Rival conducting management research where,
explanations for cause and effect relating to unlike deductive approaches to scientific
14
An evaluation of two qualitative methods Qualitative Market Research: An International Journal
Tony Hines Volume 3 . Number 1 . 2000 . 7±16
research, replication of the conditions is not participants. This can especially be the case if
the aim. However, it is suggested that the researcher is new to mapping and slow in
replication of the research process could be doing it such that it detracts from the
achieved. The methods are usefully combined discussion or that technical failures occur. On
when investigating small firm owner-manager one occasion I experienced a technical
decision-making processes. The steps problem with a projector that my laptop
involved are to: agree access to the computer was connected to and had to
owner-managers in the small firms you want abandon the computer map for a paper
to investigate; agree protocols; specify version. It is, therefore, essential for the
benefits for those participants being researchers to be flexible and knowledgeable
researched; agree dates for interviews; ensure enough to adopt an alternative strategy on the
that all owner-managers you want to spot. You may not get a second chance.
interview will be present; use interactive focus
group interview techniques and map the Utility of the research approach
responses during the discussion; probe and However, drawbacks considered, there are a
clarify any ambiguities during the interview; number of very important positive reasons for
finally, analyse the evidence using the adopting the combined approaches reported.
cognitive mapping program beyond the First, if you want to conduct a qualitative
interviews. Furthermore, it may be possible to piece of research work that is attempting to
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
suggested that multiple methods provide Flanagan, J.C. (1954), ``The critical incident technique'',
construct validity, internal and external Psychological Bulletin, Vol. 1, pp. 327-58.
validity. Furthermore, the methods allow Fransella, F. and Dalton, P. (1990), Personal Construct
Counselling in Action, Sage Publications, London.
complex issues to be examined using the
Gergen, K.J. (1988), ``The social constructionist movement
language of those involved. Interpretations in modern psychology'', American Psychologist,
can be made with the help of those who have Vol. 40, pp. 266-75.
influenced or socially constructed their Glaser, B. and Strauss, A. (1967), The Discovery of
actions. This reduces researcher bias in Grounded Theory: Strategies for Qualitative
attempting to understand the world in which Research, Aldine, New York, NY.
participants are engaged. Meanings can be Goodman, L. (1978), Analyzing Quantitative Categorical
examined through the group interviews, Data, ABT Books, Cambridge, MA.
Gummesson, E. (1991), Qualitative Methods in
recorded and analysed using the cognitive
Management Research, Sage Publications, London.
mapping program, while participants are Hines, T. (1998), Management Information for Marketing
present. and Sales, Butterworth-Heinemann, Oxford.
Houldsworth, E. (1995), Theoretical Paradigms in
Management Research, EDAMBA.
Jahoda, M. (1988), ``Opening address: the range of
References convenience of personal construct psychology ± an
Ackerman, F., Eden, C. and Cropper, S. (1993), ``Getting outsider's view'', in Fransella, F. and Thomas, L.
(Eds), Experimenting with Personal Construct
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)
16
This article has been cited by:
1. Eleonora Pantano. 2016. Engaging consumer through the storefront: Evidences from integrating interactive technologies.
Journal of Retailing and Consumer Services 28, 149-154. [CrossRef]
2. Camilla Barbarossa, Alberto Pastore. 2015. Why environmentally conscious consumers do not purchase green products.
Qualitative Market Research: An International Journal 18:2, 188-209. [Abstract] [Full Text] [PDF]
3. Sanda Renko, Kristina Bucar. 2014. Sensing nostalgia through traditional food: an insight from Croatia. British Food Journal
116:11, 1672-1691. [Abstract] [Full Text] [PDF]
4. Felicity Kelliher, Elaine Aylward, Patrick LynchExploring Rural Enterprise: The Impact of Regional Stakeholder Engagement
on Collaborative Rural Networks 35-57. [Abstract] [Full Text] [PDF] [PDF]
5. Wojciech Piotrowicz, Richard Cuthbertson. 2014. Introduction to the Special Issue Information Technology in Retail:
Toward Omnichannel Retailing. International Journal of Electronic Commerce 18, 5-16. [CrossRef]
6. Hannele Kauppinen-Räisänen, Anne Rindell, Charlotta Åberg. 2014. Conveying conscientiousness: Exploring environmental
images across servicescapes. Journal of Retailing and Consumer Services 21, 520-528. [CrossRef]
7. Hannele Kauppinen-Räisänen, Johanna Gummerus, Catharina von Koskull, Åke Finne, Anu Helkkula, Christian
Kowalkowski, Anne Rindell. 2014. Am I worth it? Gifting myself with luxury. Journal of Fashion Marketing and Management:
An International Journal 18:2, 112-132. [Abstract] [Full Text] [PDF]
8. Marco Tieman, Maznah Che Ghazali. 2014. Halal Control Activities and Assurance Activities in Halal Food Logistics. Procedia
- Social and Behavioral Sciences 121, 44-57. [CrossRef]
9. Jillian C. Sweeney, Johannes Kresling, Dave Webb, Geoffrey N. Soutar, Tim Mazzarol. 2013. Energy saving behaviours:
Downloaded by Duquesne University At 04:34 31 January 2016 (PT)