Professional Documents
Culture Documents
net/publication/345533583
CITATIONS READS
51 1,878
3 authors:
Nick Caddick
Anglia Ruskin University
40 PUBLICATIONS 1,263 CITATIONS
SEE PROFILE
All content following this page was uploaded by Brett Smith on 31 August 2021.
is that there is no way to ‘get at’ that reality as it really is (see also Randall
and Phoenix 2009). And, if one cannot capture that social reality as it
really is, then that reality cannot be called upon to do the adjudicate-the-
different-claims-to-knowledge work asked of it. This is the whole problematic
posed by the idea that no matter how hard we try, we cannot achieve
theory-free observation or knowledge.
(Smith and Hodkinson 2009: 34)
Indeed, the second option has yet to be cashed in and confirmed in sports
coaching research. However, it still persists as the option to take.
Third, in light of such problems, Lincoln and Guba changed their position
toward the end of the 1980s (Guba and Lincoln 1989) and now no longer
believe in their 1985 proposals (see also Lincoln 1995; Guba and Lincoln
2005). That is, they listened to critiques, agreed with them, and rejected the
idea of achieving trustworthiness as simply involving the use of specific data-
gathering techniques. This raises questions about the non-reflective adherence
of sport coaching researchers to this earlier position. Why, given the numerous
critiques and the fact that Lincoln and Guba have changed their mind, do
sport researchers still adopt the position they held in 1985?
Although many sports coaching researchers still adopt a parallel approach
when judging qualitative research, there are some who have reacted to its
critiques and adopted different positions and strategies for judging qualitative
research that call on different criteria in the process. One of these is the letting
go position as described by Sparkes (1998, 2002), and Sparkes and Smith
(2013). Here, the sports coaching researcher lets go of traditional views of
validity that privilege techniques as the only way to guarantee trustworthiness,
and calls upon other more relevant and appropriate criteria to judge the
‘goodness’ of a qualitative study. This shift is informed by a relativist perspective in
which the use of time- and place-contingent lists of characteristics to make
judgments is called upon.
It is important to stress that relativism does not mean that ‘anything goes’
when it comes to making assessments about the quality of qualitative
research. Nor does it mean that all knowledge claims are equal to other
knowledge claims. As Smith and Deemer (2000) point out, relativists can and
do make judgments, and will continue to do so for the foreseeable future.
But, when passing judgment on a piece of research, the criteria used are not
taken to mean a preordained or universal standard against which to make
judgment. Given this, relativists view criteria as characterizing traits that have, at
best, mild implications as a prescription for inquirer behavior. They are willing
Template: Royal A, Font: ,
Date: 06/12/2013; 3B2 version: 9.1.406/W Unicode (May 24 2007) (APS_OT)
Dir: //integrafs1/kcg/2-Pagination/TandF/SPOR_RAPS/ApplicationFiles/9780415626804.3d
The application of a list like that above is contingent. Its use depends, for
example, on the type of study (e.g. ethnographic, discursive, or narrative) one is
judging, its purpose, and what the person judging the work brings to the
table. It depends on what has and is being done in the field along with the
practical wisdom gained through experience in the field (i.e. phronesis). Thus,
the list is not set in stone to be applied to all qualitative studies be they
ethnographic, grounded theory, narrative, visual, or otherwise. Nor do we
wish to suggest that the ‘more’ criteria that are met from any given list that
the better the study is. That is, meeting ten criteria does not make a study
twice as good as one that meets five criteria. As Smith and Deemer (2000)
warn, to think of a list in these terms is to miss the point that lists and how
they are used is a practical matter. Criteria are worked and reworked within
the context of actual practices/applications by researchers in the field and
cannot be set down in abstract formulae. That is, our lists to judge sports
coaching research are challenged, changed, and modified not though abstracted
discussions of the lists and items in and of themselves, but in application to
actual research. Thus, in proposing lists like that above we do not wish to
infer that these are the only criteria that can be used for passing judgment.
Rather, these criteria are just a few that students, journal reviewers, and so on
might apply on different occasions to sort out ‘good’ qualitative sports
coaching work from the ‘bad’.
Template: Royal A, Font: ,
Date: 06/12/2013; 3B2 version: 9.1.406/W Unicode (May 24 2007) (APS_OT)
Dir: //integrafs1/kcg/2-Pagination/TandF/SPOR_RAPS/ApplicationFiles/9780415626804.3d
Given that the Fatal Flaw is bound to fail the test of plausibility in Ham-
mersley’s (1992) terms, the next step for a student or reviewer in sports
coaching is to assess its credibility. Garratt and Hodkinson (1998) point out
the problems with such a move. As they argue, any judgment about the
credibility of a claim necessarily involves a judgment about its accuracy,
which entails a closer examination of the evidence collected and a judgment
about whether the research was conducted using the relevant methodology.
Template: Royal A, Font: ,
Date: 06/12/2013; 3B2 version: 9.1.406/W Unicode (May 24 2007) (APS_OT)
Dir: //integrafs1/kcg/2-Pagination/TandF/SPOR_RAPS/ApplicationFiles/9780415626804.3d
Substantive contribution
Impact
Aesthetic merit
Dialogue as a space of debate and negotiation
Engaged embodiment as a condition for change
Personal narrative and storytelling as an obligation to critique
Worthy topic
Sincerity
Resonance
Incisiveness
Generativity
The above criteria are a few among many that might be used on certain
occasions to judge a sporting autoethnography. If, however, we had
preselected criteria, such as outlined by Lincoln and Guba (1985) and
Hammersley (1992), sporting autoethnographies like the ‘Fatal Flaw’ would
be deemed ‘not research’. Each would ‘fail’ the criteria pre-imposed on it. For
us, then, when criteria are used in a predetermined manner to judge all
research, there is the danger of excluding work before it has even been read
and producing a closed system of judgment that can only operate with a very
narrow range of what constitutes legitimate research. Others agree. For
example, along with Smith and Deemer (2000), Garratt and Hodkinson
(1998) state that, choosing any list of universal criteria in advance of reading
a research report is antithetical to the process of understanding as experience:
References
Barone, T. and Eisner, E. W. (2012) Arts Based Research, Thousand Oaks, CA: Sage.
Bucci, J., Bloom, G. A., Loughead, T. M. and Caron, J. G. (2012) ‘Ice hockey coaches’
perceptions of athlete leadership’, Journal of Applied Sport Psychology, 24: 243–59.
Caddick, N. and Ryall, E. (2012) ‘The social construction of “mental toughness” – a fascistoid
ideology?’, Journal of the Philosophy of Sport, 39: 137–54.
Flyvbjerg, B. (2001) Making Social Science Matter: Why Social Inquiry Fails and How It Can Succeed
Again, Cambridge: Cambridge University Press.
Garratt, D. and P. Hodkinson (1998) ‘Can there be criteria for selecting research criteria?: A
hermeneutical analysis of an inescapable dilemma’, Qualitative Inquiry, 4: 515–39.
Guba, E. and Lincoln, Y. (1989) Fourth Generation Evaluation, London: Sage.
Guba, E. G. and Lincoln, Y. (2005) ‘Paradigmatic controversies, contradictions, and emerging
confluences’, in N. K. Denzin and Y. Lincoln (eds) Handbook of Qualitative Research (3rd ed.),
London: Sage, 191-216.
Gucciardi, D. F., Gordon, S. and Dimmock, J. A. (2009) ‘Evaluation of a mental toughness
training program for youth-aged Australian footballers: II. A qualitative analysis’, Journal of
Applied Sport Psychology, 21: 324–39.
Hammersley, M. (1992) What’s Wrong With Ethnography?, London: Routledge.
Holman Jones, S. (2005) ‘Autoethnography: Making the personal political’, in N. K. Denzin
and Y. Lincoln (eds) Handbook of Qualitative Research (3rd ed.), London: Sage, 763-92.
Lieblich, A., Tuval-Mashlach, R. and Zilber, T. (1998) Narrative research, London: Sage.
Lincoln, Y. (1995) ‘Emerging criteria for quality in qualitative and interpretive research’,
Qualitative Inquiry, 1: 275–89.
Lincoln, Y. and Guba, E. (1985) Naturalistic inquiry, Thousand Oaks, CA: Sage.
McGannon, K.R. and Schweinbenz, A.N. (2011) ‘Traversing the qualitative–quantitative
divide using mixed methods: Some reflections and reconciliations for sport and exercise
psychology’, Qualitative Research in Sport, Exercise and Health, 3: 370–84.
Randall, W. L. and Phoenix, C. (2009) ‘The problem with truth in qualitative interviews:
Reflections from a narrative perspective’, Qualitative Research in Sport and Exercise, 1(2): 125–40.
Richardson, L. (2000) ‘Writing: a method of inquiry’, in N. Denzin and Y. Lincoln (eds)
Handbook of Qualitative Research (2nd ed.), London: Sage, 923-48.
Rolfe, G. (2006) ‘Judgements without rules: Towards a postmodern ironist concept of research
Validity’, Nursing Inquiry, 13: 7–15.
Smith, B. (1999) ‘The Abyss: Exploring depression through a narrative of the self’, Qualitative
Inquiry, 5: 264–79.
——(2013) ‘Disability, sport, and men’s narratives of health: A qualitative study’. Health Psychology,
32: 110–19.
Template: Royal A, Font: ,
Date: 06/12/2013; 3B2 version: 9.1.406/W Unicode (May 24 2007) (APS_OT)
Dir: //integrafs1/kcg/2-Pagination/TandF/SPOR_RAPS/ApplicationFiles/9780415626804.3d