You are on page 1of 8

Before 1970, most assessments administered by occu-

The Use of pational therapists were informal and nonstandard-


ized. Since the 1970s, the use ofsCientifically sound in-
Standardized struments has increased. One such standardized
assessment, the Bay Area Functional Performance
Assessment in Evaluation (BaFPE) , was developed to measure the
functional peljormance ofpsychiatric clients. This
Occupational Therapy: study was designed to explore the use of a revised ver-
sion of BaFPE as an example of standardized assess-

The BaFPE-R as an ment in occupational therapy.


The BaFPE was selected as an example of an as-
Example sessment extensively used in psychiatric occupational
therapy practice. A qualitative study that used in-
depth semistructured interviews was conducted with a
convenience sample of occupational therapists.
The occupational therapists who were inter-
Mary F. Managh, Joanne Valiant Cook viewed described and explained making several
adaptations and modifications to the recommended
administration and scoring of the BaFPE An analysis
Key Words: professional practice. qualitative of the interview data sU&ff,ested that standardized as-
method. values clarification sessments are valued as indicaton 0/ pmfessional
status However, the interview responses also suggested
that the demands of test standardization were incon-
gruent with the values that gUide occupational ther-
apy practice.
The{indings 0/ this study suggest that the/uture
development and use of standardized instruments
should be consistent with the values of the profession.
In particular, assessments that recognize the diverse
nature and needs of individual clients are reqUired

person's ability to perform the tasks required to

-A function successfully in his or her daily life is of


fundamental concern to occupational therapists
(Kielhofner, 1992). Traditionally, many occupationaJ
therapists have used homemade assessment tools such
as checklists [Q assess function (Leonardelli Haertlein,
1992; Smith, 1992; Stein, 1988). Before 1970, most assess-
ments administered by occupational therapists were in-
fOrmal and nonstandardized (Stein, 1988). Since the
1970s, however, scientifically sound instruments have
been developed in an attempt [Q document client status
and change mOre accurately, as well as [Q demonstrate
treatment effectiveness (Watts, Brollier, & Schmidt,
1988).
The trend in the profession tOward the use of stan-
dardized assessment has been followed by occupational
therapists specializing in mental health (Hemphill, 1980;
Mary F. Managh, .\ISl. DUe). is Senior Occupational Therapist Moyer, 1984; Thibeault & Blackmer, 1987; Watts et ai,
-Research, Clat-ke Institute of Psvchiatty, 250 College Street. 1988). The Bay Area Functional Performance Evaluation
Toronto, Ontario, Canada M5T IR8. (BaFPE) was one of the first standardized instruments
developed by occupational therapists for use with psychi-
Joanne Valianr Cook, Phl),OT(C). is Assisr3m Professor, Depan-
atric clients (Bloomer & Williams, 1978; Watts et a\.,
menr of Occuparional Therapy, Universirv of Wesrern Oll(ario,
Lonclon, Ontario, Canada.
1988). According to the test developers, the BaFPE was
designed to measure some behaviors that persons must
This arricle was accepted for publica/ion ,Hay 9. 199:3. exhibit to carry out activities of daily living (Bloomer &

The American Journat of Occupational Therapl' 877


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
Williams, 1978). The original version of the BaFPE was Method
revised and a second edition (BaFPE-R) was published in Sample
1987 in an attempt to improve its standardization and
Thirty oCCllpatio al therapists in four cities were inter-
clinical utility (Houston, Williams, Bloomer, & Mann,
viewee! Each therapisr wa, pracricing in psychiany and
L989). This revised version is widely used by occupational
had used the BaFPE-R during the previous 2 years. The
therapists in psychiatry (Mann, KJyczek, & Fiedler, 1989).
intervie\vees were graduates of nine different occupation-
For the purroses of clarity, the revised BaFPE will be
al therapy programs, both domestic and foreign. The
referred to as the BaFPE-R in this paper.
sample included 18 (60%) therapists who were graduates
The BaFPE-R consists of two subtests, the Task-Ori-
of the same university program. Twenty-one (70%) of the
ented Assessment (TOA) and the Social Interaction Scale
thefapists were employed at provincial psychiatric hospi-
(SIS) The TOA is designed to assess general ability to act
tals and 9 (30%) were employed in psychiatric units of
on the environment in specific goal-directed ways, and
general hospitals. On average, the therapists had been
the SIS is designed to assess general ability to relate ap-
practiCing occupational therapy for 75 years and had
propriately to people within the environment. Interrater
been practicing in psychiatry for almost 6 years. The
reliability and internal consistency of the BaFPE-R has
mean length of employment at the therapists' current
heen established and some evidence of the validity of the
facility was 4.4 years.
instrument has been published (Williams & Bloomer,
1987).
Leonardelli Haerrlein (1992) and Smith (1992) in the Procedure and Instrument
United States, Eakin (1989) in Britain, and Fricke and
Unsworth (1992) in Australia have reported that the Face-to-face, in-depth, semistructured interviews were
modification of standardized assessments in occu pational used because of the explofatory nature of the study. This
therapy practice is widespread. During discussions with research method allows the interviewer to establlsh a
clinicians about the clinical use of the BaFPE-R, the princi- "peer" relationship with the respondents (Lincoln &
ral investigator learned that there were often variations in Guha, 1985, p. 269) and proVides opportunities to ask
the purposes for assessment use, methods of administra- questions relating to context and meaning (Schatzman &
tion, and interpretation of the results. In an article dealing Strauss, 1973; Spradley, 1979). All interviews were con-
with current issues in occupational therapy assessment, ducted at the therapists' place of employment and re-
Smith (1992) asserted that "we have nor addressed the corded on audiotape hy the first author. The length of the
most critical questions pertaining to how occupational interviews ranged from 30 to 80 min. Typically, the inter-
therapists collect data and what occupational therapists views were "more like conversations than formally struc-
do with it" (p. 3). With these issues in mind, an explora- tured interviews" (Marshall & Rossman, 1989, p. 82). Us-
tory study examining the clinical use of the BaFPE-R by an ing this technique, "the researchef explores a few general
available sample of occupational therapists was conduct- topics to help uncover the participant's meaning perspec-
ed in 1991. The selection of the BaFPE-R as an example of tive, but other,vise respects how the participant frames
standardized assessments was based on its reputation in and structures the responses" (Marshall & Rossman,
the literature. Mann et '11. (1989) have documented its 1989, r 82)
extensive use and Leonarclelli Haertlein (1992) described The interview questions were based on the first au-
it as one of the assessments "setting the current standard thor's personal use of the BaFPE-R and on a review of the
for occupational therapy evaluation" (p. 952). literature about standardized assessments, including the
The study consisted of chart audits of occupational BaFPE-R. The interview gUide was elaborated and refined
therapy department records and semistructured inter- after pilOt trials. Eight topic areas were covered in the
views with occupational therapists who used the BaFPE- interview· demographic and clinical information, use of
1\. The purposes of the research were to describe the the assessment, perceptions of the purposes of the
demographic characteristics of both the clinicians who BAFPE-R, administration of the assessrnent and analysis
used the BaFPE-R and the assessed clients, to explore why of the assessment results, assessment of clients' reactions
and how the assessment was administered, and to deter- to the BaFPE-R, therapists' knowledge of the BaFPE-R,
mine how the assessment results were interpreted and evaluation of the strengths and weaknesses of the assess-
used. menr, and attitudes toward standardized assessments in
This paper focuses on three aspects of the study to general (see AppendG-x:).
provide (a) a classification of the therapists' descriptions
of their administration of the BaFPE-R and their analysis
Anal)'lic Procedures
and use of the assessment results, (b) an interpretive
analysis of the therapists' descriptions, and (c) a discus- The taped interviews \verc transcribed bv the first author
sion of the implications for the development and use of and analyzed according to the methods described hv Mar-
standardized assessment in occupational therapy. shall and Rossman, who stated that .

878 October 1993. Volume 47, Number 10


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
analytic procedures fall into five modes: organizing the data; gen- because they Iikel}' weren't going to be in that long and at least this
erating categories, themes, and pauerns; testing the emergenr gave ille some quick and diny observations that I could get into a
hypotheses against the data; searching for alternative explana- clinical note.
tions of the data; and writing the report. Each phase of data
analysis entails dala reduction as the reams of colleCted dara are Screening functiOn. Therapists reponed that the
brought into manageable chunks and interpretation as the re- BaFPE-R was often used for two screening purposes. A~
searchel' brings meaning and insight to the words and acrs of the
participants in the study (1989, p. 114) the follOWing statements suggest, therapists found the
BaFPE-R helpful in establishing the clients' level of func-
In accord with these conventions of qualitative data analy- tional performance to determine whether occupational
sis, the therapists' responses were organized into cate- therapy intervention was required:
gories of patterns and themes. Sets of interrelated re-
Respondent 13: It can also be an indicator of Iwhether] OT is
sponses were compared logically, theoretically, and required.... If they do super well Ion the I3aFPE-R), there may
empirically with other findings (Polgar & Thomas, 1988). nor be a need for extcnsive OT involvement.
The interpretation of the patterns and themes was de-
rived from the literature on the profession of occupation- Respondenr 17: Sometimes they're vcry functional so I don't walll
Ihem in aT because I don't fccl they need it.
al therapy and its values (KieJhofner, 1992; Shannon,
1977; Yerxa, 1983). The second screening function was to identify difficulties
The emergent analysis and interpretation of the in specific functional rerformance component areas. The
study results were examined by academic peers and recognition of these impairments then Justified place-
members of the occupational therapy pmfession, includ- ment of the client in " oanicular occupational therapy
ing some who were involved in the study The purpose of group.
this examination was to assess the trustworthiness of the Respondent 18: I find it'S very good as far as highlighting organiza-
research (Guba, 1981; Kr-efting, 1990; Lincoln & Guba, tion, memory, kinds of aClivities they do best on, structured ver-
1985)_ sus unstructured.. it helps me to pick the kind of aClivity that I
would probahl\' give them.

Results AI/iludes of multidiSCiplinary teams. Many of the


therapists interviewed indicated that their use of the
Reasonsfor the Use of the BaFPE-R BaFPE-R was influenced by the multidisciplinary team
The categories of reasons that therapists provided for with which they were affiliated. Most explained, in some
using the BaFPE-R, in order of frequency of responses, way, that their multidisciplinary team preferred standard-
were (a) departmental procedure, (b) time efficiency, (c) ized assessments to nonstandardized assessments.
screening function, (d) attitudes of multidisciplinary Rcspondent 15: For the initial assessment, they prefer that it be a
teams, (e) suPPOrt for other assessments, (f) therapeutic st'lIldardized test. ... If they didn't know about it [the I3aFPE-RI,
medium, and (g) evaluation of task performance. Exam- and if Lhey didn't want me to use standardized tests, I might not
tend to USt' it as much.
ples of these reasons, selected fmm the interview tran-
scripts, follow. l{cspondelll 2: Our p.sychi:ttrisIS challenge Ihe OTs about the teSt
Departmental procedure. The most commonly re- II3aFPE-R] fhey place a 101 of importance on traditional standalTI-
poned rationale for use of the BaFPE-f{ was that it was the ized psycholugictl LeSIs such as Ihe Ml\1PI . . they always felt we
10Tsi didn't ha\e a 101 of basis in SCientific merhml because we
standardized assessment that the occupational therapy dld;;'1 have a stanlhll-dil.ed assessment. The main expectation
department had decided therapists would routineJy use that psychiatei,ts have of the OT on the team is lproviding] infor-
lll:llion abuut the p:lticnr's funcrioning. Psychiatrists al'e con-
Respondent 2: It is our standard 1001 \,e made the decision cerned wilh p;llhology, while [the', OT is the teaill member that
that [it] was the lOol we were going to \he :IS a standard ;l.<scss-
accentuates the stren"lhs ofrhe patient. The OTs' initial concern,
mcnt for assessing task skills. when Ihe test \"IS fir'l u.')ed, was that it reflected the medical
model of pS\Thiatrish, rather than the client-centered model lof
Respondent I: All our patients, other than those 1"11 h dementia or occupaLional therapYI ... P'ychulogy is particularly interested in
those who arc illiterate or have poor English, get the Lest hecause Lhe GaFPE[-H] res ILS. OT and psychology [testing] resulLs oflen
it's part of our assessment process. cmeelate.... Ntlrsing has foeu,('d moee on subjecLive informa-
tion, while aT now has objective information instead of I-dying on
Time effiCiency. The second most frequently cited obselvation.
reason for using the BaFPE-R rather than alternate assess-
Several of the therapists interviewed reported publi-
ments was that the BaFPE-R could be administered and
cizing the BaFPE-R ill grand rounds or inservices at their
scored in less time.
facilities. One respondent explained as follows
Respondent 17: II" a vel)' quick turnover Ion the unit]. They're:
Respondent 17: Most of thenl (the team] ;ne [familiae WiIh Ihe
allowed to stay 6 weeks, but Ihey dun't stay that lung. And this i:,
why the: BaFPE[-RJ is vel)' useful. Because you do a qUiek one-shOl BaFPE-Rj because r've done an inservice on it. In fact, we fiaull[ it
around here.
assessment. That'S why I'd w;e it, bccausc tiille IS a facwr on
admission units.
Supportive pwposes. Therapists reported that the
I{espondent 9: 11 lthe BaFPE-Rj was probably illcetlllg my needs,
I3aFPE-R was used to support clinical observations and to
hecause I had to have something done quicklv with Ipillient'), complement other life skills assessments.

The American journal 0/ Occupational Therapy 879


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
Rcspondent 2'): The BafPE[R] gives nle lal hilck-up as 1(\ Will' terms of the value therapists placed upon the therapeutic
the)'I'e nO[ able 10 rJo certain tilings, like iflbel' can't l()l1o\V [thel
alliance and what [hey considered to be in their clients'
directions of a complex ra,.,k, can't COI1U.'lItrate, [Ol'! arc [,u(lIly
organized, f1 gives me reasons will' thc\' re dvsfuncrional in rhose best interests, The interview responses indicated three
areas. main areas where variations in therapists' use of the
BaFPE-R were common: (a) exclusion of the Social Inter-
The BaFPE-R as a therapeutic medium, In addition
action Scale (SIS), (b) exclusion of the Quali[ative Signs
to evaluating c1iems' current level of functioning, the
and Referral Indica[ors Section (QSRlS), and (c) modifica-
BaFPE-R was used as a therapeutic mec.Iium, Therapists
tions to the administration and scoring of the Task Ori-
recoumec.I that the feedback clients received f!'Om the
ented Assessment (TOA).
BaFPE-R results often improved client self-esteem and
E\'clusion of Social Interaction Scale, The most
self-confidence,
common form of variation in the administration of the
Respondent 7: One lad v said "I can't concentrme, [ can't do any- BaFPE-R was the exclusion of the SIS. Twenty-six (86,7%)
thing." I had something to show her II said that] "even though
you're feeling that wav, you scored 20 out of20 on Attenlion Span, of [he clinicians interviewed stated they had not used the
[andl vour MemolY for InSU'llClions was 20" I can show her that, SIS in the past 6 months, The assessment developers
when she did this formal test, ,[her attention spanl wasn't a emphasized that the evaluation of functional perform-
problem area,
ance should include both the task performance and social
Respondent 6: [If the patient hasl functional difficulties, [if he is I interaction scales (WiJliams & Bloomer, 1987). Therefore,
unable to cope with dependency and his world has become velY clinicians who had only used the TOA can be said to have
small because of his illness, I might do the I3aFPEI,RI tu give [himl assessed task performance rather than functional per-
some conCl'ete feedback,
formance using the BaFPE-R.
Evaluation of task perjormance, Five therapists Therapists offered various reasons for not using the
stated that the principal strength of the assessmem was SIS, One frequently cited reason was that other therapists
that it is task-based, They reported that they preferred were not observed using the scale, Others reported that
the BaFPE-R because it requires the cliem to "perform" the SIS was not used because social interaction was rou-
specific actions rather than merely respond to verbal or tinely assessed by the observation of clients in therapy
written questions, The follOWing quotation represents groups. Of most concern to therapists was the length of
this view: time required to rate the SIS, As one therapist stated:
Respondent 13: The biggest strength, as far as I'm concerned. is Respondenr 27: I used [the SIS I once, some time ago, but 1 just
thai it's task based. That is, to me, tremendously significant. As found thai Ihe amount of time thar I had to put into the paper
opposed to other standardized interviews, self,report queslion· wOI'k wasn't conducive, A'i far as I can remember, I think lhat the
naires, [lhat askl "how do you do in, ," [thc BaFPE-R) is !ask areas that it covered weJ'(~ quite relevant, It's jusl char I fell I had an
based, , , I believe, certainly for the populalion thar we e1eal \vith awareness of that son of summary thruugh my observations, It
in the provincial system. I queStion 1he valielily of self-I'epon ques· was more of a paper task thal wasn'l revealing something unusual
tionnaires [thal ask] "do yuu have pl'Oblems wilh , .. 10 me lhal I wasn't aware of [alreadvl

In summary, the clinicians who used the BaFPE-R Eyclusion of the Qualitative Signs and Refen-al In-
provided numerous rationales for their use of the as- dicators Section. According to the assessment develop-
sessment. These rationales included the inAuence of de- ers, the QSIUS is an optional component of the TOA that
partmental policy, the time efficiency of the assessment, may provide information about possible organic involve-
its screening function, the influence of the multidiSCiplin- ment (Williams & Bloomer, 1987), Six of the therapists
ary team, its usefulness as an adjunct to other assess- inter-viewed stated they had not used the QSRlS at aiL Of
ments, its therapeutic value, and its emphasis on task those therapists who reported that they had used the
performance. section occasionally, 11 therapists said that the QSRlS was
only used if the client had previously exhibited organic
Variations in Assessment Administration and Analysis signs, Some therapists who had not used the QSRlS stat-
of Assessment Results ed that, with experience, they had learnecl to identify
signs of organic involvement independently through ob-
The developers of the BaFPE-R provided specific guide- servation of the client in other situations.
lines for the administration of the assessment and for the
Res[xlndent 13: Organicily is something, , , vou can jusl lell, ami
interpretation of the results (Williams & Bloomer, 1987), vet the sCl'eening factors [on the QSRlS] wouldn't pick il up any
Therapists interviewed in this study reported varying de- more than with any schizuphl'enic who has lhe same kinds of
grees of deviation from the guidelines described in the problems of inabililv I() abstract. " I t was usuallv with clinical
observation that you [couldl sa\, "there's something wrong here,"
assessment manual. Some of these variations in the ad-
ministration of the assessment and in the interpretation Adaptations and modifleations in the administra-
of the results were consistent with the assessment guide- tion and scoring 0/ the TOA When asked c.Iuring the
lines, Conversely, some of the adaptations and modifica- interview if they had ever adapted or modified the assess-
tions described did not conform to the developers' speci- ment administration, most therapists said they had not,
fications, Many of these adaptations were explained in However, in explaining their experience and use of the

880 October 1993, Volume 47, Number 10


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
assessment, 21 therapists (70%) described some modifi- about comparing clients' scores on the TOA to the nor-
cations they had made and their reasons for doing so. The mative scores. Some therapists chose not to use the nor-
majority of reasons given for the adaptations related to mative data at all; others continued to persevere with
therapist's perceptions of clients' needs. Although thera- their use of (he norms despite misgivings. Six therapists
pists provided many examples of deviations from the as- stated that (hey believed the norms for the TOA were not
sessment protocol of the TOA, three variations were most applicable (0 their client population. The small sample
commonly described: (a) alteration of task completion size of the normative group was a concern to twO thera-
time, (b) deviation from the protocols for scoring and pists interviewed. Another two therapists considered the
analysis of results, and (c) modification of the verbatim use of norms for the TOA to be unimportant. Some thera-
instructions pists stated that they decided not to use the norms for the
With regard to the first variation, 19 therapists (63%) TOA after observing that other therapists were not using
stated that the gUidelines for task completion time on the them. Others explained that they believed the use of the
TOA were not always followed. Five therapists reponed TOA norms would not be fair to the client. Thev were
that additional imponant information about clients' task panicularly concerned that the client might be labelled as
functioning could be gained if the client was permitted to a result of the performance scores. One therapist exem-
complete the task rather than StOP when the allotted time plified the heSitation expressed by many therapists about
had expired. Several therapists explained that clients the use of the standardized scoring and norms in the
were allowed to complete tasks on the TOA to maintain follOWing \·\lords:
their self-esteem. One of these therapists reponed as
foJlows: Respondenr 6: I think there must have been some rea~e)f) why I
didn't think it Iv3S fair for mc to documenl those lscores in com-
Re>ponlknt 6: I don't ,,""n[ them 10 think rm ,cuing them up felt·
pari"on to the normsl I must have compared lhem [() ~ome
f<lilure. They get a e<:nain s"tisf<lctlon from completing il.
l).wcho!ogl tesl and felt thai it'.' not fair lO wrile lhi,; Judgment'
down. to he on ,ol11eonc's file forcvcr I "epon evervthing "s
Other therapists were concerned about the negative ef- heing mI' O(\'n impression. not absolute. Sometime~ the things
fect that timing the task had on client performance. vou I)ut In the nOlCS hal'e a 1m of power They can make long-
stalllllllg imp,'essloI1S on fu[UI'e people who arc involved wilh the
Respondent 9: 1l putS pressure un lhem thal thel' can'l rolerme.
diel1l
kno,ving lhal lhe)ire limed . .'.0 thel probJIJIl' dOn'l function as
well ,1S they can It affeCtS pCI·formance.
With I'egard to the third variation, 18 therapists
With regard to the second variation, deviations from (60%) t'eponed that thev modified the provision of the
the TOA scoring protocol and the guidelines for anah'sis written and verbatim instructions for the TOA. Some
of the results were made almost as often as the time therapists paraphrased the instructions; others used ver-
allotted for assessment completion was altered. Nineteen bal prompting. They offet-ed several reasons fOt" choosing
therapists (63%) reported that they did not use the norms to adapt the prOVision of the verbatim or written instruc-
published in the BaFPE-R manual (Williams & Bloomer, tions Some stated that mme infOt"mation about clients'
1987). None of the therapists interviewed had ever used performance could be obtained if the verbatim instruc-
the norms published by Mann et al. (1989) and Mann and tions were modified Others believed that presenting the
K1yczek (1991). Therapists at one provincial psvchiatric TOA instructions in a standardized form was demeaning
hospital reponed that neither the scoring format nor the to clients. Several therapists emphasized that the method
norms for the TOA were used. Conversely. therapists at a by which the assessment instructions are delivered
general hospital stated thm they used the scoring proto- should be individualized for each client. Four therapists
col outlined in the manual. However, instead of compar- reponed that the provision of assessment instructions
ing these scores to the norms, thev used other methods was 81tered to ensure that the client achieved success
of interpreting the scores. during the thet'apy session. One therapist explained as
Many therapists pl'Ovided more than one reason for foJlows:
their decision to alter the scoring or the protocols used RC,.,pOllllel1l 11: Occasionalh'. II paraiJhl"3se the instrUCtions] tU
for analysis of the assessment results. Some reponed thar mcct the needs of an indil'iduJI pJtienl.1t·s dlfl1cultnOlto try and
the length of time taken to score the assessment deten-ed explain the insll'lluions in ,mother W<l\, and see if they can under-
stand if \'()u repl"'Jse it The abstraction question, in tile sec-
them from using the formal scoring protocol. Other ()ml edition. i" pool'k (\·orded. J oflen neeclto rephrase it. "Skills"
therapists made observations of performance while the is:t lingo" ord. Patients don't think of the specific things we do. J
client was completing the TOA. These observations were llli~ht I'e\\,md [thc question to say'l "what do vou need to be able
lU do in mder t() do this lask'"
described as mOt"e useful than the actual task scmes Ten
therapists (33%) expressed concerns with the scoring The information gleaned from the interviews with
criteria for the TOA. Some said that thev questioned the tlwrapists who used the BaFPE-R indicated that there
reliability of the scoring procedures Three therapists did were perceived positive innuences un the decision to use
not score the TOA because of these concerns. (his assessment Simultaneously, however, perceived
Therapists discussed their differing reservations needs and contingencies to alter its standardized admin-

7be American Journal olOccupational TberapJ' 881


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
istration appeared to exist. Some suggested interpreta- such instruments. Additionally, through their education
tions of this paradox follow. and socialization to practice, occupational therapists tend
to adopt the core values and assumptions of the profes-
sion (Department of Health and Welfare Canada and
Interpretative Understanding
Canadian Association of Occupational Therapists, 1983;
The results of this exploratory study support the asser- Kielhofner, 1992; Yerxa, 1983). These values reflect a
tions of other authors on the widespread practice of strong tendency "to focus on the assets of individuals and
modifying standardized assessments in occupational to emphasize the therapeutic process" (Kielhofner, 1992,
therapy (Eakin, 1989; Fricke & Unsworth, 1992; Leonar- p. 73). According to Kielhofner, "another deeply in-
delli Haertlein, 1992; Smith, 1992). The content of thera- grained value of occupational therapy is the belief in ca-
pists' explanations provides some suggestions as to why pacity and the therapist'S obligation to tease out that
assessment adaptation is occurring. Professional issues capacity" (1992, p. 73). The findings of this study illustrate
and values appeared to permeate the responses of most the continuing commitment to those core values and
interviewees. The responses centered on the therapists' beliefs that have underpinned the profession of occupa-
values and beliefs about clients' needs and the perceived tional therapy since its inception. As Kielhofner stated,
obligations of occupational therapy practice. values "are very important guides to action" (1992, p. 73).
Most therapists interviewed directly expressed or in- Knowledge of the values expressed by the therapists in
directly indicated an ambivalence toward standardized this study contributes to an understanding of the manner
assessments. They expressed a need to use standardized of using and modifying assessments such as the BaFPE-R.
assessments, such as the BaFPE-R, yet they were con- The therapists modified the administration and scor-
cerned about the incompatibility of the assessment with ing of the BaFPE-R to "tease out" their clients' capacities
the therapeutic aims of their practice. Many stated that at the expense of the standardized protocol. It appears
their decision to use the assessment was influenced by that the values of a humanistic, client-centered practice
the professional image that their multidisciplinary team outweighed the values of a reductionistic, scientific ap-
colleagues, especially psychiatrists and psychologists, as- proach to practice. Their desire to maintain and enhance
sociated with the use of standardized assessments. It ap- client strengths rather than to focus on deficits appeared
pears that they used the reporting of the BaFPE-R results to guide the therapists' modified use of the standardized
in team meetings as an indicator of professional status. instrument.
These therapists described their use of the BaFPE-R as a
means to developing a professional identity and improv-
Implications
ing the recognition and credibility afforded their profes-
sion. The BaFPE-R seemed to serve as an outward mani- The results of this study raise several questions in regard
festation of the scientific base of occu pational therapy. to occupational therapy research and practice. Most cur-
This commitment to the use of a standardized as- rent research in the profession relies on the use of stan-
sessment was often constrained by the perceived inability dardized assessments to measure the variables of con-
of the BaFPE-R to identify and address the specific needs cern. As this was an exploratory study, the findings
of individual clients. Most therapists alluded to a desire to described cannot be generalized to the use of other stan-
address the unique needs of each client rather than mere- dardized assessments. Similar studies to the one reported
ly the manifestations or symptoms of the disease. Many here, examining the use of other standardized instru-
reported that the guidelines of the standardized proce- ments are, therefore, required. Such research needs to
dures inhibited their ability to attend to persons' needs. address questions regarding the extent to which the non-
Although they did aspire to gain the acceptance and rec- standardized administration of assessments influences
ognition of the multidisciplinary team, it appeared that the reliability and validity of research based on these
following the administration protocol was incongruent assessment results.
with the therapists' inclination to treat clients as The implications for clinical practice appear to be as
individuals. salient as the implications for research. The results of this
Kielhofner (1992), Shannon (1977), and Yerxa study were interpreted in terms of the strength of occupa-
(1983), among many others, have examined the relation- tional therapists' commitment to approaches that em-
ship between the core values of occupational therapists phasize each client's unique strengths. This interpreta-
and the influence of science, scientific methods, and the tion challenges the profession to develop assessments
reductionistic approach to health and illness. These au- that recognize the importance of that therapeutic goal,
thors provide possible reasons for the ambivalence re- that is, to develop assessments that meet our clinical
ported by the therapists interviewed in this study. responsibilities, our values, and our clients' needs. Such
The education of occupational therapists includes instruments must demonstrate acceptable psychometric
instruction in the administration of standardized assess- properties without diminishing our recognition of the
ments and the necessity for the reliability and validity of capacities and holistic nature of our clients. The incon-

882 October 1993, Volume 47, Number 10


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
gruity between professional values and the demands of Knowledge of the BaFPE
standardization, as currently professed, require careful 61 How did you first Jearn about the BaFPP
6.2 How were you trained to use it'
examination and, ultimately, resolution. ~
63 Are you familiar with the BaFPE manual'
6.4 Are you familiar with any studies that examine the BaFPE?
Acknowledgments
EI'aluation of the A'isessment
We thank Samuel Noh, PhD. thesis co-advisor, and Helene Pola- 71 How much do you think the results on the BaFPE reflect
tajko, PhD. of the thesis advisory committee. We are indehted to the p"!tients' actual functional status'
Carrie Clark for her critical evaluation. to Elizaheth SCOtt, ,\IS, for 7.2 Do you think the BaFPE is reliable?
her editorial assistance, and to Elizaheth Yerxa, odD. for her 73 And valid?
encouragement and support. In addition, we thank all of the 7.4 What do you think are the strengths of the BaFP£?
occupational therapists who participated in this stuely for their' 7.) And its weaknesses or shortcomings'
open and honest sharing of their clinical expel'iences. 76 Do you think an)' of the items are inappropriate for cul-
This paper' is based on research the fir-st author conduCied tural or other reasons'
in partial fulfillment of the requirements for- the degree of Mas- 7.7 Have you ever taught or trainee! anOther occupational
ter of Science at the University of Western Ontario, London. therapist or occupational therapy s[LIdent to use the
Ontario, Canada. BaFPP
78 Have vou ever r'ecommendecl It [(J other occupational
ther-apists or occuDational theraDY Students?
St(mdardized Tests
Appendix 8.1 Ho\-v important do you think it is that we as occupational
therapists in psychiatry use standardized tests?
Clinician Interview Guide: Revised
NOLe These questions gUJded the intelview and were not asked
Demographic and Clinical Information verhatim. Probe questions, not shown here, were used to eluci-
1.1 When did you get your OCCulxltional therapy qualifica- date salient Doints raised bv interviewees.
tion'
1.2 At which university'
1.3 How long have vou practiced here, at lhis facility' References
14 And how long in psychialIY'
15 What clinical team are you affiliated With' Bloomer,.J S. & Williams, S L (l97H). Bay Areu Function-
1.6 What is the average lenglh of stay of patients on your al Pei/ol'lnance El'aluution. Palo AJtO, CA: Consulting Psychol-
unit? ogists Press
1.7 What are your main duties? Depanment of Health and Welfare Canada and Canadian
Association of Occu!Jational Ther·apists. (1983). GUidelines/or
Use 0/ the Instrument tbe client-cenlred practice oj' occupational therapy (H39-
2.1 Are you using the first or second edition of the BaFPE' 33/198:3E) Otta<;\a, ON Department of National Health and
[Have you ever used the (other) edition'] Welfal'e
2.2 How often do you use it' Eakin, P (1989). Assessments of activities of daily living: A
23 Which patients cIo you use the BaFPE with [describe age, uiticli l-eVieIV Britisb JOllrnal of Occupational Tbel-apv. 52,
diagnosis, acute or chronic]' 11-1 '5
P1I1pose 0/ the BaFPE Fricke,]., & l nsworth, C (1992). The status ofactjvjties of
3.1 What do you think the purpose of the BaFPE is? dailv living A Vidorian perspective. Australian Occupational
32 What do you think the developers of the BaFPE intended Tbempl' JOII 1'/'/(/1, 39, 29-31.
it for' Guha, E G (l9Rl). Criteria for assessing the trustworthi-
ness of naturalistic inquiries. Fducarional Communication
Administration 0/ tbe BaFPE and Anall'sis of Results and Technology Journal, 29. 7'5-91.
4.1 Which of the suhtests do you administer? Hemphill, l3.]. 09HO). Ivlental health evaluations used 111
[Whv do YOU not use (_) subtest/component?j occupational therapl'. )..merican Journal 0/ Occupational
4.2 Have you ever made any adaptations to the BaFPP Therapy. 3-'1, 721- 7 25.
43 How do vou inteq)ret patients' scores' [If norms not Houston. D., Williams, S, Bloomel-, J. & Mann, W. (1989).
used, elahorate] The Bav f\.rea Functional Performance Evaluiltion: Development
4.4 What do you use the results from the BaFPE for' and standardization. )..merican Journal o{Occupmional Ther-
4.'5 How much e!oes the patient's performance on the BaFPE apr. 43, 170-183
affect your- planning? Kielhofner, G. (1992). Conceplual/oundationsoj'occupo-
4.6 Who e!o you discuss the evaluallon results With' tionalt!Jerap.1'. Philadelphia: F. A Davis.
4.7 Are other members of your multicJisciDlinary team famil- Krdting.1.. (1990). Rigor in qualitative reseal'ch: The as-
iar with the BaFP£, se,sment of trustll·OnhIllCSS. Americanjou rna IolOccupation-
Palient Reaction to tbe BaFPE al Thempl·. ,,/), 21-l-222
') 1How do your patients react to the BaFPP Leon;m.klli l'laertlein, C. A. (1992). Ethics in evaluation in
5.2 HolV often are you unable to complete it in one session' o"cupationJI therap)'. American jounwl of Occupational
'5.3How often are you unable to complete it at all' Tberapl', 46. 9'50-9'i3
).4 How long does it usuallv take for you to administer the Lincoln. Y S., 8:. Cuba, E C. (198'). Naturalistic inquirr
BaFPP BClcril 11 ills. CA Sage
'55 A.ne!lO write up the results' i\lann, \\1. KJl'czek J, & Fiedler. R. (19H9). Bay AreJ Func-
S6 Do you think a shortened version of the BaFPE woule! be tional Performancc EI',lluation (BaFPE): Standard scores Occu-
useful co vou? patiollal Thempl' il7 .Hen/al Healtb. 9. 1-7.

The American journat of Occupaliunal Therapl' 883


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms
Mann, W" & KJ)'czek,j. (1991), Standard scores for the Bay York: Holt, Rinehart, & Winston.
Area Functional Performance Evall arion Task Oriented Assess- Stein, F. (1988). Research analysis of occupational therapy
menr. Occupational Therapy in Mel/lal Health, II, 13-24, assessments used in mental health. In B. j. Hemphill (Ed.),
Marshall, c., & Rossman, G, B, (1989). Desip,ning qualila- Mental health assessment in occupational therapy: An inte-
live "esearch Newbury Park, CA: Sage. gratiue approach 10 the evalualive process. Thorofare, I J:
Moyer, E. A. (1984). A review of initial assessments used by Slack
occupational therapists in mental health settings. Occupational Thibeault, R., & Blackmer, E. (1987). Validating a test of
Therapy in Health Care, 1, 33-43. functional performance with psychiatric patients. American
Polgar, S., & Thomas, S. (1988). Introduction to research journal of Occupational Therapy, 41, 515-521.
in Ihe health sciences. lew York: Churchill Livingstone. Watts, J 11., Bmllier, c., & Schmidt, W. (1988). Why use
Schatzman, L, & Strauss, A. L (1973). Field research. En- standardized patient evaluations' Commentary and sugges-
glewood Cliffs, NJ: Prentice-Hall. tions. Occupational Therapy in Mental Health, 8, 89-95
Shannon, P. D. (1977). The derailment of occupational Williams, S. L, & Bloomer,.!. S. (1987). Bay Area Function-
therapy. American journal of Occupational Therapy, 31, al Performance Evaluation (2nd ed.). Palo Alto, CA: Consulting
229-234 PsychologistS Press.
Smith, R O. (1992). The science of occupational therapy Yerxa, E..!. (1983). Audacious values: The energy source for
assessmenr. Occupational Therapy journal of Research, 12, occupational therapy practice. In G. Kielhofner (Ed.), Health
3-15. through occupation: Theory and practice in occupational
Spradley, 1. S. (1979). The ethnowaphic interview. New therapy (pp. 149-162). Philadelphia: Davis.

ATTENTION O.T. lOu saw us at Seattle &


PROFESSIONALS AND Fart Lauderdale
DEPARTMENT HEADS
NOWTRY OUR BACK
Perm. and Temp. employ- SUPPORT PRODUCTS
ment opportunities availa- THE BAMBACH
ble for OT. professionals.
SADDLE
To help fill your depart-
ment staffing needs call
SEAT
All States Medical Place- for natural
ment Agency, Inc. Serving ba£krelief
medical professionals and
facilities since 1959.
Call 1-800-521-6750 or
1-800-762-1258
FOR
ALL STATES INTERNATfO
MEDICAL PLACEMENT TOLL FREE
INFORMATION
AGEN~ INC. FAX I 800 4683465
Box 91 P.O. Box 153
laSalle, Michigan 48145 Sydney Australia 2100
VISA I MASTERCARD ACCEPTED

884 October 1993, Volume 47, Number 10


Downloaded from http://ajot.aota.org on 05/31/2020 Terms of use: http://AOTA.org/terms

You might also like