You are on page 1of 7

Article

Performance-Based Measurement of Functional


Disability in Schizophrenia: A Cross-National Study
in the United States and Sweden

Philip D. Harvey, Ph.D. Objective: Recent advances in the as- (New York, mean score=13.84; Sweden,
sessment of disability in schizophrenia mean score=13.30), as were scores on the
have separated the measurement of func- case manager ratings of everyday activi-
Lars Helldin, M.D.
tional capacity from real-world functional ties (New York, mean=49.0; Sweden,
outcomes. The authors examined the mean=48.8). The correlations between
Christopher R. Bowie, Ph.D. similarity of performance-based assess- UPSA-B score, neuropsychological test per-
ments of everyday functioning, real-world formance, and case manager ratings did
Robert K. Heaton, Ph.D. disability, and achievement of milestones not differ across the two samples. The pro-
in people with schizophrenia in the portion of patients who had never had a
Anna-Karin Olsson, M.D. United States and Sweden. close relationship and the rate of voca-
Method: The UCSD Performance-Based tional disability were also nearly identical.
Fredrik Hjärthag, Ph.D. Skills Assessment–Brief Version (UPSA-B) However, while 80% of the Swedish pa-
and a neuropsychological assessment tients were living independently, only 46%
Torsten Norlander, Ph.D. were administered to schizophrenia pa- of the New York patients were.
tients living in rural areas in Sweden (N= Conclusions: While scores on perfor-
Thomas L. Patterson, Ph.D. 146) and in the New York City area (N= mance-based measures of everyday living
244), and patients’ functioning was rated skills were similar in people with schizo-
by their case managers. Information from phrenia across cultures, real-world resi-
records and case managers was used to dential outcomes were very different.
determine the frequency of living inde- These data suggest that cultural and so-
pendently, working, and having ever ex- cial support systems can lead to divergent
perienced a stable romantic relationship. real-world outcomes among individuals
Results: Performance on the UPSA-B was who show evidence of the same levels of
essentially identical in the two samples ability and potential.

(Am J Psychiatry 2009; 166:821–827)

P eople with severe mental illnesses suffer disability in


multiple everyday domains. Recent studies of real-world
smaller and more variable, with the studies rating real-
world outcomes with self-report methods generally yield-
disability have focused on the relationships between im- ing smaller correlations.
paired performance on neuropsychological tests and func- Despite the relationship between neuropsychological
tional skills (or functional capacity) (1–3). Functional ca- outcomes, functional capacity outcomes, and real-world
pacity measures are standardized tests of everyday outcomes, in most studies only a small amount of vari-
activities, such as financial management and medication ance in real-world outcomes is accounted for by the other
management; they are clearly face-valid predictors of ev- two sets of variables. Even patients whose neuropsycho-
eryday functioning, but other environmental and experi- logical functioning is in the normal range have substantial
ential factors may cause discrepancies between what peo- disability in certain domains of everyday functioning (8).
ple can do and what they actually do in their everyday lives. Several other variables clearly mediate the relationships
For instance, a person with schizophrenia may be capable between skills competence and performance in real-world
of independent medication management but may not settings, including the motivation to engage in real-world
have the opportunity to do so because of rules and operat- functional activities; other symptoms, such as depression
ing procedures at his or her board-and-care facility. and negative symptoms (9, 10); and other skills, such as
The results of studies examining the correlation be- social cognitive abilities (11). Perhaps the most important
tween functional capacity and neuropsychological mea- of these influences is the societal context, which includes
sures have been remarkably consistent in finding substan- health insurance, disability policies, and cultural attitudes
t i a l c o r re la t i o n s be twe en t he se tw o d o m a in s o f toward disability and mental illness. In the large Clinical
functioning (3–7). Correlations between these two sets of Antipsychotic Trials of Intervention Effectiveness (CATIE)
measures and various real-world outcomes have been study, the most potent predictor of current unemploy-

Am J Psychiatry 166:7, July 2009 ajp.psychiatryonline.org 821


MEASUREMENT OF FUNCTIONAL DISABILITY IN SCHIZOPHRENIA

TABLE 1. Characteristics of Swedish and U.S. Samples of tients in Sweden. Patients in both countries performed the
Schizophrenia Patients in a Study of the Measurement of functional capacity measure and their case managers rated
Functional Disability
their functioning in several domains, including residential,
Country
vocational, and social functioning. Real-world functioning
Sweden United States
Characteristic (N=146) (N=244) milestones, including independence in living situation, re-
Mean SD Mean SD lationship history, and current employment status, were all
Age (years) 48.4 11.9 55.8 9.4 collected from records, interviews, and case manager re-
Years of education 13.6 3.4 12.6 3.2 ports. Of additional interest was the fact that the Clinical
WAIS-III vocabulary subtest 39.44 11.55 34.34 14.89
N % N % Long-Term Investigation of Psychosis in Sweden sample
Ethnicity was from a largely rural area (Trollhättan) and the U.S.
Caucasian 146 100 129 53 sample was collected in New York City and its immediate
African origin 0 0 71 29
Native American 0 0 5 2 suburbs. This is, to our knowledge, the first study that di-
More than one race 0 0 15 6 rectly compared functional capacity, clinical ratings of dis-
Unknown or unavailable 0 0 24 10 ability, and functional outcome milestones across two dif-
Male 92 63 178 73
ferent countries whose health care systems and levels of
social support for people with mental illness are very diver-
ment in individuals with schizophrenia was the receipt of gent. Thus, this study provides a wide-ranging test of the
disability compensation (12), which is often linked to the cross-cultural generalizability and utility of functional ca-
individual’s health insurance coverage. This is a finding pacity assessments.
consistent with previous research (13).
Social service plans are highly divergent across coun- Method
tries, with some countries having national health insur-
ance and others having much more haphazard systems. Participants
The prevalence of schizophrenia and the distributions of Participants in this study were older ambulatory schizophrenia
patients. Exclusion criteria for this study included a primary
classical schizophrenia symptoms are quite consistent
DSM-IV axis I diagnosis other than schizophrenia or schizoaffec-
across countries (14), and cross-national studies of cogni- tive disorder; a Mini-Mental State Examination score below 18; or
tive performance in schizophrenia have found substantial any medical illnesses that might interfere with the assessment. All
similarity across different Western countries (15). However, U.S. participants were in outpatient treatment at the time of re-
since elements of everyday functional disability are multi- cruitment at a Department of Veterans Affairs site, a New York
state site, or an academic research site. Patients in Sweden were
ply determined, it may be that the influences of social ser-
receiving care from the county council-funded outpatient clinics
vices are different across countries. In line with this hy- at NU Health Care Hospital. Outpatient status was defined as liv-
pothesis, we previously reported that several elements of ing outside of any institutional setting, including a nursing home.
disability in everyday skills (i.e., social and self-care func- All participants received a complete explanation of the testing
tions) were differentially impaired across long-stay institu- procedures and signed an informed consent form approved by
the institutional review board at each research site.
tionalized schizophrenia patients in the United States and
Patients in both samples were excluded if they had a history of
the United Kingdom (16). Cognitive impairment was con- head trauma with loss of consciousness, active substance abuse
sistent in severity across the patients in the two countries, or a lifetime history of substance dependence, or any disease of
and despite the differences in severity of disability, the cor- the CNS, including a history of stroke, degenerative dementia
relations between cognitive impairments and the severity such as Alzheimer’s Disease, or Parkinson’s disease.
All participants met diagnostic criteria for schizophrenia or
of the different aspects of disability were essentially the
schizoaffective disorder (DSM-IV ). For the U.S. patients, the
same across countries. We suggested that environmental Comprehensive Assessment of Symptoms and History (CASH; 19)
differences in the long-stay hospital system drove varia- was completed by a trained research assistant, and diagnosis was
tions in the topography of impairments in everyday skills confirmed with a senior clinician. For the Swedish patients, diag-
across the two countries and systems of care. noses were generated according to DSM-IV diagnostic criteria
and the Decision Trees for Differential Diagnosis by their psychi-
In this article, we present the results of a cross-national atrists. Data for these analyses came only from patients who were
study conducted in the United States and Sweden examin- receiving case management services and were actively involved
ing the severity of impairments in performance on struc- in psychiatric rehabilitation services. The case managers were
tured examinations of everyday living skills (i.e., functional used as the informants for the real-world functional status rat-
ings. All patients were receiving treatment with antipsychotic
capacity), the level of observed disability in everyday living,
medications (either first- or second-generation agents) at the
performance on neuropsychological tests, and real-world time of their assessments.
functional milestones (e.g., independent living) and their
Performance-Based Measure of Functional Capacity
correlations. We created a translated version of a func-
tional capacity measure, the UCSD Performance-Based The UCSD Performance-Based Skills Assessment battery
(UPSA; 20) is designed to directly assess functional skills compe-
Skills Assessment–Brief Version (UPSA-B; 17), and a trans- tence among the severely mentally ill. It was designed for outpa-
lated version of a real-world outcomes clinical rating scale, tients and measures performance in a number of domains of ev-
the Specific Level of Functioning Scale (18), for use in pa- eryday functioning through the use of props and standardized

822 ajp.psychiatryonline.org Am J Psychiatry 166:7, July 2009


HARVEY, HELLDIN, BOWIE, ET AL.

TABLE 2. Performance on the UCSD Performance-Based Skills Assessment–Brief Version (UPSA-B), Neuropsychological As-
sessments, and Ratings of Real-World Functional Outcomes in Swedish and U.S. Samples of Schizophrenia Patients
Country
Sweden United States Analyses
Measure Mean SD Mean SD t p Cohen’s d
UPSA-B (Sweden, N=146; U.S., N=244)
Finances, raw subscore 7.73 2.52 7.47 3.59 0.77 0.40 0.07
Communication, raw subscore 5.57 1.91 5.67 2.99 0.71 0.43 0.03
Total score, raw 13.30 3.75 13.84 3.98 –1.33 0.83 0.13
Total score, adjusteda 69.89 18.59 69.03 19.64 0.43 0.68 0.04
Specific Level of Functioning Scale domain subscores
(Sweden, N=142; U.S., N=197)
Physical functioning 23.87 2.34 23.74 2.08 0.53 0.60 0.03
Personal care 32.52 3.47 34.22 4.70 3.66 0.001 0.36
Interpersonal 23.61 6.03 29.78 5.37 9.09 0.001 0.67
Acceptable behavior 33.71 2.06 33.87 2.03 0.72 0.47 0.08
Community activities 48.78 7.19 49.06 8.54 0.31 0.75 0.03
Work skills 20.62 4.62 24.23 8.54 6.22 0.001 0.58
Specific Level of Functioning Scale total score 183.23 18.76 196.63 18.86 5.87 0.001 0.71
Neuropsychological tests (presented as T scores) (Swe-
den, N=100; U.S., N=244)
Trail Making Test, Part A 32.45 12.64 29.79 10.16 1.87 0.08 0.26
Trail Making Test, Part B 30.60 15.27 24.51 18.92 3.14 0.003 0.32
Rey Auditory Verbal Learning Test, learning subscore 35.52 14.26 34.15 13.31 0.83 0.40 0.10
Letter-number sequencing 41.26 12.18 39.94 10.84 0.94 0.32 0.15
Wisconsin Card Sorting Test categories 38.13 10.06 32.79 9.43 4.56 0.001 0.45
Average 35.59 11.40 32.23 11.82 2.06 0.04 0.28
a Converted to a 100-point scale for comparability with the full version of the UCSD Performance-Based Skills Assessment.

skills performance situations. In this study, the UPSA-B (17) was patient’s performance on cognitive and functional capacity mea-
used, which contains two of the original UPSA domains, based on sures, and the testers and interviewers who completed and
two recent studies (17, 21) suggesting that these two subscales scored all other aspects of assessment were unaware of the case
alone correspond excellently with the total score. In the finance managers’ ratings.
domain, the patient must count out given amounts from real cur-
rency, make change, and fill out a check to pay a utility bill. The Real-World Milestones
communication domain involves a series of role play situations In addition to the dimensional approach to rating real-world
requiring that the patient make emergency calls, call directory as- behavior with the Specific Level of Functioning Scale, we used a
sistance to request a telephone number, call the number, and categorical ranking of milestone achievements, derived from a
then reschedule a medical appointment. We standardized the combination of self-report, case-manager, and chart data, that
scores to a 100-point scale, like the original five-subtest UPSA, we employed in a previous study (8). Independent living status
thus allowing comparisons to previous results. This total score was assessed by whether the patient lived in restrictive or sup-
was used as our dependent measure. In Sweden, occupational ported housing as well as whether he or she was at least partially
therapists performed the assessment. financially responsible for the residence. Patients were classified
as living in restricted housing, living independently but not fi-
Real-World Functional Outcomes nancially supporting the residence, or living independently and
We used the Specific Level of Functioning Scale to examine ev- financially supporting the residence. Current work status was
eryday functioning in the real world. This scale is a 43-item ob- classified as unemployed or employed at least part time. Marital
server-rated report of a patient’s behavior and functioning in six status was classified as married or widowed, divorced or sepa-
domains: physical functioning (e.g., vision, hearing), personal rated, or never married.
care (e.g., toileting, eating, grooming), interpersonal relation-
ships (e.g., initiating, accepting, and maintaining social contacts; Translation of Instruments
communicating effectively), social acceptability (e.g., verbal and The English version of the UPSA-B requires manipulation of
physical abuse; repetitive behaviors), participation in community currency, paying bills, and communication, including emergency
activities (e.g., shopping, using the telephone, paying bills, use of communication. In order to have the Swedish version be as similar
leisure time, use of public transportation), and work skills (e.g., as possible to the original, all currency amounts were retained and
following verbal instructions, completing tasks with minimal su- expressed in terms of the Swedish krona (which is also a decimal
pervision, being punctual). Ratings are made on a 5-point Likert currency system, like the U.S. dollar). The bill to be paid was mod-
scale by the third-party informant on the basis of the amount of ified to look like a Swedish bill, and emergency communication
assistance the patient needs to perform real-world skills (per- items were modified to be congruent with the local requirements.
sonal care, activities), effects of the illness on daily living (physical Instructions and scoring criteria for the UPSA-B and the Spe-
functioning), or frequency of a behavior (interpersonal relation- cific Level of Functioning Scale were translated into Swedish. For
ships, social acceptability, work skills). Higher scores reflect less the UPSA-B, two of the Swedish authors (L.H. and T.N.) per-
impairment and more independence. The Specific Level of Func- formed the translation together with a professional translator and
tioning Scale has been shown to be related to neuropsychological in contact with one of the U.S. authors (C.R.B.). For the Specific
performance and scores on functional capacity measures (5, 8, 9). Level of Functioning Scale, the same two Swedish authors and the
For all participants in this study, a case manager for the patient translator completed the translation. The two instruments were
completed the scale, and all case managers indicated that they then back-translated and checked by the Swedish authors to en-
knew the patient “very well.” Case managers were unaware of the sure comparability with the original instruments.

Am J Psychiatry 166:7, July 2009 ajp.psychiatryonline.org 823


MEASUREMENT OF FUNCTIONAL DISABILITY IN SCHIZOPHRENIA

FIGURE 1. Real-World Outcomes Across Three Functional cal tests were converted to age-, education-, and gender-cor-
Domains in Patients in Sweden and the United States rected standardized T scores from published U.S. norms. We used
U.S. norms because of the standard practice in the Nordic coun-
Residential Outcomes tries of using U.S. norms for clinical assessment (personal com-
90 munication from Erik Hessen, November 2008). We created a
80 Sweden
composite score for the neuropsychological measures by averag-
ing the T scores across the tests that were administered to both
Percentage of Sample

70 USA samples. Since these T scores are demographically corrected, we


60 did not perform analysis of covariance with demographic factors.
50 Sample Overlap
40 We reported data from the U.S. sample in a previous study (8).
30 For that study, we reported all analyses of real-world outcomes
20 and performance-based measures with patients subdivided ac-
cording to whether or not they met criteria for normal neuropsy-
10 chological functioning and symptomatic remission. As a part of
0 the Clinical Long-Term Investigation of Psychosis in Sweden, the
Independent and Not Financially Restricted Swedish sample was collected specifically to be assessed with the
Financially Responsible functional capacity and real-world outcomes assessment for this
Responsible
research project.

Vocational Outcomes
90 Results
80 Sweden The basic demographic characteristics of the sample,
Percentage of Sample

70 USA including vocabulary performance, are presented in Table


60 1. As would be expected, 100% of the Swedish patients
50 were Caucasian, and the U.S. sample was more ethnically
diverse. The Swedish patients were somewhat younger
40
and slightly better educated, on average, and more likely
30
to be female compared to the U.S. sample.
20
Performance on the various assessments is summarized
10 in Table 2. As can be seen in the table, t tests showed that
0 UPSA-B scores in the two countries were essentially iden-
Unemployed/ Employed
disabled tical, both on a raw score basis and when the scores were
converted into the UPSA-B’s 100-point scale. Impairments
Social Outcomes in physical functioning, acceptable behavior, and every-
90 day activities were also essentially identical across the two
80 countries, while the U.S. patients were rated by their case
Sweden
managers as less impaired in basic activities of daily living,
Percentage of Sample

70 USA
social activities, and work-related activities. In contrast,
60
neuropsychological performance was poorer on some of
50
the tests in the U.S. sample, with the composite T score
40 suggesting significantly poorer performance on the part of
30 the U.S. patients.
20 While total scores on the Specific Level of Functioning
10 Scale reflected significantly more impairment in the
0 Swedish sample, some of the individual subscales did not
Never Married Divorced or Married or differ between the two samples, including physical func-
Separated Equivalent
tioning, socially acceptable behavior, and everyday living
or Widowed
skills, which measures readiness for independent living.
The effect sizes of the differences for the subscales that
Neuropsychological Assessment differed across the countries were moderate for work and
Both samples were examined with a neuropsychological as- basic activities of daily living and large for social function-
sessment, which was somewhat different in each country. The ing. In contrast, the effect sizes for neuropsychological
tests that overlapped were the Trail Making Test, Parts A and B performance were large for two variables, very small for
(22); the WAIS letter-number sequencing subtest; the Rey Audi- two, and small (and nonsignificant) for one individual
tory Verbal Learning Test (23); the Wisconsin Card Sorting Test,
variable and on the composite score.
128-card version (24); and the WAIS vocabulary subtest. These in-
struments had been previously translated into Swedish and were Figure 1 presents the residential, vocational, and social
in clinical use in Sweden. All raw scores on the neuropsychologi- outcomes for the Swedish and U.S. samples. Social and vo-

824 ajp.psychiatryonline.org Am J Psychiatry 166:7, July 2009


HARVEY, HELLDIN, BOWIE, ET AL.

TABLE 3. Pearson Product-Moment Correlations Between Score on the UCSD Performance-Based Skills Assessment–Brief
Version Score, Neuropsychological Performance, and Score on the Specific Level of Functioning Scale in Swedish and U.S.
Samples of Schizophrenia Patients
Assessment
Sample and Assessment Neuropsychological Performance Specific Level of Functioning Scale Score
U.S. sample (N=197)
UPSA-B score 0.58*** 0.38***
Neuropsychological performance 0.16*
Swedish sample (N=100)
UPSA-B score 0.54*** 0.44**
Neuropsychological performance 0.24*
*p<0.05; **p<0.01; ***p<0.001.

cational outcomes were essentially identical in the two sam- TABLE 4. Score on the UCSD Performance-Based Skills As-
ples. Where the outcomes diverged considerably was in the sessment–Brief Version as a Function of Residential Inde-
pendence in Swedish and U.S. Samples of Schizophrenia
area of residential status. The majority of the Swedish pa- Patients
tients were living independently and were financially re- UPSA-B Score
sponsible for their housing. The proportion living in re- Country and Residential Status Group Mean SD
stricted settings was considerably greater in the U.S. sample. Sweden
Table 3 presents the correlations between composite Independent, financially responsible (N=118) 13.89 10.25
Independent, not financially responsible (N=21) 13.27 3.43
neuropsychological performance, total scores on the
Restricted (N=7) 10.22 4.95
UPSA-B, and total scores on the Specific Level of Func- United States
tioning Scale for the two samples. The correlations were Independent, financially responsible (N=112) 15.46 3.37
Independent, not financially responsible (N=41) 12.65 5.35
very similar across the two countries, and none of the cor-
Restricted (N=91) 10.13 4.67
relations between any of the pairs of variables in the two
samples were statistically significantly different using the
two-sample z test for the significance of the difference be- phrenia on a well-validated scale of functional capacity in
tween correlations (all z values <1.21; all p values >0.35). the domains of everyday living skills was essentially iden-
Table 4 summarizes the association between UPSA-B tical between samples in rural Sweden and New York City.
scores and independent living status for the Swedish and Case manager ratings of the ability of these patients to
U.S. patients. We used one-way analyses of variance function in terms of everyday living skills were also essen-
(ANOVAs), followed by Tukey post hoc tests within each tially identical for the two samples. The correlation be-
sample to examine the differences in UPSA-B scores asso- tween the different domains of the functional outcomes
ciated with the three levels of independent living. We construct—cognitive abilities, functional capacity, and
chose not to use a status-by-country ANOVA because of case manager ratings of real-world functioning—was es-
the very unbalanced cell sizes. For the Swedish patients, sentially identical in these two samples as well. Differ-
there was no statistically significant difference across the ences in performance on neuropsychological tests were
three residential status groups in UPSA-B scores. Given modest, and the correlations between neuropsychological
the lack of homogeneity of variance across the cells, we performance and measures of functional capacity and
used a nonparametric analysis, the Kruskal-Wallis H test. real-world outcomes were also essentially the same in the
The results of this analysis were also nonsignificant. When two countries. An additional important finding, which
the same ANOVA was performed in the U.S. sample, the renders the similarities in these multiple abilities even
results were statistically significant (F=4.94, df=2, 203, more important, is that there were substantial differences
p<0.002). The follow-up Tukey tests indicated that each of in residential outcomes between the two samples. These
the three groups was significantly (p<0.05) different from differences in residential outcomes, very likely based on
the groups immediately adjacent in terms of residential differences in social services systems, led to no association
status. There was essentially no difference in the UPSA-B between performance on structured tests designed to
scores of patients in the United States and Sweden who measure everyday living skills and residential outcomes in
were living in restricted housing environments. The main people with schizophrenia in Sweden.
differences in UPSA-B scores appear to be due to the asso- While there are essentially no differences in the ability to
ciation between residential outcomes and UPSA-B scores live independently (in terms of both functional capacity
in the U.S. patients, which resulted in the independently assessments and case manager ratings), outcomes appear
residing U.S. patients having the highest scores. markedly more favorable in the Swedish sample. There was
essentially no difference in UPSA-B performance scores
between U.S. and Swedish patients who lived in restricted
Discussion
settings, which suggests that the complete inability to live
The results of this study include several potentially im- independently may not be influenced by social service sys-
portant findings. The performance of people with schizo- tems. In contrast, there was a clear functional capacity per-

Am J Psychiatry 166:7, July 2009 ajp.psychiatryonline.org 825


MEASUREMENT OF FUNCTIONAL DISABILITY IN SCHIZOPHRENIA

formance gradient associated with residential outcomes in functional potential than aspects of real-world commu-
the U.S. sample. This finding is interesting given that inde- nity functioning (25, 26). Given that these data suggest
pendent living ability was the only one of the three do- negligible differences in the ability to perform everyday
mains of real-world functional milestones measured in this living skills in the assessment setting and marked differ-
study (social outcome, employment, and residential sta- ences in residential outcomes, it appears likely that resi-
tus) that was strongly associated with the presence of cog- dential outcomes, like employment outcomes, may be
nitive performance in the U.S. sample in our previous re- driven by factors other than ability. These findings also
port (8). Clearly these results do not necessarily apply suggest that changes in the ability to perform everyday liv-
across all countries and systems of care, and a comparison ing skills are a central feature of schizophrenia, much like
of rural and urban outcomes in either the United States or neurocognitive impairments. Although neuropsychologi-
Sweden could help to unconfound rural/urban living sta- cal and functional capacity abilities are correlated, much
tus and differences in national health care policies. as negative symptoms and neuropsychological deficits
Considerable evidence for the validity of the UPSA-B ac- are, they appear to be separable domains of functioning
crues from these findings, which suggests that this instru- that should be considered independently of their corre-
ment measures some performance-based abilities that are lates. Previous research has shown that interventions that
consistent across substantial differences in culture. In or- modify level of social support lead to functional gains in
der to perform this study, the subtasks from this instru- people with schizophrenia (27). Research will need to con-
ment not only were translated into Swedish, but they also tinue to address the impact of social and cultural support
required modification of the stimuli in accordance with mechanisms on outcomes, and multinational treatment
differences in financial requirements and communication studies will need to carefully consider the potential impact
demands across the two countries. The results suggest of these differences in social support for individuals with
that this process may well be practical in other Western schizophrenia, both for the outcomes of treatment and for
cultures as well. Differences in neuropsychological perfor- the selection of potential study participants.
mance across the two countries were modest when cor-
rected for demographic factors. Received Jan. 22, 2009; revision received March 4, 2009; accepted
March 9, 2009 (doi: 10.1176/appi.ajp.2009.09010106). From Emory
These findings have several implications for improve- University School of Medicine, Atlanta; NU Health Care Hospital,
ments in real-world outcomes following cognitive-en- Trollhättan, Sweden; Karlstad University, Karlstad, Sweden; Queens
hancement or skills-development treatments. Equivalent University, Kingston, Ontario; and University of California San Diego
Medical Center, La Jolla, Calif. Address correspondence and reprint
improvements in ability lead to very different changes in requests to Dr. Harvey, Department of Psychiatry and Behavioral Sci-
real-world functional outcomes depending on other char- ences, Emory University School of Medicine, Woodruff Memorial
acteristics of the environment. As Rosenheck et a1. (12) Building, 101 Woodruff Circle, Suite 4000, Atlanta, GA 30322;
philip.harvey@emory.edu (e-mail).
demonstrated, employment outcomes in the United Dr. Harvey has received grant or contract support from AstraZen-
States are strongly associated with disability compensa- eca and Johnson & Johnson and has served as an adviser or consul-
tion, and this is particularly true for disability compensa- tant to AstraZeneca, Dainippon Sumitomo, Eli Lilly, Johnson &
Johnson, Novartis, Pfizer, Solvay-Wyeth Alliance, and Sanofi-Aventis.
tion that is linked to health insurance coverage. Other fac- Dr. Bowie has received grant support from Johnson & Johnson. All
tors are probably involved as well. The health care system other authors report no competing interests.
in Trollhättan is more generous with compensation than The data collection for this study was supported by NIMH grant
RO1 MH63116 to Dr. Harvey and an investigator-initiated grant from
U.S. health care systems, with disability compensation in
Janssen-Cilag Sweden to Dr. Helldin.
this part of Sweden at approximately US$1,000 per month.
Moreover, the cost of living is markedly lower in Trollhät-
tan (where a two-bedroom apartment costs approxi- References
mately US$650 per month) than in New York City and its
1. Velligan DI, Diamond P, Glahn DC, Ritch J, Maples N, Castillo D,
environs. Also, the local health authority provides disabled Miller AL: The reliability and validity of the Test of Adaptive Be-
schizophrenia patients with 93% of their monthly rent, up havior in Schizophrenia (TABS). Psychiatry Res 2007; 151:55–66
to US$800 per month. The requirements associated with 2. Bellack AS, Sayers M, Mueser KT, Bennett M: An evaluation of
finding and paying for an apartment in the New York City social problem solving in schizophrenia. J Abnorm Psychol
metropolitan area are daunting for healthy individuals 1994; 103:371–378
3. Keefe RSE, Poe M, Walker TM, Kang JW, Harvey PD: The Schizo-
and much more challenging for individuals with disabling
phrenia Cognition Rating Scale: an interview-based assessment
psychiatric symptoms and chronic unemployment. These and its relationship to cognition, real-world functioning, and
differences in social support for people with mental illness functional capacity. Am J Psychiatry 2006; 163:426–432
have a clear and strong signal in terms of real-world func- 4. McKibbin C, Patterson TL, Jeste DV: Assessing disability in older
tional outcomes. In contrast, other social and vocational patients with schizophrenia: results from the WHODAS-II. J
milestones appear to occur with similar frequency in the Nerv Ment Dis 2004; 192:405–413
5. Bowie CR, Reichenberg A, Patterson TL, Heaton RK, Harvey PD:
two countries.
Determinants of real-world functional performance in schizo-
These data are consistent with the notion that ability- phrenia subjects: correlations with cognition, functional capac-
based measures may give a less confounded signal of ity, and symptoms. Am J Psychiatry 2006; 163:418–425

826 ajp.psychiatryonline.org Am J Psychiatry 166:7, July 2009


HARVEY, HELLDIN, BOWIE, ET AL.

6. Twamley EW, Doshi RR, Nayak GV, Palmer BW, Golshan S, 17. Mausbach BT, Harvey PD, Goldman SR, Jeste DV, Patterson TL:
Heaton RK, Patterson TL, Jeste DV: Generalized cognitive im- Development of a brief scale of everyday functioning in per-
pairments, ability to perform everyday tasks, and level of inde- sons with serious mental illness. Schizophr Bull 2007; 33:
pendence in community living situations of older patients with 1364–1372
psychosis. Am J Psychiatry 2002; 159:2013–2020 18. Schneider LC, Struening EL: SLOF: a behavioral rating scale for
7. Green MF, Nuechterlein KH, Kern RS, Baade LE, Fenton WS, assessing the mentally ill. Soc Work Res Abstr 1983; 19:9–21
Gold JM, Keefe RS, Mesholam-Gately R, Seidman LJ, Stover E,
19. Andreasen NC, Flaum M, Arndt S: The Comprehensive Assess-
Marder SR: Functional co-primary measures for clinical trials in
ment of Symptoms and History (CASH): an instrument for as-
schizophrenia: results from the MATRICS Psychometric and
sessing psychopathology and diagnosis. Arch Gen Psychiatry
Standardization Study. Am J Psychiatry 2008; 165:221–228
1992; 49:615–623
8. Leung WW, Bowie CR, Harvey PD: Functional implications of
20. Patterson TL, Goldman S, McKibbin CL, Hughs T, Jeste DV: UCSD
neuropsychological normality and symptom remission in
Performance-Based Skills Assessment: development of a new
older outpatients diagnosed with schizophrenia: a cross-sec-
measure of everyday functioning for severely mentally ill
tional study. J Int Neuropsychol Soc 2008; 14:479–488
adults. Schizophr Bull 2001; 27:235–245
9. Bowie CR, Leung WW, Reichenberg A, McClure MM, Patterson
TL, Heaton RK, Harvey PD: Predicting schizophrenia patients’ 21. Harvey PD, Keefe RS, Patterson TL, Heaton RK, Bowie CR: Ab-
real-world behavior with specific neuropsychological and func- breviated neuropsychological assessment in schizophrenia:
tional capacity measures. Biol Psychiatry 2008; 63:505–511 prediction of different aspects of outcome. J Clin Exp Neuro-
10. Mohamed S, Rosenheck R, Swartz M, Stroup S, Lieberman JA, psychol 2009; 31:462–471
Keefe RSE: Relationship of cognition and psychopathology to 22. Reitan RM, Wolfson D: The Halstead-Reitan Neuropsychologi-
functional impairment in schizophrenia. Am J Psychiatry 2008; cal Test Battery: Theory and Clinical Interpretation, 2nd ed.
165:978–987 Tucson, Ariz, Neuropsychology Press, 1993
11. Pinkham AE, Penn DL: Neurocognitive and social cognitive pre- 23. Spreen O, Strauss E: Compendium of Neuropsychological Tests
dictors of interpersonal skill in schizophrenia. Psychiatry Res and Norms, 2nd ed. New York, Oxford University Press, 1998
2006; 143:167–178
24. Heaton RK, Chellune CJ, Talley JL, Kay GG, Curtiss G: Wisconsin
12. Rosenheck R, Leslie D, Keefe R, McEvoy J, Swartz M, Perkins D,
Card Sorting Test Manual, revised and expanded. Odessa, Fla,
Stroup S, Hsiao JK, Lieberman J, CATIE Study Investigators
Psychological Assessment Resources, 1993
Group: Barriers to employment for people with schizophrenia.
25. Bellack AS, Green MF, Cook JA, Fenton W, Harvey PD, Heaton
Am J Psychiatry 2006; 163:411–417
RK, Laughren T, Leon AC, Mayo DJ, Patrick DL, Patterson TL,
13. Rosenheck RA, Frisman LK, Sindelar J: Disability compensation
Rose A, Stover E, Wykes T: Assessment of community function-
and work: a comparison of veterans with psychiatric and non-
ing in people with schizophrenia and other severe mental ill-
psychiatric impairments. Pychiatr Serv 1995; 46:359–365
ness: a white paper based on an NIMH-sponsored workshop.
14. World Health Organization: International Pilot Study of Schizo-
Schizophr Bull 2007; 33:805–822
phrenia. Geneva, WHO, 1973
15. Harvey PD, Artiola i Fortuny L, Vester-Blockland E, De Smedt G: 26. Harvey PD, Velligan DI, Bellack AS: Performance-based mea-
Cross-national cognitive assessment in schizophrenia clinical sures of functional skills: usefulness in clinical treatment stud-
trials: a feasibility study. Schizophr Res 2003; 59:243–251 ies. Schizophr Bull 2007; 33:1138–1148
16. Harvey PD, Leff J, Trieman N, Anderson J, Davidson M: Cogni- 27. Velligan DI, Diamond PM, Maples NJ, Mintz J, Li X, Glahn DC,
tive impairment in geriatric chronic schizophrenic patients: a Miller AL: Comparing the efficacy of interventions that use en-
cross-national study in New York and London. Int J Geriatr Psy- vironmental supports to improve outcomes in patients with
chiatry 1997; 12:1001–1007 schizophrenia. Schizophr Res 2008; 102:312–319

Am J Psychiatry 166:7, July 2009 ajp.psychiatryonline.org 827

You might also like