You are on page 1of 5

Accuracy of Self-Reported Disability

in Patients With Parkinsonism


Richard G. Brown, MPhil; Brigid MacCarthy, MSc; Marjan Jahanshahi, MPhil; C. David Marsden, DSc

\s=b\ For the patient, the most important motor symptoms. For the patient, with their level of depression,2·4 al¬
aspect of parkinsonism is the degree to however, the significance of the symp¬ though there have been exceptions.5·6
which the disease interferes with daily liv- toms does not lie in the amplitude of While it may be that the depression is
ing. The patient's self-report may be the the tremor or the speed of foot tapping. a reaction to the disability, it is also
only way in which such information can be Rather, it is the degree to which the possible that depression may bias the
obtained. Depression and cognitive im- motor symptoms and other aspects of patient's self-report, so that the more
pairment, however, may influence that the disease interfere with his or her depressed patients perceive them¬
self-report. In the present study, three ability to lead a normal life. Conse¬ selves as being more disabled than
ratings of disability, from the patient, a quently, the goal of clinical manage¬ they really are. Depression, therefore,
relative, and an independent observer, ment, or the development of new treat¬ may introduce a systematic bias into
showed high levels of agreement. The pa- ments, should be aimed at decreasing self-report. In addition, depression it¬
tients' cognitive function made a small but the level of disability. self may make an independent contri¬
significant contribution to the accuracy of The main methods of assessment of bution to the patient's overall level of
their self-report judged against the rela- disability are observation in natural or functional disability. Second, marked
tive's rating. Depression, however, played seminatural settings, interview, and cognitive impairment is found in some
no role. Agreement between patients and questionnaire. In many instances, both cases. While estimates vary,7 recent
relatives for individual items on the dis- clinical and research, questionnaires studies suggest that clinically signifi¬
ability questionnaire was reasonably high. provide the only practical or cost- cant impairment may be found in ap¬
The results suggest that patients with par- effective method of gathering informa¬ proximately 10% of patients with Par¬
kinsonism can provide accurate self-re- tion. Kivela1 addressed the question of kinson's disease.811 Taking the whole
port of their level of disability, even in the the validity of such self-report. He as¬ parkinsonian population, however, the
presence of depression and cognitive im- sessed 218 patients with a variety of figure may be higher. The relevance of
pairment. medical disorders. Subjects completed dementia to the present issue is that
(Arch Neurol. 1989;46:955-959) a questionnaire covering aspects of cognitive impairment in a patient may
self-care and domestic activities. They interfere with the reliability of his or
were also assessed by a health-care her self-report. It is unclear whether
rPhe clinical picture of parkinsonism professional on a set of six activities. there would be a systematic bias, or
is dominated by akinesia, tremor, Employing a four-point scale, agree¬ simply increased variability in the ac¬
ment between the patients and the curacy of the ratings.
rigidity, and postural abnormality. Be¬ professional of 97% was obtained for The aim of the present study was to
cause of this, clinical assessment of assess the accuracy of self-reported
dressing and 84% for bathing. For
patients with parkinsonism is heavily more general types of activity such as disability in a group of patients with
weighted to obtaining indexes of these cooking and cleaning, agreement was parkinsonism by comparing their rat¬
lower (77% and 64% ) even when using ings with those of a care giver and of
Accepted for publication February 6,1989. a dichotomous scale. The suggestion is, an independent observer. Further¬
From the University Department of Neurology however, that for specific activities
and Parkinson's Disease Society Research Centre more, the study aimed to explore the
(Mr Brown) and the Medical Research Council self-report can provide a valid index of possible influence of depression and
Social Psychiatry Research Unit (Ms MacCarthy), disability. cognitive impairment on self-report.
Institute of Psychiatry; and the Department of Can this finding be generalized to
Clinical Neurology, Institute of Neurology (Ms PATIENTS AND METHODS
Jahanshahi and Dr Marsden), London, England.
patients with Parkinson's disease? Sample
Reprint requests to MRC Human Movement
Caution is necessary for two reasons.
and Balance Unit, National Hospital, Queen First, the level of disability reported Sixty-six patients took part in this study,
Square, London WC1N 3BG, England (Mr Brown). by patients is significantly associated drawn from two sources. The patients com-

Downloaded From: http://archneur.jamanetwork.com/ by a Oakland University User on 06/10/2015


posing group 1 were assessed as part of a
study of psychosocial function in patients Table 1.—Activities of Daily Living Scale: Item Analysis of Agreement/Disagreement
with parkinsonism and their care givers. Between Patient and Relative Ratings (N =
66)
Forty patients were selected from a sample %Complete % Agreement
of 132 described previously.4 Selection was
based on two criteria: first, that the patient
Item Agreement (Weighted)
Gross mobility
lived with another person, usually a spouse,
who could act as an informant, and second, Getting out of bed_70_92_.67
that the patient lived within a 50-mile Getting out of chair 64 91 .65
radius. All 40 patients were visited in their Walking around home 68 89 .55
own homes, where they were assessed. Walking outside, eg, to shops 64 90 .74
Three of the patients and/or their care giv¬ Traveling by public transport 57 85 .66
ers failed to complete the disability ques¬ Walking up stairs 70 91 .59
tionnaires (see below). These patients will Walking downstairs 62 88 .49
not be considered further in the present re¬ Getting into bath 54 86 .59
port. In addition, one caregiver failed to Getting out of bath_58_88_.62
complete the Beck Depression Inventory Getting undressed 56 86 .50
(BDI). Results on care givers BDI are, Picking up object from floor 41 80 .28
therefore, based on 64. Fine coordination
The remaining group of 37 patients com¬
Brushing teeth 62 62 .53
prised 23 men and 14 women, with a mean
( ± SD) age of 65.1 ± 9.6 years. Mean ap¬ Washing_68_9i_.57
proximate duration of illness was 10.9 ± 5.4 Opening tins 58 84 .60

years, with a range from 3 to 26 years. Pouring milk from bottle 66 90 .63
Twelve of the patients were in Hoehn and Making cup of tea 71 92 .73
Yahr12 stage II, 20 in stage III, 3 in stage IV, Holding cup and saucer 57 87 .54
and 2 in stage V. All were taking antipar- Washing and drying dishes 59 87 .55
kinsonian medication at the time of assess¬ Using knife and fork 47 84 .51
ment. Inserting electrical plug 71 92 .73
The second group of patients were par¬ Dialing telephone 57 87 .54
ticipants in a study of sexual function in Holding and reading newspaper 59 87 .55
patients with parkinsonism and their Writing letter 47 84 .51
spouses carried out by us. Twenty-nine pa¬
tients and their spouses completed disabil¬ Getting dressed 56 86 .51
Means
ity questionnaires. The patient group com¬ Total scale 60 87 .58
prised 20 men and 9 women, with a mean Gross movements 60 88 .58
age of 50.4 ± 9.3 years. Mean approximate
duration of illness was 10.5 ± 4.3 years, Fine movements 59 86 .58
with a range from 3 to 19 years. Hoehn and
Yahr ratings were not available for these
patients. All were taking antiparkinsonian pour liquid from one container to another, was not significant (i 0.79, df= 64,
=

medication. and hold a cup and saucer. Each item was .43). The mean of the total sample
=

Assessment Measures rated in the same way as the ADL ques¬ was 48.5 ± 21.8. This was comparable
tionnaire. Subjects from group 1 were also with the score obtained by the larger
All patients completed an Activities of assessed for the severity of their tremor,
Daily Living (ADL) questionnaire. This rigidity, akinesia, and postural abnormal¬ sample in the earlier study (48.5
questionnaire was the same as that em¬ ± 18.7).4 The mean ADL score re¬
ployed in two earlier studies.34 It contains ity, employing the King's College Hospital
24 items covering a range of activities (KCH) Parkinson's disease rating scale.13 ported by the relatives was slightly
(Table 1). A five-point scale was used for Depression was assessed in patients and higher than that reported by the pa¬
their relatives using the BDI.14 One patient tients themselves, both for relatives in
each item ranging from "able to perform
task alone and without difficulty" to
in group 2 failed to complete the BDI. In group 1 (49.6 ± 20.5) and relatives in
"unable to perform task." A high score in¬ addition, the patients in group 1 were ad¬ group 2 (52.5 ± 22.5). The relatives'
ministered the Folstein et al15 Mini-Mental ratings for the two groups did not
dicated greater disability. A total score was State Examination (MMS).
computed (range, 24 to 120), together with differ significantly (t 0.56, df= 64,
=

two subscores. These were derived by split¬ .58). The mean for the total sample
=

ting the scale into two factors correspond¬ RESULTS was 50.9 ± 21.3. Comparing the pa¬
ing roughly to "gross mobility" and "fine tients' and relatives' ratings for the
coordination." The subscales were derived Patients in group 1 were signifi¬ combined sample revealed that the
from a principal components analysis re¬
ported previously.4 Each patient was asked cantly older than those in group 2 relatives' tendency to rate disability
to fill out the questionnaire according to (t 6.2, df= 64, < .001). They also
=
higher than the patients approached
how well he or she would be able to perform had a later approximate age at onset of significance (t =
1.81, d/=65, =
.08).
each activity "in general" and without the their parkinsonism (t 5.3, df= 64,= The BDI score of the patients
mean
use of any special aids. Each relative was < .001). The mean duration of illness in group 1 was 13.2 ± 8.8, and 15.4 ± 7.9
also asked to give his or her independent in the two groups, however, did not for those in group 2. The difference be¬
judgment of the patient's level of ability for differ (t =0.37, df= 64, .71). The
=
tween the groups not significant
was
each task on the ADL questionnaire. mean age of the total sample was 58.6 (i =
1.06, df= 63, .28). The mean
=

In addition to the questionnaire mea¬ ± 11.9 years, and the mean approxi¬ BDI score for the combined sample
sures, patients in group 1 were asked to mate age at onset of the disease was
perform a range of activities to be rated by (14.2 ± 8.4) was similar to that re¬
48.9 ± 12.8 years. Mean duration of ported previously4 (13.9 ± 7.3). Eigh¬
an observer (R.G.B.). These were as follows:
get up from a chair, walk and turn, walk up illness was 10.7 ± 4.9 years. teen patients (27% ) had a BDI score of
and down stairs, fasten buttons, hold and The mean score for the patient-rated 18 or more. The mean for the relatives
turn the pages of a large newspaper, bend ADL was 46.6 ± 21.5 for group 1 and in group 1 was 11.4 ± 9.7, and 10.1
down and insert an electric plug in a socket, 50.9 ± 22.3 for group 2. This difference ± 7.5 for those in group 2. The differ-

Downloaded From: http://archneur.jamanetwork.com/ by a Oakland University User on 06/10/2015


Table 2.—Pearson Correlations Between Indexes of Disability, Depression, and
patient-rated ADL score was taken as
the dependent variable. Independent
Cognitive Function* variables considered were the relative-
Relative's Observer's Symptom Patient's Relative's rated ADL, patient's BDI and MMS
ADL ADL Severity BDI BDI MMS scores, and relative's BDI scores. This
Patient's ADL .59 .34 .37 latter variable was included to assess
Relative's ADL .82 .60 .39 .44 -.34 whether a depressed relative was bi¬
Observer's ADL .29 .25 (NS) -.50 ased in his or her report of the pa¬
Symptom severity .01 (NS) .17 (NS) -.35 tient's disability, in the same way as
Patient's BDI .33 -.27 (NS) the patients themselves might be.
Relative's BDI (NS)
.20 First, the independent variables
*
ADL indicates Activities of Daily Living questionnaire score; BDI, Beck Depression Inventory score; and MMS, were entered in one step into the re¬
Mini-Mental State score. All correlations are significant (P < .05) except for those marked NS (not significant).
64 to 65. except for correlations Involving observer's ADL, symptom severity, and MMS,
gression equation. This gave a multiple
For all correlations, ~
R of .89 (adjusted R2 .77, F 27.78,
= =

where =
37.
P<.0001). Together, therefore, this
set of variables gives a very good pre¬
enee between the groups was not sig¬ the symptoms of tremor, rigidity, aki- diction of patient-rated ADL. The next
nificant (i 0.60, df= 63,
=
.55). The
=
nesia, and postural abnormality is not stage was to perform a stepwise anal¬
mean for the combined sample was necessarily a good indicator of disabil¬ ysis in which the independent vari¬
10.9 ± 8.8. This figure is considerably ity, at least as rated by the patient. In ables were entered one at a time in the
higher than that obtained by Gotham contrast, the observer-rated disability order determined by their association
et al3 for a sample of normal elderly and KCH symptom severity scores with the dependent variable. The first
(6.4 ± 5.8). Ten relatives (17.2% ) had a were strongly correlated (r .84). This =
variable to enter the equation was the
BDI score of 18 or more. may be partly due to the fact that both relative-rated ADL. This gave a mul¬
The mean MMS score for the pa¬ ratings were made by the same indi¬ tiple R of .87 (adjusted R2 .74, =

tients in group 1 was 31.7 ± 3.2. Eight vidual. A more important reason may F 96.8, < .0001). The relative rat¬
=

patients achieved a score of less than be that both ratings were made on the ing, therefore, gave almost as good a
30 of a maximum of 35, with three of patient at the same point in time, prediction of the patient's disability as
these scoring less than 25. whereas the patient's and relative's the whole set of independent variables
As a first step to assessing the agree¬ ADL ratings were based on more gen¬ together. Examining the partial cor¬
ment between the patient's and the eral levels of disability. In particular, relation of the remaining variables
relative's ADL ratings, standardized general ratings made by patients who with patient-rated ADL, after ac¬
difference scores were obtained and experience a wide variation in disabil¬ counting for the relative's rating, re¬
the distribution examined. Thirty- ity throughout the day may not reflect vealed a significant assocation of —.49
eight cases (58% ) were within ± 0.5 SD their performance either at their best for MMS score (P < .01). In contrast,
of complete agreement. One case, how¬ or at their worst. In these cases, two neither the patient's BDI (partial
ever, was revealed as an outlier, the separate self-ratings may provide the r =
.05, .78) nor the relative's BDI
=

patient rating his level of disability as most useful information. (partial r .03,
=
.89) was signifi¬
=

far greater than the relative (z 4.1). = As found in previous studies,3·4 the cantly associated with the patient-
This case was eliminated from the patient's level of depression as mea¬ rated ADL. These findings were re¬
subsequent analyses. sured by the BDI was significantly flected in the next stage of the regres¬
Table 2 gives the zero-order Pearson correlated with the overall level of sion analysis in which the MMS was
correlation coefficients for the various self-rated disability (r .34). The BDI=
entered, making a significant contri¬
measures of disability, symptom se¬ scores of the patients were also associ¬ bution to the regression equation
verity, depression, and cognitive func¬ ated with the relative-rated ADL (multiple R .89, adjusted R2 .78, R2
= =

tion. Correlations involving MMS (r .37). The correlation with observ¬


=
change .05, F change 8.07, <
= =

score, symptom severity, and observ¬ er-rated disability was lower, al¬ .01). Neither BDI score made any sig¬
er-rated disability are based on sub¬ though still significant (r .29). In = nificant contribution to the regression
jects from group 1. In terms of the pa¬ contrast, the patient's BDI score was equation.
tient's self-reported disability, the unrelated to the KCH symptom sever¬ To summarize, the relative's rating
most meaningful direct association is ity score (r =
—.01). of disability was the best single pre¬
between the patient-rated and rela¬ Scores on the MMS were signifi¬ dictor of the patient's own rating, ac¬
tive-rated ADL. The correlation of .91 cantly associated with the patient's counting for 83% of the variance in the
for the total score suggests a high de¬ level of self-rated disability (r -.48), = total sample and 74% in group 1. In
gree of overall agreement between the with high levels of disability associ¬ addition, however, the patient's level
two sets of ratings. The figures were ated with lower levels of cognitive of cognitive function as measured by
equally high for the subscale scores for function. The association was not lim¬ the MMS explained an additional 4%
"gross" (r .90) and "fine" movements
= ited to the patient's self-report. The of the variance. In contrast, neither
(r .87). The association between the
= MMS scores were also significantly re¬ the relative's nor the patient's levels of
observer rating and patient rating for lated to the relative-rated ADL depression, as measured by the BDI,
group 1 was .84. In contrast to these (r —.34) and the observer ratings of
= added significantly to the regression
high correlations between patient self- disability (r =-.50), as well as the rat¬ equation. To explore the contribution
report and independent measures of ings of symptom severity (r —.35). = of cognitive function, the MMS scores
disability, the patient's rating of dis¬ To explore the contributions of the were correlated with the difference
ability was less strongly associated patients' BDI and MMS scores to their between the patients' and relatives'
with the parkinsonian symptom sever¬ self-report of disability, a multiple re¬ ADL ratings. The direction of the as¬
ity score (KCH scale; r .59). The im¬
=
gression analysis was performed, us¬ sociation (r .35,=
< .05) suggested
plication is that a measure based on ing the data from group 1, in which the that the more cognitively impaired the

Downloaded From: http://archneur.jamanetwork.com/ by a Oakland University User on 06/10/2015


patient was, the more he or she tended more marked categories of impair¬ introduces no systematic bias.
to underestimate his or her level of ment where the patient's difficulty was A distinction was drawn, in the in¬
disability compared with his or her obvious or assistance was required, the troduction, between disability and
relative, or alternatively, the more the relative's rating was more likely to be symptom severity. The results from
relative tended to overestimate the in accordance with the patient's. the present study revealed that the two
patient's level of disability. The lowest value of was .28 (picking factors were only moderately corre¬
So far, the analysis has been con¬ up an object from the floor). This item lated. More surprising was the dra¬
cerned with global indexes of disabil¬ was exceptional, however, and all matic difference in the relationship
ity. The next question to be addressed other values were .49 or greater. between the two factors and the pa¬
was the "accuracy" of the patient's There are no rigid rules for interpret¬ tient's level of depression as measured
self-report (as judged against the rel¬ ing values. Landis and Koch18 suggest by the BDI. While depression was sig¬
ative's assessment) for individual that values in the range .4 to .6 are nificantly associated with disability,
items on the ADL scale. The statistic of "moderate," .6 to .8 "substantial,"and whoever rated the disability, there was
choice in such an instance is the .8 to 1.0 "almost perfect." With the ex¬ no association with symptom severity.
weighted .16 This is based on the ception of the single low value, all of If depression is taken as one index of
agreement between the two raters be¬ the values were in the range from the impact of the disease on the suf¬
yond that which would be expected by moderate to substantial. ferer, then it is clear that the severity
chance. In addition, it allows credit for Finally, the analysis conducted of the motor symptoms alone is of lit¬
partial rater agreement. With a five- gave an indication of "bias" for each tle importance. Rather, it is the impact
point continuous ordinal rating scale item. This indicated whether there that these symptoms, and other fac¬
as used with the ADL questionnaire, was a tendency for one set of raters tors, have on the patient's ability to
linear weights were used as recom¬ (patients or relatives) to give consis¬ lead a normal life that contributes
mended by Cicchetti." Complete tently higher ratings than the other most to his or her mood. This rein¬
agreement was given a weighting of 1, set. For the large majority of items, forces the point made in the introduc¬
ratings one scale point apart a rating the relatives tended to rate higher tion, that treatment should be focused
of 0.75, those two scale points apart a than the patients. For only three on lessening the disability, not the
weighting of 0.5, three scale points a items, however, was the bias signifi¬ motor symptoms. The results from the
weighting of 0.25, and complete dis¬ cant: traveling by public transport present study suggest that patients'
agreement (four scale point differ¬ (2 6.0, df= 1, < .05), getting un¬
=
self-ratings can provide accurate mea¬
ence) a weighting of 0. Chance agree¬ dressed ( 2 6.8, df= 1,P< .01), and
= sures of that disability.
ment was also calculated using the opening tins ( 2 10.3, df=l,P< .01).
= The distinction between disability
same weighting procedure. Table 1 and symptom severity may also be im¬
COMMENT
gives various statistics. First, there is portant methodologically in obtaining
the percentage of cases in which there The main finding of the present self-report data. In a recent study,
was complete agreement between the study was that patients with Parkin¬ Golbe and Pae19 assessed the validity
patient's and relative's ratings for son's disease can provide accurate of physical self-assessment in Parkin¬
each given item. Next, there is the judgments of their disability. The son's disease. Patients were asked to
percentage agreement based on the analyses showed this to be true for a ratethemselves, on a four-point scale,
weighting procedure described above. total disability score, for subscales, for speed of finger tapping, gait,
Finally, there is the statistic for each and for individual items. In the latter tremor, and chorea. These same phys¬
item. instance, however, it was clear that ical features were rated independently
Complete agreement varied from there may be a small margin of dis¬ by a neurologist. Agreement between
41% (picking up an object from the agreement between the ratings of the the two sets of ratings, however, was
floor) to 71% (making a cup of tea, and patient and the relative, particularly low, with patients tending to rate
inserting and removing an electrical for instances of mild impairment. In higher. The values were low and
plug). The average was 60% for the such instances, the patient's rating ranged from .12 (finger-tapping) to .35
whole scale. There was no difference should be taken to be more accurate. (tremor). The authors concluded that
between agreement for "gross" actions In the introduction, depression and quantitative self-assessment of the
(60%) and "fine" movements (59%). cognitive impairment were proposed physical signs of the disease has poor
The percentages after weighting for as factors that might influence this ac¬ validity in Parkinson's disease, at least
partial agreement were, of course, curacy. The pattern of correlations re¬ with the measures they employed. An
higher. The pattern, however, was es¬ vealed that both variables were signif¬ important difference exists, however,
sentially the same as that for absolute icantly associated with the patient's between their study and the present
agreement. The dramatic increase in self-reported level of disability. How¬ one. The Golbe and Pae19 patients were
percentage agreement after weighting ever, only cognitive function made any asked to rate clinical features of the
suggests that the majority of disagree¬ independent contribution to the pre¬ disease, while in the present study the
ments were by one or at most two scale diction of the patient's self-report once behaviors being rated were everyday
points. Examining the data revealed the relative's rating of disability was activities. It is plausible to assume
that the majority of such disagree¬ taken into account. Even then, the that the latter are more meaningful to
ments occurred between ratings of 1 contribution was small. The implica¬ the patient and, therefore, easier to
("can perform alone without diffi¬ tion is that the best single index of rate. As an illustration, the patient is
culty") and 2 ("can perform alone with disability is the patient's own judg¬ likely to be able to give a good indica¬
a little effort"). It was, presumably, ment of it. In the presence of cognitive tion of how well he or she can walk
difficult for the relative to distinguish impairment, it is possible that the pa¬ without necessarily being able to rate
between these two ratings. It may be, tient's judgment may be a slight un¬ the severity of gait disturbance. Simi¬
therefore, that the relative's ratings derestimate. Depression, however, larly, a self-rating of the ease with
were less accurate than those of the seems to have little impact on the ac¬ which the patient can drink from a cup
patient in these instances. For the curacy of the self-report and certainly and saucer is likely to be more valid

Downloaded From: http://archneur.jamanetwork.com/ by a Oakland University User on 06/10/2015


than a self-rating of tremor. patient's level of disability. Several however, that the study demonstrates
Finally, it should be noted that the areas of functioning were omitted. a general point about the accuracy of
ADL scale employed in this and previ¬ Rather, the scale was intended to pro¬ self-reported disability in patients
ous studies was not intended to provide vide a brief, global rating of disability with parkinsonism.
a complete clinical assessment of the for research purposes. It is hoped,

References

1. Kivela SL. Measuring disability: do self-rat- 8. Taylor AE, Saint-Cyr JA, Lang AE. Demen- 14. Beck AT, Beamesderfer A. Assessment of
ings and service provider ratings compare? J tia prevalence in Parkinson's disease. Lancet. depression: the depression inventory. In: Pichot P,
Chronic Dis. 1984;37:115-123. 1985;1:1037. ed. Psychological Measurements in Psychophar-
2. Lieberman A, Dziatolowski M, Coopersmith 9. Mayeux R, Stern Y, Rosenstein R, et al. An macology. Paris, France: Kagel-Basel; 1974:7.
M, et al. Depression, intellectual impairment and estimate of the prevalence of dementia in idio- 15. Folstein MF, Folstein SE, McHugh PR.
Parkinson's disease. Neurology. 1981;31:645-650. pathic Parkinson's disease. Arch Neurol. 1988; 'Mini-Mental State': a practical method for grad-
3. Gotham AM, Brown RG, Marsden CD. De- 45:260-262. ing the mental state of patients for the clinician.
pression in Parkinson's disease: a quantitative 10. Mutch WJ, Dingwall-Fordyce I, Downie J Psychiatr Res. 1975;12:189-198.
and qualitative analysis. J Neurol Neurosurg AW, Paterson JG, Roy SK. Parkinson's disease in 16. Cohen J. Weighted kappa: nominal scale
Psychiatry. 1986;49:381-389. a Scottish city. Br Med J. 1986;292:534-536. agreement with provision for scaled disagree-
4. Brown RG, MacCarthy B, Gotham AM, Der 11. Oyebode JR, Barker WA, Blessed G, Dick ment or partial credit. Psychol Bull. 1968;70:213\x=req-\
GJ, Marsden CD. Depression and disability in DJ, Britton PG. Cognitive functioning in Parkin- 220.
Parkinson's disease: a follow-up of 132 cases. son's disease: in relation to prevalence of demen- 17. Cicchetti DV. Assessing inter-rater reli-
Psychol Med. 1988;18:49-55. tia and psychiatric diagnosis. Br J Psychiatry. ability for rating scales: resolving some basic is-
5. Robins AH. Depression in patients with 1986; 149:720-725. sues. Br J Psychiatry. 1976;129:452-456.
parkinsonism. Br J Psychiatry. 1976;128:141-145. 12. Hoehn MM, Yahr MD. Parkinson's disease: 18. Landis JR, Koch GG. Measurement of ob-
6. Mayeux R, William JBW, Stern Y, Cote L. onset, progression and mortality. Neurology. server agreement for categorical data. Biometri-
Depression in Parkinson's disease. Adv Neurol. 1967;7:427-442. ca. 1977;33:159-174.
1984;40:241-250. 13. Parkes JD, Zilkha KJ, Calver DM, Knill-$ Validity of a mailed epide-
19. Golbe LI, Pae J.
7. Brown RG, Marsden CD. How common is Jones RP. Controlled trial of amantadine hydro- miological questionnaire and physical self-as-
dementia in Parkinson's disease? Lancet. 1984; chloride in Parkinson's disease. Lancet. 1970; sessment in Parkinson's disease. Movement Dis-
2:1262-1265. 1:259-262. ord. 1988;3:245-254.

Downloaded From: http://archneur.jamanetwork.com/ by a Oakland University User on 06/10/2015

You might also like