Professional Documents
Culture Documents
Reznek 2005
Reznek 2005
REVIEW
L. REZNEK
Abstract
Background: The Rey 15-Item Memory Test (RMT) is frequently used to detect malingering. Many objections to the test
have been raised. Nevertheless, the test is still widely used.
Objective: To provide a meta-analysis of the available studies using the RMT and provide an overall assessment of the
sensitivity and specificity of the test, based on the cumulative data.
Results: The results show that, excluding patients with mental retardation, the RMT has a low sensitivity but an excellent
specificity.
Conclusions: These results provide the basis for the ongoing use of the test, given that it is acceptable to miss some cases of
For personal use only.
malingering with such a screening test, but one does not want to have many false positives.
Correspondence: L. Resnek, MD, University of Toronto-Sunnybrook and Women’s Health Sciences Centre, 2075 Bayview Ave., Toronto, Ontario MN4 3M5,
Canada. E-mail: ashaki.adonis@sw.ca
ISSN 0269–9052 print/ISSN 1362–301X online # 2005 Taylor & Francis Group Ltd
DOI: 10.1080/02699050400005242
540 L. Reznek
using a cut-off of nine items was able to exclude the They found that IQ accounted for 37% of the
vast majority of the cases with brain damage from variance in scores. Those patients with psychiatric
being classified as malingerers. A score of eight or disorder and a low IQ not uncommonly scored
less was recommended in identifying individuals below the cut-off score of nine previously suggested.
exaggerating memory difficulties. Their results gave This demonstrated that, for those patients with
the RMT a specificity of 94%. psychiatric disorder and mental retardation, the
Schretlen et al. [5] compared subjects who were RMT was not very specific and identifies many
instructed to malinger amnesia with patients from non-malingerers as malingerers. This is consistent
several clinical groups (for example, those with with the original findings of Goldberg and Miller
brain damage, severe psychiatric disorders and [3]. Excluding those patients with psychiatric dis-
dementia). Using the cut-off of nine (recall of eight order and mental retardation (that is, who had an
or less items), these investigators found that the IQ less than 70), the RMT had a specificity of 85%.
RMT has a sensitivity of 12% and a specificity of Simon [11] tested the RMT by comparing 14
73%. diagnosed malingerers with 14 forensic in-patients
Lee et al. [6] tested the utility of the RMT using who had been acquitted by reason of insanity. He
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14
a group of patients with neurological disorders found that a cut-off of nine was useful in identifying
(suffering from temporal lobe epilepsy). They 86% of the malingerers. That is, remembering more
found that a cut-off of nine was too demanding for than eight items excluded 86% of the non-malinger-
this group of patients and generated an unacceptably ing group and included 86% of the malingering
low specificity, identifying many of the patients group as malingerers.
with neurological disorders as malingerers. They Lee et al. [12] used the RMT to assess the cogni-
proposed instead a cut-off of eight as a better tive performance of 64 older patients with major
standard—scores of seven or less gave the RMT depression. They found that the cut-off of nine
a specificity of 96%. That is, it classified 96% of gave the RMT a specificity of over 95%.
With all these results, some conflicting, there is a
For personal use only.
Table I. Specificity.
Ratio of Ratio of
not malingering not malingering
Study Subjects at cut-off <9 at cut-off <8
Goldberg and Miller [3] Subjects with psychiatric disorder 50/50 50/50
Goldberg and Miller [3] Subjects with mental retardation 10/16 ?
Bernard and Fowler [4] Normal subjects 16/16 16/16
Bernard and Fowler [4] Subjects with brain damage 18/18 18/18
Simon [11] Mentally ill forensic cases 12/14 ?
Taylor et al. [8] Subjects with severe brain damage 5/5 5/5
Schretlen et al. [5] Normal 80/80 80/80
Schretlen et al. [5] Subjects with brain injury 55/55 55/55
Schretlen et al. [5] Subjects with severe psychiatric disorder 40/40 40/40
Schretlen et al. [5] Subjects with mixed dementia 8/9 9/9
Schretlen et al. [5] Subjects with neuropsychiatric disorder 26/34 34/34
Schretlen et al. [5] Subjects with amnesia 8/10 10/10
Lee et al. [6] TLE 93/100 96/100
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14
Ratio of Ratio of
not malingering not malingering
Study Subjects at cut-off <9 at cut-off <8
identified as such. This gives the RMT an enhanced who were not malingering were identified as such.
specificity of 92%. Using the same cut-off of seven or This gives the RMT a specificity of over 95% (see
less items recalled, 11 out of 120 malingerers were Tables I and II).
identified as such. This gives the RMT a sensitivity
of 9% (see Tables I and II).
Discussion
Excluding those patients with mental retardation
and using the cut-off of nine, 803 out of 893 patients The specificity of a test is defined as the capacity
who were not malingering were identified as such. of that test to identify only those patients that the
This gives the RMT a specificity of 90%. If those test is designed to identify. Specificity is calculated
patients with mental retardation are excluded and by finding the ratio of true negatives to the sum of
the cut-off of eight used, 804 out of 851 patients the true negatives and the false positives [16]. That
542 L. Reznek
is, specificity ¼ true negatives/true negatives þ false If one is going to use a test to arrive at a damning
positives. A test with 100% specificity implies that no assessment (of malingering), one wants most of all to
one without the condition is identified as having that have the test highly specific. It is worth letting a
condition. A test that is highly specific has very few number of malingerers escape detection and having
false positives—that is, people identified as having a test of low sensitivity in favour of being sure that
the condition who, in fact, do not have it. when someone is identified as malingering it is very
The sensitivity of a test is defined as the capacity of unlikely that he is not. For this reason, when using
that test to identify patients that the test is designed the RMT, one should use it only with those who
to identify. Sensitivity is calculated by finding the do not have mental retardation and set the cut-off
ratio of true positives to the sum of the true positives at seven correct items, giving a specificity of greater
and the false negatives [16]. That is, sensitivity ¼ true than 95%. While this gives the RMT a very low
positives/true positives þ false negatives. A test with sensitivity (of only 10%), this is a trade-off worth
100% sensitivity is one that is able to classify all of making.
the patients with the condition as having that condi- This meta-analysis is limited in that it only exam-
tion. A test that is highly sensitive has very few false ined studies where the raw data is available or could
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14
negatives—that is, people who have the condition be inferred from the papers. It is also limited in that it
who are not identified as having it. only examined the quantitative response to the
Clearly, the sensitivity of a test and the specificity RMT. Other studies looking at the qualitative differ-
of a test are competing virtues. That is to say, a test ences in the results were not explored. Larger studies
that is highly sensitive in that it captures all those are needed using multiple measures of malingering
who have the condition is likely to achieve this at to further evaluate the use to the RMT.
the expense of specificity—that is, it is likely to also It must also be stressed that malingering is a clin-
identify some patients who do not have the condition ical judgement and cannot be made on the basis of a
as having it. By setting the standard very low (to single test result alone. Other factors such as the pre-
exclude false negatives), it is likely that patients sence of financial incentives, marked discrepancy
For personal use only.
who do not have the condition will get identified as between subjective complaints and the objective clin-
having it. On the other hand, a test that is highly ical presentation, inconsistencies, bizarre and unphy-
specific and ensures that no one who does not have siological symptoms not normally encountered in
the condition is identified as having it, will likely neurologic and psychiatric practice and the use of
not be very sensitive. By setting the standard very other tests to elicit malingering of cognitive deficits,
high (to exclude false positives), it is likely to miss such as the Test of Memory Malingering [17],
many patients who do, in fact, have the condition. should be taken into account. All these factors
This is exactly the case with the RMT. If the cut- should be used to arrive at a clinical judgement
off is set low, then one is likely to miss many patients of malingering. However, in the end, malingering
who are in fact malingering. On the other hand, the can only be confirmed with 100% confidence if the
good thing about setting a low cut-off score is that person either confesses to it or is observed not to
there will be very few false positives. If the cut-off be disabled, even though he claims he is.
is set high, then one may be able to identify many
malingerers. However, one is likely to identify
many patients who are not malingering as Acknowledgements
malingerers. How should the cut-off be selected? I would like to thank Professor Anthony Feinstein for
Should it be set low, to exclude false positives? Or his helpful review of the earlier draft.
should it be set high, to exclude false negatives?
To answer this question, one must turn to ethics.
The cost of misidentifying a non-malingerer as a References
malingerer is greater than the cost of missing a 1. Binder LM, Rohling ML. Money matters: A meta-analytic
malingerer by incorrectly classifying him as a non- review of the effects of financial incentives on recovery after
malingerer. This is why the justice system presumes closed-head injury. American Journal of Psychiatry
1996;153:7–10.
innocence and requires the law to prove guilt
2. Rey A. The Clinical Examination in Psychology. Paris:
beyond reasonable doubt. This high legal standard University Press of France; 1964.
is there to exclude the worst option—that of convict- 3. Goldberg JO, Miller HR. Performance of psychiatric
ing an innocent person. For the same reason, then, in-patients and intellectually deficient individuals on a task
a test should be chosen that minimizes the chance that assesses the validity of memory complaints. Journal of
Clinical Psychology 1986;42:793–95.
of classifying a non-malingerer as malingering.
4. Bernard LC, Fowler W. Assessing the validity of memory
Therefore, one should aim to exclude false positives complaints: Performance of brain-damaged and normal indi-
and choose a cut-off that generates a high specificity viduals on Rey’s task to detect malingering. Journal of Clinical
at the cost of a high sensitivity. Psychology 1990;46:434–36.
Rey 15-item memory test 543
5. Schretlen D, Brandt J, Krafft L, Van Gorp W. Some 11. Simon MJ. The use of the Rey memory test to assess
caveats in using the Rey 15-item memory test to detect malingering in criminal defendants. Journal of Clinical
malingered amnesia. Psychological Assessment 1991;3: Psychology 1994;50:914–17.
667–72. 12. Lee A, Boone KB, Lesser I, Wohl M, Wilkins S, Parks C.
6. Lee GP, Loring DW, Martin RC. Rey’s 15-item visual Performance of older depressed patients on two cognitive
memory test for the detection of malingering: Normative malingering tests: False positive rates for the Rey 15-item
observations on patients with neurological disorders. memorization and dot counting tests. Clinical
Psychological Assessment 1992;4:43–6. Neuropsychologist 2000;14:305–8.
7. Guilmette TJ, Hart KJ, Guiliano AJ, Leininger BE. Detecting 13. Beetar JT, Williams JM. Malingering response styles on the
simulated memory impairment: Comparison of the Rey memory assessment scales and symptom validity tests.
fifteen-item test and the Hiscock forced-choice procedure. Archives of Clinical Neuropsychology 1994;10:52–72.
Clinical Neuropsychologist 1994;8:283–94. 14. Bernard LC. Prospects for faking believable memory deficits
8. Taylor LA, Kreutzer JS, West DD. Evaluation of malingering on neuropsychological tests and the use of incentives in
cut-off scores for the Rey 15-item test: A brain injury case simulation research. Journal of Clinical and Experimental
series. Brain Injury 2003;17:295–308. Neuropsychology 1990;12:715–28.
9. Arnett PA, Hammeke TA, Schwartz L. Quantitative and 15. Hays JR, Emmons J, Stallings G. Dementia and mental
qualitative performance on Rey’s 15-item test in neurological retardation markers on the Rey 15-item visual memory test.
patients and sissimulators. Clinical Neuropsychologist Psychological Reports 2000;86:179–82.
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14