You are on page 1of 5

Brain Injury, July 2005; 19(7): 539–543

REVIEW

The Rey 15-item memory test for malingering: A meta-analysis

L. REZNEK

University of Toronto, Toronto, Ontario, Canada

(Received 12 January 2004; accepted 12 July 2004)


Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14

Abstract
Background: The Rey 15-Item Memory Test (RMT) is frequently used to detect malingering. Many objections to the test
have been raised. Nevertheless, the test is still widely used.
Objective: To provide a meta-analysis of the available studies using the RMT and provide an overall assessment of the
sensitivity and specificity of the test, based on the cumulative data.
Results: The results show that, excluding patients with mental retardation, the RMT has a low sensitivity but an excellent
specificity.
Conclusions: These results provide the basis for the ongoing use of the test, given that it is acceptable to miss some cases of
For personal use only.

malingering with such a screening test, but one does not want to have many false positives.

Keywords: Malingering, Rey

Introduction is very simple because of the redundancy among


There is growing evidence that there is an element items, and even patients with significant impairment
of malingering in many cases where patients are in can perform the test without difficulty. However, it is
litigation and claiming brain damage. Binder and assumed that malingerers will not know this. Instead,
Rohling [1] assess that 23% of all cases of closed they will reason that, in order to register a result of
head injuries would not be professing disability being memory impaired, they will have to recall
if financial compensation were eliminated. This is only a few items. Thus, patients with impairment
an alarming statistic and suggests that financial will do well on the test, while malingerers will do
incentives play a significant role in these cases. poorly, enabling one to identify them.
Interestingly, these authors show that those patients Many guidelines have been presented in using this
who were less severely injured were more likely to seek test. Goldberg and Miller [3] examined the perfor-
monetary compensation. What is urgently needed, mance of patients with severe psychiatric disorders
then, is a reliable test to detect such cases. and patients with mental retardation. Based on
Rey [2] proposed such a test. The RMT is a quick, their finding that none of the patients with psychi-
easily administered test used to detect the malinger- atric disorder recalled fewer than nine items, these
ing of memory impairment. The test consists of five investigators proposed a cut-off of less than nine
rows of three characters each on a card (A B C, for identifying individuals exaggerating memory
1 2 3, a b c, œ  i, I II III). Subjects are shown impairment. Excluding the patients with mental
the card for 10 seconds and told to study it carefully retardation, this gave the RMT a specificity of 100%.
in order to try to remember as many of the items as Bernard and Fowler [4] examined the perfor-
they can. The RMT is presented to subjects as a very mance of patients with brain damage (most of
difficult memory test consisting of having to remem- whom had received a significant head injury) in com-
ber as many as 15 different items. In fact, the test parison to normal controls. They confirmed that

Correspondence: L. Resnek, MD, University of Toronto-Sunnybrook and Women’s Health Sciences Centre, 2075 Bayview Ave., Toronto, Ontario MN4 3M5,
Canada. E-mail: ashaki.adonis@sw.ca
ISSN 0269–9052 print/ISSN 1362–301X online # 2005 Taylor & Francis Group Ltd
DOI: 10.1080/02699050400005242
540 L. Reznek

using a cut-off of nine items was able to exclude the They found that IQ accounted for 37% of the
vast majority of the cases with brain damage from variance in scores. Those patients with psychiatric
being classified as malingerers. A score of eight or disorder and a low IQ not uncommonly scored
less was recommended in identifying individuals below the cut-off score of nine previously suggested.
exaggerating memory difficulties. Their results gave This demonstrated that, for those patients with
the RMT a specificity of 94%. psychiatric disorder and mental retardation, the
Schretlen et al. [5] compared subjects who were RMT was not very specific and identifies many
instructed to malinger amnesia with patients from non-malingerers as malingerers. This is consistent
several clinical groups (for example, those with with the original findings of Goldberg and Miller
brain damage, severe psychiatric disorders and [3]. Excluding those patients with psychiatric dis-
dementia). Using the cut-off of nine (recall of eight order and mental retardation (that is, who had an
or less items), these investigators found that the IQ less than 70), the RMT had a specificity of 85%.
RMT has a sensitivity of 12% and a specificity of Simon [11] tested the RMT by comparing 14
73%. diagnosed malingerers with 14 forensic in-patients
Lee et al. [6] tested the utility of the RMT using who had been acquitted by reason of insanity. He
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14

a group of patients with neurological disorders found that a cut-off of nine was useful in identifying
(suffering from temporal lobe epilepsy). They 86% of the malingerers. That is, remembering more
found that a cut-off of nine was too demanding for than eight items excluded 86% of the non-malinger-
this group of patients and generated an unacceptably ing group and included 86% of the malingering
low specificity, identifying many of the patients group as malingerers.
with neurological disorders as malingerers. They Lee et al. [12] used the RMT to assess the cogni-
proposed instead a cut-off of eight as a better tive performance of 64 older patients with major
standard—scores of seven or less gave the RMT depression. They found that the cut-off of nine
a specificity of 96%. That is, it classified 96% of gave the RMT a specificity of over 95%.
With all these results, some conflicting, there is a
For personal use only.

the non-malingerers correctly as non-malingerers.


Guilmette et al. [7] administered the RMT to a need to provide guidelines for the use of the RMT.
group of non-litigating individuals with moderate- The method adopted in this study was to pool all
to-severe brain damage, psychiatric in-patients with these data and generate an overall assessment of
depression and a group of normal subjects asked to the sensitivity and specificity of the RMT.
fake memory impairment. Using a cut-off of seven
or less items as suggested by the above study, 40%
of the group with brain damage and 20% of the Method
psychiatric in-patients with depression would have
An Internet search for studies using the RMT was
been identified as malingerers. On the other hand,
undertaken. Studies were gathered that had exam-
the same cut-off gave the RMT a sensitivity of
ined the use of the RMT. Some studies had to be
only 5%.
discarded, as they did not provide sufficient informa-
Taylor et al. [8] challenged these latter findings.
tion on the way that individual subjects had scored,
They tested a group of patients with severe brain
so that their data could not be pooled. A total of 13
injury and found that all of them were able to score studies were gathered [3–15]. Their results were
a perfect 15/15 on the RMT. This suggests that per- pooled to generate the overall results.
haps a higher standard would be more appropriate
even for patients with severe brain damage. On
their results, a cut-off of nine gave the RMT
a specificity of 100%. Results
Arnett et al. [9] used the RMT to detect malinger- Assuming a cut-off of nine (that is, those scoring
ing in a group of patients with neurological disorder eight or less are identified as malingering), 837 out of
and a group of subjects instructed to simulate 983 patients who were not malingering were
memory impairment. A cut-off of less than two com- identified as not malingering. This gives the RMT
plete rows correct gave the RMT a sensitivity of 64% a specificity of 85%. Using the same cut-off of nine,
and a specificity of 96%. However, the usual cut-off 70 out of 192 malingerers were identified as
of nine (that is, a score of eight or less items recalled) malingerers. This gives the RMT a sensitivity of
gave the test a specificity of 100%, but a sensitivity 36% (see Tables I and II).
of 5%. Adopting a cut-off of eight (that is, those scoring
Hays et al. [10] examined the performance of seven or less are identified as malingering), 853
patients with psychiatric disorder on the RMT. out of 925 patients who were not malingering were
Rey 15-item memory test 541

Table I. Specificity.

Ratio of Ratio of
not malingering not malingering
Study Subjects at cut-off <9 at cut-off <8

Goldberg and Miller [3] Subjects with psychiatric disorder 50/50 50/50
Goldberg and Miller [3] Subjects with mental retardation 10/16 ?
Bernard and Fowler [4] Normal subjects 16/16 16/16
Bernard and Fowler [4] Subjects with brain damage 18/18 18/18
Simon [11] Mentally ill forensic cases 12/14 ?
Taylor et al. [8] Subjects with severe brain damage 5/5 5/5
Schretlen et al. [5] Normal 80/80 80/80
Schretlen et al. [5] Subjects with brain injury 55/55 55/55
Schretlen et al. [5] Subjects with severe psychiatric disorder 40/40 40/40
Schretlen et al. [5] Subjects with mixed dementia 8/9 9/9
Schretlen et al. [5] Subjects with neuropsychiatric disorder 26/34 34/34
Schretlen et al. [5] Subjects with amnesia 8/10 10/10
Lee et al. [6] TLE 93/100 96/100
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14

Lee et al. [6] Subjects with neurological disorders 37/40 38/40


Lee et al. [6] Subjects with depression 61/64 64/64
Bernard [14] Controls 21/28 ?
Guilmette et al. [7] Subjects with brain damage 18/20 18/20
Guilmette et al. [7] Subjects with depression 11/20 12/20
Beetar and Williams [13] Normal 30/30 30/30
Hays et al. [10] Subjects with psychiatric 24/74 49/74
disorder w/IQ <70
Hays et al. [10] Subjects with psychiatric 180/226 195/226
disorder w/IQ <70
Arnett et al. [9] Subjects with neurological disorder 34/34 34/34
For personal use only.

All studies All subjects 837/983 ¼ 85% 853/925 ¼ 92%


All studies All subjects except subjects with 803/893 ¼ 90% 804/851 ¼ 95%
mental retardation

Table II. Sensitivity.

Ratio of Ratio of
not malingering not malingering
Study Subjects at cut-off <9 at cut-off <8

Simon [11] Malingerers 12/14 ?


Schretlen et al. [5] Suspected fakes 6/7 4/7
Schretlen et al. [5] Fake amnesia 0/47 0/47
Lee et al. [6] Subjects with neurological 6/16 6/16
disorder in litigation
Bernard [14] Malingerers 43/58 ?
Guilmette et al. [7] Normals malingering 3/20 1/20
Beetar and Williams [13] Normals malingering 0/30 0/30
All studies All subjects 70/192 ¼ 36% 11/120 ¼ 9%

identified as such. This gives the RMT an enhanced who were not malingering were identified as such.
specificity of 92%. Using the same cut-off of seven or This gives the RMT a specificity of over 95% (see
less items recalled, 11 out of 120 malingerers were Tables I and II).
identified as such. This gives the RMT a sensitivity
of 9% (see Tables I and II).
Discussion
Excluding those patients with mental retardation
and using the cut-off of nine, 803 out of 893 patients The specificity of a test is defined as the capacity
who were not malingering were identified as such. of that test to identify only those patients that the
This gives the RMT a specificity of 90%. If those test is designed to identify. Specificity is calculated
patients with mental retardation are excluded and by finding the ratio of true negatives to the sum of
the cut-off of eight used, 804 out of 851 patients the true negatives and the false positives [16]. That
542 L. Reznek

is, specificity ¼ true negatives/true negatives þ false If one is going to use a test to arrive at a damning
positives. A test with 100% specificity implies that no assessment (of malingering), one wants most of all to
one without the condition is identified as having that have the test highly specific. It is worth letting a
condition. A test that is highly specific has very few number of malingerers escape detection and having
false positives—that is, people identified as having a test of low sensitivity in favour of being sure that
the condition who, in fact, do not have it. when someone is identified as malingering it is very
The sensitivity of a test is defined as the capacity of unlikely that he is not. For this reason, when using
that test to identify patients that the test is designed the RMT, one should use it only with those who
to identify. Sensitivity is calculated by finding the do not have mental retardation and set the cut-off
ratio of true positives to the sum of the true positives at seven correct items, giving a specificity of greater
and the false negatives [16]. That is, sensitivity ¼ true than 95%. While this gives the RMT a very low
positives/true positives þ false negatives. A test with sensitivity (of only 10%), this is a trade-off worth
100% sensitivity is one that is able to classify all of making.
the patients with the condition as having that condi- This meta-analysis is limited in that it only exam-
tion. A test that is highly sensitive has very few false ined studies where the raw data is available or could
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14

negatives—that is, people who have the condition be inferred from the papers. It is also limited in that it
who are not identified as having it. only examined the quantitative response to the
Clearly, the sensitivity of a test and the specificity RMT. Other studies looking at the qualitative differ-
of a test are competing virtues. That is to say, a test ences in the results were not explored. Larger studies
that is highly sensitive in that it captures all those are needed using multiple measures of malingering
who have the condition is likely to achieve this at to further evaluate the use to the RMT.
the expense of specificity—that is, it is likely to also It must also be stressed that malingering is a clin-
identify some patients who do not have the condition ical judgement and cannot be made on the basis of a
as having it. By setting the standard very low (to single test result alone. Other factors such as the pre-
exclude false negatives), it is likely that patients sence of financial incentives, marked discrepancy
For personal use only.

who do not have the condition will get identified as between subjective complaints and the objective clin-
having it. On the other hand, a test that is highly ical presentation, inconsistencies, bizarre and unphy-
specific and ensures that no one who does not have siological symptoms not normally encountered in
the condition is identified as having it, will likely neurologic and psychiatric practice and the use of
not be very sensitive. By setting the standard very other tests to elicit malingering of cognitive deficits,
high (to exclude false positives), it is likely to miss such as the Test of Memory Malingering [17],
many patients who do, in fact, have the condition. should be taken into account. All these factors
This is exactly the case with the RMT. If the cut- should be used to arrive at a clinical judgement
off is set low, then one is likely to miss many patients of malingering. However, in the end, malingering
who are in fact malingering. On the other hand, the can only be confirmed with 100% confidence if the
good thing about setting a low cut-off score is that person either confesses to it or is observed not to
there will be very few false positives. If the cut-off be disabled, even though he claims he is.
is set high, then one may be able to identify many
malingerers. However, one is likely to identify
many patients who are not malingering as Acknowledgements
malingerers. How should the cut-off be selected? I would like to thank Professor Anthony Feinstein for
Should it be set low, to exclude false positives? Or his helpful review of the earlier draft.
should it be set high, to exclude false negatives?
To answer this question, one must turn to ethics.
The cost of misidentifying a non-malingerer as a References
malingerer is greater than the cost of missing a 1. Binder LM, Rohling ML. Money matters: A meta-analytic
malingerer by incorrectly classifying him as a non- review of the effects of financial incentives on recovery after
malingerer. This is why the justice system presumes closed-head injury. American Journal of Psychiatry
1996;153:7–10.
innocence and requires the law to prove guilt
2. Rey A. The Clinical Examination in Psychology. Paris:
beyond reasonable doubt. This high legal standard University Press of France; 1964.
is there to exclude the worst option—that of convict- 3. Goldberg JO, Miller HR. Performance of psychiatric
ing an innocent person. For the same reason, then, in-patients and intellectually deficient individuals on a task
a test should be chosen that minimizes the chance that assesses the validity of memory complaints. Journal of
Clinical Psychology 1986;42:793–95.
of classifying a non-malingerer as malingering.
4. Bernard LC, Fowler W. Assessing the validity of memory
Therefore, one should aim to exclude false positives complaints: Performance of brain-damaged and normal indi-
and choose a cut-off that generates a high specificity viduals on Rey’s task to detect malingering. Journal of Clinical
at the cost of a high sensitivity. Psychology 1990;46:434–36.
Rey 15-item memory test 543

5. Schretlen D, Brandt J, Krafft L, Van Gorp W. Some 11. Simon MJ. The use of the Rey memory test to assess
caveats in using the Rey 15-item memory test to detect malingering in criminal defendants. Journal of Clinical
malingered amnesia. Psychological Assessment 1991;3: Psychology 1994;50:914–17.
667–72. 12. Lee A, Boone KB, Lesser I, Wohl M, Wilkins S, Parks C.
6. Lee GP, Loring DW, Martin RC. Rey’s 15-item visual Performance of older depressed patients on two cognitive
memory test for the detection of malingering: Normative malingering tests: False positive rates for the Rey 15-item
observations on patients with neurological disorders. memorization and dot counting tests. Clinical
Psychological Assessment 1992;4:43–6. Neuropsychologist 2000;14:305–8.
7. Guilmette TJ, Hart KJ, Guiliano AJ, Leininger BE. Detecting 13. Beetar JT, Williams JM. Malingering response styles on the
simulated memory impairment: Comparison of the Rey memory assessment scales and symptom validity tests.
fifteen-item test and the Hiscock forced-choice procedure. Archives of Clinical Neuropsychology 1994;10:52–72.
Clinical Neuropsychologist 1994;8:283–94. 14. Bernard LC. Prospects for faking believable memory deficits
8. Taylor LA, Kreutzer JS, West DD. Evaluation of malingering on neuropsychological tests and the use of incentives in
cut-off scores for the Rey 15-item test: A brain injury case simulation research. Journal of Clinical and Experimental
series. Brain Injury 2003;17:295–308. Neuropsychology 1990;12:715–28.
9. Arnett PA, Hammeke TA, Schwartz L. Quantitative and 15. Hays JR, Emmons J, Stallings G. Dementia and mental
qualitative performance on Rey’s 15-item test in neurological retardation markers on the Rey 15-item visual memory test.
patients and sissimulators. Clinical Neuropsychologist Psychological Reports 2000;86:179–82.
Brain Inj Downloaded from informahealthcare.com by Northeastern University on 11/04/14

1995;9:17–26. 16. Tombaugh T. Test of Memory Malingering. New York:


10. Hays JR, Emmons J, Lawson KA. Psychiatric norms for the MHS; 1996.
Rey 15-item visual memory test. Perceptual and Motor Skills 17. Altman DG. Practical Statistics for Medical Research.
1993;76:1331–34. London: Chapman & Hall; 1991.
For personal use only.

You might also like