You are on page 1of 9

International Journal of Nursing Studies 123 (2021) 104070

Contents lists available at ScienceDirect

International Journal of Nursing Studies


journal homepage: www.elsevier.com/ijns

Instruments to assess self-neglect among older adults: A systematic


review of measurement properties ✩
Min Qian, Yuexian Shi, Jinghong Lv, Mingming Yu∗
School of Nursing, Peking University, Beijing, P.R. China

article info abstract

Article history: Objective: To critically appraise, compare, and summarize the measurement properties of existing instru-
Received 19 April 2021 ments that assess self-neglect among older adults.
Received in revised form 18 August 2021
Methods: Eight electronic databases (PubMed, Scopus, Embase, CINAHL Plus with Full Text, Web of Sci-
Accepted 18 August 2021
ence, PsycINFO, China National Knowledge Infrastructure, and WanFang Data) were searched from their
inception to September 6, 2020. The methodological qualities of the included studies on measurement
Keywords:
properties were assessed by using the COnsensus-based Standards for selection of health Measure-
Instruments
Measurement properties ment INstruments (COSMIN) methodology for systematic reviews of Patient-Reported Outcome Measures
Self-neglect (PROMs).
Systematic review Results: Among the 1184 studies identified, 47 full-text studies were assessed further for their eligibil-
ities. A total of 8 studies were eventually included. The methodological quality of content validity for
relevance, comprehensiveness, and comprehensibility of all instruments in this review was doubtful or
inadequate. The methodological quality of structural validities in the majority of the studies were very
good, while the quality of hypothesis testing for construct validity was doubtful. The internal consistency
was assessed by calculating Cronbach’s alpha coefficient in all studies. Some measurement properties
(e.g., cross-cultural validity/measurement invariance, measurement error, and responsiveness) were not
assessed in the reviewed studies.
Conclusions: This systematic review provides a comprehensive overview of the measurement properties
of elder self-neglect instruments. Among the eight instruments identified, none of them demonstrate
better properties than any other. Future studies are suggested to use COSMIN methodology as guideline to
examine the measurement properties of the developed instruments. Instruments with rigid measurement
properties are urgently needed to assess self-neglect among older adults to provide the necessary and
valuable information on this particular phenomenon.
© 2021 Elsevier Ltd. All rights reserved.

What is already known What this paper adds

• Self-neglect is a common phenomenon and prominent public • Eight instruments are available to assess self-neglect of older
problem in older adults. adults. However, no evidence has been found regarding which
• Self-neglect is associated with early mortality, increased read- instrument is superior to others.
mission and hospitalization, suicidal ideations, and diverse • Future studies should consider COSMIN methodology as instru-
forms of elder abuse. ments development guideline. Moreover, the self-reported and
• Effort has been exerted to develop self-neglect instruments for proxy-reported methods should be adopted in one instrument
older adults. However, no rigorous evaluations and summaries to obtain the entire and accurate picture of self-neglect in older
of measurement properties have been conducted to date. adults.

✩ 1. Introduction
Register number: CRD42020218810

Corresponding author.
E-mail addresses: qianmin2019@pku.edu.cn (M. Qian), lv@bjmu.edu.cn (J. Lv), Self-neglect, formerly called “Diogenes syndrome” (Clark et al.,
yumm@hsc.pku.edu.cn (M. Yu). 1975), “senile breakdown” (Macmillan and Shaw, 1966), and “senile

https://doi.org/10.1016/j.ijnurstu.2021.104070
0020-7489/© 2021 Elsevier Ltd. All rights reserved.
2 M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070

squalor syndrome” (Kafetz and Cox, 1982), is a prominent problem who are interested in the self-neglect phenomenon among older
in older adults (Braye et al., 2011; Yu et al., 2020). The first em- adults.
pirical study on self-neglect was conducted in 1966 in England,
and self-neglect was called “senile breakdown” (Macmillan and
2. Methods
Shaw, 1966) . In the late 1970s, the term “self-neglect” was gradu-
ally used in the medical and social literature (Roe, 1977; Reed and
2.1. Design
Leonard, 1989). Self-neglect is treated as a subtype of elder abuse
in some states in the US (National Center on Elder Abuse Web-
A systematic review of the measurement properties of self-
site 2021). However, in Ireland, Australia, and the UK, self-neglect
neglect instruments in older adults was conducted according to the
is not included as a subtype of elder abuse. To date, there has
COSMIN methodology for systematic reviews of PROMs (Mokkink
been no internationally accepted definition of self-neglect. Ac-
et al., 2018a,b; Prinsen et al., 2018; Terwee et al., 2018). A proto-
cording to the US National Center on Elder Abuse (NCEA), self-
col for this systematic review was registered in PROSPERO and the
neglect refers to “…the behavior of an elderly person that threat-
register number is CRD42020218810.
ens his/her own health and safety and generally manifests it-
self in an older person as a refusal or failure to provide him-
self/herself with adequate food, water, clothing, shelter, personal 2.2. Search strategy
hygiene, medication (when indicated), and safety precautions”
(National Center on Elder Abuse Website 2021). A comprehensive literature search was conducted in six English
The risk factors of elder self-neglect are poorly understood, electronic databases, namely, PubMed, Scopus, Embase, CINAHL
and previous studies have shown that it may be related to trau- Plus with Full Text, Web of Science, and PsycINFO; and two Chi-
matic personal experiences, perceptions, and behaviors devel- nese databases including China National Knowledge Infrastruc-
oped over a lifetime, such as separation and abandonment, par- ture (CNKI) and WanFang Data from their inception to Septem-
ticularly in childhood or adolescence (Lien et al., 2016). Never- ber 6, 2020. The Medical Subject Headings (MeSH) terms and key-
theless, multiple risk factors associated with elder self-neglect words in the title or abstract were combined together with the
have been identified, including depressive symptoms/depression “OR” and “AND” Boolean operators when appropriate. These MeSH
(Burnett et al., 2006; Yu et al., 2019), cognitive impairment terms and keywords were as follows: self-neglect, Diogenes syn-
(Abrams et al., 2002; Dong et al., 2010; X. Dong, Simon, drome, senile breakdown, social breakdown syndrome, Diogenes of
Mosqueda et al., 2012; Dong and Simon, 2016;), male gender snipe, domestic squalor, squalor syndrome, messy house syndrome,
(Dong et al., 2010, 2016), low income (Dong et al., 2012), older gross self-neglect, self-endangering behavior, surveys and question-
age (Dong, 2016), living alone (Burnett et al., 2006; Lee and naires, survey, instrument, questionnaire, tool, scale, screen∗ , and
Kim, 2014), and low level of physical function (Dong and Si- measure∗ . In addition, the reference lists of all retrieved papers
mon, 2016). Self-neglect can result in negative health outcomes were further searched for potential studies. The detailed search
among older adults, including early mortality, increased read- strategy as an example in the PubMed database is provided in sup-
mission and hospitalization, suicidal ideations, and diverse forms plemental file 1.
of elder abuse (Dong et al., 2009, 2012; Dong et al., 2013,
2017).
2.3. Eligibility criteria
According to a recent published systematic review of self-
neglect in older adults, the prevalence rates of elder self-neglect
The eligible studies should meet the following criteria: (1) orig-
range from 18.4% to 29.1% (Yu et al., 2020). Nevertheless, such
inal studies aiming to develop an instrument to measure self-
prevalence rates are likely underestimated and underreported
neglect of older adults aged 60 years or above (A minor modifica-
(May-Chahal and Antrobus, 2011) because of the absence of uni-
tion was made regarding the cutoff age of the older adults. In the
versally accepted standards for definition, assessment, and severity
registered protocol, a cutoff age of 65 years was used. However,
measurement of self-neglect. In addition, self-neglect is occasion-
the age of 60 years was adopted in the present review to include
ally reported under the category of “elder abuse,” and such a phe-
as many as eligible studies.); (2) describing at least one measure-
nomenon also contributes to rate underestimation. Hence, instru-
ment properties of the self-neglect instruments (Mokkink et al.,
ments to recognize and assess self-neglect for older adults have
2010) and/or the scale validation process; and (3) full-text articles
been in urgent need, considering the large older population and
published in Chinese or English (Authors of this review are native
significant effects of self-neglect on the health outcomes of older
Chinese speakers and inclusion of both English and Chinese studies
people.
can expand the breadth of the review). Studies were excluded from
Although multiple instruments have been developed and avail-
this review if they were conference proceedings, editorials, com-
able for use as elder self-neglect measurement instruments, min-
mentaries, abstracts only, newsletters, research protocols, or letters.
imal information regarding their methodological quality can be
referred to. Accordingly, researchers and health professionals are
challenged to make a choice on which elder self-neglect in- 2.4. Study selection
strument they should adopt. To the best of our knowledge,
no systematic review has been conducted, particularly on the All records of eight databases were imported into the reference
measurement properties of self-neglect instruments among older management software program Endnote X 9.3.3. After the removal
adults. The primary aim of this systematic review was to iden- of duplicates, two authors (QM &YM) independently reviewed the
tify current self-neglect instruments for older adults and to titles and abstracts of the remaining records for relevance to the
evaluate their measurement properties based on the COSMIN review topic. Studies that potentially or completely met the inclu-
methodology for systematic reviews of PROMs (Mokkink et al., sion criteria were kept and their full-texts were retrieved. The two
2018a,b; Prinsen et al., 2018; Terwee et al., 2018) . We are op- authors assessed and screened the full texts to decide whether to
timistic that our critical appraisal of the measurement prop- keep the records in the review. Discrepancies were discussed with
erties of self-neglect instruments can provide useful and prac- a third author (SY) to reach a consensus. The final included studies
tical references for other researchers and health professionals were reviewed by all authors for agreement.
M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070 3

2.5. Data extraction 3.2. Characteristics of the included studies

The following information of each included study was extracted Eight instruments that were specifically developed or translated
in two standardized information forms: (1) characteristics of the to assess self-neglect for older adults were identified: Elder Self-
included PROMs, such as item generation, target population, par- Neglect Assessment (ESNA) (Iris et al., 2014), Elder Self-Neglect
ticipants, mode of administration (self-reported/proxy-reported), Questionnaire (ESNQ) (Cai, 2015), Scale of the Elderly Self-Neglect
number of items, response options, range of scores, original lan- (Rural) (SESNr) (Zhao, 2017), Self-Neglect-37 (SN-37) (Day and Mc-
guage, and available translated version; and (2) results of stud- Carthy, 2016), Istanbul Medical School Elder Self-Neglect Question-
ies on measurement properties, such as content validity, structural naire (IMSelf-neglect) (İlhan et al., 2018), Abrams Geriatric Self-
validity, internal consistency, reliability, and hypothesis testing for Neglect Scale (AGSS) (Abrams et al., 2018), Self-neglect Question-
construct validity. naire (Peng et al., 2020), and Chinese version of the Elder Self-
Neglect Assessment (C-ESNA) (Wang, 2018).
The characteristics of the included self-neglect instruments
were presented in Table 1. These studies were published in En-
2.6. Methodological and measurement quality assessment
glish or Chinese from 2014 to 2020 and conducted in China
(n = 4) (Cai, 2015; Peng et al., 2020; Wang, 2018; Zhao, 2017),
The methodological quality of the included studies was as-
the US (n = 2) (Abrams et al., 2018; Iris et al., 2014), Ire-
sessed using the COSMIN Risk of Bias checklist (Mokkink et al.,
land (n = 1) (Day and McCarthy, 2016), and Turkey (n = 1)
2018a). The COSMIN Risk of Bias checklist was initially developed
(İlhan et al., 2018). Item generations were based on theoreti-
by the COSMIN steering committee to assess risk of bias of stud-
cal framework, literature review, the appraisal of existing instru-
ies on measurement properties in systematic reviews of PROMs
ments, expert advice, questionnaire survey, and interviews. These
(Mokkink et al., 2018a). The checklist has 10 boxes related to
instruments can be self-reported (Iris et al., 2014; Zhao, 2017;
instrument development (35 items), content validity (31 items),
Wang, 2018; Peng et al., 2020), proxy-reported (Cai, 2015;
structural validity (4 items), internal consistency (5 items), cross-
Day and McCarthy, 2016; İlhan et al., 2018), or both self-reported
cultural validity/measurement invariance (4 items), reliability (8
and proxy-reported (Abrams et al., 2018). The target popula-
items), measurement error (6 items), criterion validity (3 items),
tion were community-dwelling older population (Iris et al., 2014;
hypothesis testing for construct validity (7 items), and responsive-
Cai, 2015; Day and McCarthy, 2016; Zhao, 2017; Abrams et al.,
ness (13 items) (Mokkink et al., 2018a; Prinsen et al., 2018; Terwee
2018; İlhan et al., 2018; Wang, 2018) and inpatient older adults
et al., 2018). All items are rated on the four-point rating scale in-
(Peng et al., 2020). However, one study involved college students
cluding very good (V), adequate (A), doubtful (D), or inadequate (I)
(Cai, 2015), and the other one included public health nurses, social
against the COSMIN methodology. The overall score of each box in
workers, and senior case workers as research subjects (Day and
a measurement was judged based on the lowest rating within the
McCarthy, 2016). The number of items included in these instru-
criterion called “the worst score counts” (Terwee et al., 2012).
ments was diverse, ranging from 6 to 62. Only one instrument has
The quality of measurement properties of each instrument
both English and Chinese versions (Iris et al., 2014; Wang, 2018),
was rated by the updated criteria for good measurement proper-
which we treated as two independent self-neglect instruments.
ties (Prinsen et al., 2018). According to the COSMIN methodology
(Mokkink et al., 2018a,b; Prinsen et al., 2018; Terwee et al., 2018),
3.3. Results of methodological quality and measurement property
if the content validity (step 5) is rated as insufficient, authors can
rating
skip steps 6–8 and directly draw a recommendation for a PROM
in step 9. However, the COSMIN methodology (Mokkink et al.,
The methodological quality and measurement property rating
2018a,b; Prinsen et al., 2018; Terwee et al., 2018) was published
against criteria for good measurement properties for each study
in 2018, while 7 out of 8 scales in this review were published be-
were presented in Table 2. None of the eight instruments identi-
fore 2018 or in 2018. Researchers of these included studies may not
fied were assessed for all measurement properties. Structural va-
know this COSMIN methodology. By referring to other published
lidity and internal consistency were the two most frequently re-
systematic reviews of measurement properties (Charette et al.,
ported measurement properties in the included studies.
2020; Gentizon et al., 2021), group discussion, and expert consul-
tations, we finally decided to evaluate the measurement proper-
3.3.1. ESNA
ties of a PROM step by step according to the COSMIN methodology
ESNA (Iris et al., 2014) was the first developed self-neglect in-
(Mokkink et al., 2018a,b; Prinsen et al., 2018; Terwee et al., 2018).
strument for older adults, and has detailed measurement prop-
The measurement properties of a PROM can be rated as sufficient
erties reported. ESNA was designed with two versions based on
(+), insufficient (–), or indeterminate (?) against the updated crite-
a previous theoretical framework of concept mapping (Iris et al.,
ria (Prinsen et al., 2018).
2010): long version with 62 items and short version with 25 items.
The item generations of ESNA were established by 79 staff
members, including social workers, case managers, caseworkers,
3. Results elder abuse investigators, housing specialists, nurses, and client
advocates. The authors did not report the content validity index
3.1. Studies identification (CVI) of the instrument. Therefore, its content validity was judged
as doubtful methodological quality and the measurement property
A total of 1184 records were originally identified through sys- rating was indeterminate. Structural validity testing was performed
tematic database searching, with 133 in Embase, 279 in Scopus, 118 based on the Rasch measurement model. The variances explained
in PubMed, 253 in Web of Science, 217 in PsycINFO, 121 in CINAHL were 32.5% and 39.1% in the long and short versions, respectively.
Plus with Full Text, 41 in CNKI, and 22 in WanFang Data. After The methodological quality of the structural validities of the two
the removal of duplicates, title/abstract screening, full-text reviews, versions was judged as very good and the measurement prop-
and additional searches, eight studies were eventually included in erty rating was sufficient. The methodological quality of hypoth-
the systematic review. The study search and selection process were esis testing for construct validity was inadequate because the con-
presented in Fig. 1. structs and measurement properties of the comparative instrument
4
Table 1
Characteristics of the included studies.

Instrument Author, Year, Item generation Target Participants Mode of (Sub)scale (s) (number of Response options Range of scores Original Available
Country population administration items) language translated
version

Elder Iris et al., Based on theoretical community- community- self-report 62 items and 25 items Four choices: NA English Chinese
Self-Neglect 2014, US framework of concept dwelling older dwelling older with no subscales “yes’’, “no’’, “suspected’’,
Assessment mapping adults adults or “don’t know’’
(ESNA)
Elder Cai, 2015, Based on the literature community- college proxy-report 23 items divided into 4 Two choices: 0–23: Chinese None
Self–Neglect China review, expert advice, dwelling older students subscales: life style, “yes’’ or “no’’ Higher scores
Questionnaire questionnaire survey and adults healthcare, social indicate greater
(ESNQ) interviews interaction, and living self-neglect.
environment

M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070
Self-Neglect-37 Day and Based on literature community- public health proxy-report 37 items divided into 5 A 5-point Likert scale: NA English None
(SN-37) McCarthy, review, ESN conceptual dwelling older nurses, social subscales: Environment, 1 (unimportant) to 5
2016, Ireland framework, previous adults workers, senior social networks, emotional (very important)
qualitative research and case workers and behavioral labiality,
the appraisal of existing health avoidance, and
instruments self-determinism
Scale of the Zhao, 2017, Based on the literature community- community- self-report 14 items divided into 5 A 5-point 0–28: Chinese None
Elderly China review, interviews,and an dwelling older dwelling older subscales: health care, Likert scale: Higher scores
Self-Neglect expert panel using Delphi adults adults hygiene, emotion, safety, 0 (absence of indicate greater
(Rural) (SESNr) technique and social interaction self-neglect) to 4 (highest self-neglect.
level of self-neglect)
Istanbul ILHAN et al., Based on combination of community- community- proxy-report 11 items divided into 3 Two choices: 0–11: Turkish None
Medical School 2018, Turkey homeinterviews and dwelling older dwelling older subscales: personal “yes’’ or “no’’ Lower scores
Elder examining multiple scales adults adults in hygiene, health habits, indicate higher
Self-Neglect outpatient social functioning possibility of
questionnaire clinics self-neglect.
(IMSelf-
neglect)
Abrams Abrams et al., Based on the geriatric community- community- self-report and 6 items with 6 subscales: A 5-point Likert scale: 0–24: English None
Geriatric 2018, US self-neglect literature and dwelling older dwelling older proxy-report prescription medicines, 0 (absence of Higher scores
Self-Neglect experts of local adults adults personal care, nutrition, self-neglect) to 4 (highest indicate greater
Scale (AGSS) psychiatrists, geriatricians, environment/housing, level of self-neglect) self-neglect.
and social workers financial stewardship,
socialization
Chinese Wang, 2018, Based on the original scale community- community- self-report 24 items divided into 3 Four choices: 0–48 English Chinese
version of the China (the ESNA scale) dwelling older dwelling older subscales: life “yes’’,“no’’,“suspected
Elder adults adults style/condition, health problem’’, or “don’t
Self-Neglect care, and living know’’
Assessment environment
(C-ESNA)
Self-neglect Peng et al., Based on former results of inpatient older inpatient older self-report 24 items divided into 7 Five choices: 24–120: Chinese None
Questionnaire 2020, China qualitative interviews, adults adults subscales: neglecting “strongly agree’’ “agree’’ The higher the
literature review and safety, neglecting hygiene, “neutral’’ “disagree’’ score is , the
Delphi expert consultation neglecting diet, neglecting “strongly disagree’’ greater the
emotional needs, possibility of
neglecting self-neglect
self-development, older adults
neglecting health care, have.
neglecting social
interaction
Note:
NA: not available.
M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070 5

Fig. 1. Detailed information of literature search and study selection.

were not mentioned. The measurement property rating of the hy- hypothesis testing for construct validity was inadequate because
pothesis testing for construct validity was sufficient. Internal con- the constructs and measurement properties of the comparative in-
sistency of ESNA was rated as sufficient with Cronbach’s alpha of struments were not clear. Meanwhile, measurement property was
0.91 for the long version and 0.87 for the short version. Moreover, rated as sufficient because the results were in accordance with the
the methodological quality of internal consistency was assessed as hypothesis. Internal consistency was calculated for the overall scale
very good. with Cronbach’s alpha of 0.877 and for the subscales with Cron-
bach’s alphas from 0.804 to 0.869, which was assessed as very
3.3.2. ESNQ good and sufficient in terms of the methodological quality and
ESNQ (Cai, 2015) is a proxy-reported scale. College students measurement property rating, respectively.
were invited to observe an older adult around them during
their holidays, and complete the questionnaire according to their 3.3.3. SN-37
scrutiny and communications with that older person. Content va- SN-37 (Day and McCarthy, 2016) is a proxy-reported scale,
lidity was evaluated among 3 students, 4 experts and 2 social and developed for professionals to rate the self-neglect of older
workers. Given that the number of professionals used in the con- adults. The content validity of SN-37 was established by a panel
tent validity assessment was below 30, the methodological qual- of eight experts with a variety of professional backgrounds. CVI
ity of ESNQ was doubtful and the measurement property rating was 0.875 for the overall scale and 0.75 to 1.00 for each subscale.
of content validity was sufficient. The methodological quality of The methodological quality of content validity was deemed doubt-
the structural validity was deemed as very good and measurement ful and the measurement property was rated as insufficient. The
property was rated as sufficient, with explanation of 44.4% of the methodological quality of structural validity was rated as very good
variance and showing good fit to the original factor structure via with the original structure confirmed by exploratory factor analysis
confirmatory factor analysis (CFA). The methodological quality of (EFA), explaining 56.5% of variance. The measurement property of
6 M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070

Table 2
Brief summary of the methodological quality of the reviewed instruments.

Instrument Content Validity Structural Validity Internal Consistency Reliability Hypotheses testing
for construct validity

N MQ R N MQ R N MQ R N MQ R N MQ R

ESNA (Iris et al., 2014) experts and social services D ? 215 V + 215 V + n.r. n.r. n.r. 51 I +
practitioners (n = 50)
ESNQ (Cai, 2015) students (n = 3) D + 1173 V + 819 V + n.r. n.r. n.r. 819 I +
Experts (n = 4)
social workers (n = 2)
SN-37 (Day et al., 2016) experts (n = 8) D – 305 V + 305 V ? n.r. n.r. n.r. n.r. n.r. n.r.
SESNr (Zhao, 2017) experts (n = 23) D + 220 V + 181 V – NA D + 201 D –
older adults (n = 28)
IMSelf-neglect Older adults (n = 10) I ? n.r. n.r. n.r. 27 I + 253 D ? 90 I +
(ILHAN et al., 2018)
AGSS (Abrams et al., 2018) NA D ? n.r. n.r. n.r. 71 V – n.r. n.r. n.r. n.r. n.r. n.r.
C-ESNA (Wang, 2018) experts (n = 6) D + 649 V + 336 V + 30 D + 313 D +
older adults (n = 5)
SNQ (Peng et al., 2020) Experts (n = 19) older D + 314 A + 314 I ? n.r. n.r. n.r. n.r. n.r. n.r.
adults (n = 71)
Notes:
NA: not available;
n.r.: not reported;
MQ: methodological quality; R:Rating;
V:Very Good; A:Adequate; D:Doubtful; I:Inadequate;
+: sufficient; -:insufficient; ?: indeterminate;
ESNA: Elder Self-Neglect Assessment; ESNQ: Elder Self–Neglect Questionnaire;
SN-37: Self-Neglect-37; SESNr: Scale of the Elderly Self-Neglect (Rural);
IMSelf-neglect: Istanbul Medical School Elder Self-Neglect questionnaire;
AGSS: Abrams Geriatric Self-Neglect Scale; C-ESNA: Chinese version Elder Self-Neglect Assessment;
SNQ: Self-neglect Questionnaire.

structural validity was rated as sufficient. The measurement prop- property rating of content validity was indeterminate. The method-
erty of internal consistency was rated as indeterminate because the ological quality of the hypothesis testing for construct validity was
alpha of some of the subscales was below 0.7. The methodological inadequate because the constructs and measurement properties of
quality of internal consistency was deemed very good. the comparative instruments were not reported. The measurement
property rating of the result of the hypothesis testing for con-
3.3.4. SESNr struct validity was sufficient. The methodological quality of inter-
SESNr (Zhao, 2017) was developed to assess the self-neglect of nal consistency was rated as inadequate because the internal con-
older adults in China’s rural areas. The methodological quality of sistency of the subscales was not calculated and Cronbach’s alpha
content validity was regarded as doubtful because the number of was 0.708. The measurement property was rated as sufficient. The
experts representing the comprehensiveness and relevance was in- ICC of test–retest reliability was 0.942. The methodological quality
adequate and measurement property was rated as sufficient. The of reliability was doubtful and the measurement property rating of
structural validity of the scale was tested using CFA explaining the result was indeterminate.
68.23% of the variance, and methodological quality was judged to
be very good and the measurement property rating of the result 3.3.6. AGSS
was sufficient. The Assessment of Self-Neglect Severity (ASS) scale AGSS (Abrams et al., 2018), which was originally called the Cor-
was used for hypothesis testing for construct validity (Dong et al., nell Scale for Self-Neglect, was developed to identify the clini-
2009), and the correlation coefficient between the two scales was cal characteristics of older adults who have self-neglect and eval-
0.370. The methodological quality of hypothesis testing for con- uate self-neglect independent of comorbid medical and psychi-
struct validity was doubtful because minimal information could be atric conditions (Abrams et al., 2002). The scale has six domains,
referred to regarding the measurement properties of ASS; mea- and the scores of these domains can be given based on the sub-
surement property rating was insufficient because the result did jects’ responses, observers’ ratings, and overall impressions (infor-
not agree with the hypothesis (correlation coefficient: 0.4 to 0.8) mation sources were from clinicians, family members, and non-
(Zhao, 2017). The methodological quality of internal consistency relative caregivers). The methodological quality of content validity
was very good and the measurement property rating of the inter- was doubtful and measurement property rating of the result was
nal consistency of SESNr was insufficient because Cronbach’s al- indeterminate. The methodological quality of internal consistency
pha was 0.779 for the overall scale and 0.623–0.779 for the sub- was very good and the measurement property of internal consis-
scales. The methodological quality of reliability was doubtful be- tency was rated as insufficient with Cronbach’s alpha calculated at
cause conditions for the tests were not described, and the mea- 0.681 of the subject responses and 0.758 of the observer responses.
surement property rating was sufficient with infraclass correlation
(ICC) of 0.747. 3.3.7. C-ESNA
C-ESNA (Wang, 2018) is a Chinese version of ESNA to assess
3.3.5. IMSelf-neglect the self-neglect of Chinese community-dwelling older adults.
IMSelf-neglect (İlhan et al., 2018) was designed in Turkey Content validity was assessed by asking experts and older adults
and developed for self-neglect among community-dwelling self- about comprehensiveness, relevance, and/or comprehensibility.
sufficient older adults admitted to outpatient clinics. The method- Scale-level CVI was 0.97 and the item-level CVI was 0.83 to 1. The
ological quality of content validity was rated as inadequate because methodological quality of content validity was doubtful and mea-
the relevance of all items has not been reported. The measurement surement property rating was sufficient. CFA was performed with
M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070 7

53.27% of the cumulative percentage of variance. The methodolog- Middlebrook et al., 2021). On the one hand, researchers are un-
ical quality of structural validity was very good and measurement aware of the basic standards for content validity assessment pro-
property rating was sufficient. Hypothesis testing for construct posed by COSMIN Risk of Bias checklist. On the other hand, the
validity was conducted through a comparison with the Social minimum number of experts for content validity evaluation is wor-
Support Rating Scale (Xiao, 1994), and the methodological quality thy of further careful discussions and verifications based on and
of hypothesis testing for construct validity was doubtful and its beyond the COSMIN Risk of Bias checklist.
measurement property rating was sufficient. The methodological CFA and EFA are beneficial for structural validity evaluation
quality of internal consistency was very good and the measure- when classical test theory is used (Floyd and Widaman, 1995).
ment property rating of internal consistency was sufficient with According to the COSMIN Risk of Bias checklist (Mokkink et al.,
Cronbach’s alpha of 0.918 for the overall tool and 0.803 to 0.884 2018a), CFA is preferred over EFA and only the criteria of CFA
for each subscale. Test–retest reliability was assessed within a are available for the methodological quality of structural validity.
two-week interval, and ICC was 0.893. The methodological quality Two instruments in the current review (Day and McCarthy, 2016;
and measurement property of the test–retest reliability were Peng et al., 2020) used EFA to test the structural validity of their
doubtful and sufficient, respectively. instruments. Although no concrete criteria were provided for as-
sessing the results of the two studies in COSMIN Risk of Bias
checklist, the research team made the final judgments based on
3.3.8. Self-neglect questionnaire
their expertise. We suggest that future studies adopt CFA as the
The Self-neglect Questionnaire (Peng et al., 2020) was de-
main method to evaluate the structural validity of the instruments
veloped to evaluate the self-neglect of older adults who were
they develop. Moreover, detailed criteria for assessing the results of
hospitalized. Content validity of the Self-neglect Questionnaire
studies using EFA should also be explored and listed in the COS-
was assessed by 19 experts and 71 older adults, who reviewed the
MIN Risk of Bias checklist to facilitate the consistent reports and
comprehensiveness, relevance and/or comprehensibility. Scale-level
comparisons of the methodological quality of the reviewed instru-
CVI was 0.987 and item-level CVI was 0.895 to 1. The methodolog-
ments.
ical quality of content validity was doubtful because the number
Three studies (Iris et al., 2014; Cai, 2015; İlhan et al., 2018)
of experts was below 30, and measurement property rating was
in this systematic review did not clearly report the measurement
sufficient because the experts and target population were involved
properties of the comparable instruments when they conducted
in the process. Structural validity testing was performed via EFA
hypothesis testing of the construct validity. In general, the more
with 69.39% of the cumulative percentage of variance explained.
specific the hypotheses are, the more supportive evidence the con-
The methodological quality of structural validity was adequate and
struct validity has (Strauss and Smith, 2009). When a newly de-
its measurement property rating was sufficient. The measurement
veloped instrument is compared to another instrument, the em-
property of internal consistency was rated as indeterminate and
phasis is that the constructs of the comparable instruments should
the methodological quality was inadequate because only the
be described in detail. The instrument itself should be of sufficient
internal consistency of the overall scale was assessed.
quality as well. Future self-neglect instrument development stud-
ies should report the measurement properties of the comparable
4. Discussion instruments if it is applicable.
In our review, three studies (Zhao, 2017; İlhan et al., 2018;
In this review, eight instruments were identified to assess self- Wang, 2018) reported the test–retest reliability of the instruments,
neglect in older adults. To the best of our knowledge, this sys- although these studies’ methodological qualities were doubtful.
tematic review is the first to critically appraise the methodolog- The common problem of the methodological quality of the test–
ical qualities and the quality of measurement properties of each retest reliability was that researchers did not describe whether the
self-neglect instrument according to the COSMIN methodology conditions of two tests were similar. Guided by the COSMIN Risk
(Mokkink et al., 2018a,b; Prinsen et al., 2018; Terwee et al., 2018). of Bias checklist (Mokkink et al., 2018a) , we propose that the con-
No studies have mentioned all the measurement properties accord- ditions of the two tests for the test–retest reliability (e.g., type of
ing to the COSMIN Risk of Bias checklist (Mokkink et al., 2018a) , administration, setting where the instruments are administered)
particularly such criteria as measurement error, cross-culture va- should be provided.
lidity, and responsiveness. In general, no clear evidence has shown The self-neglect instruments in our review can be completed
that one instrument is superior to others. Accordingly, research ef- by older adults themselves or by other relevant personnel, includ-
fort is needed for understanding the self-neglect of older adults ing professionals, university students, caregivers, and family mem-
and instrument development. Although multiple instruments have bers. We have difficulties in identifying which method is better
been available to assess self-neglect of older adults, numerous owing to the following considerations. First, given that the older
challenges still have to be addressed. people with self-neglect may have cognitive problems with vari-
Content validity, which refers to the relevance, comprehensive- ous level (Abrams et al., 2002; Dong et al., 2010; X. Dong, Simon,
ness, and comprehensibility of an instrument, is often recognized Mosqueda et al., 2012; Dong and Simon, 2016), they are relatively
as the most important measurement of PROMs (Terwee et al., unable to conduct an accurate self-assessment of themselves. Fur-
2018). A lack of high methodological quality of content valid- thermore, self-neglect is a life choice by some older people, and
ity can affect all other measurement properties (Terwee et al., they may be reluctant to report the real situation to avoid embar-
2018). Conversely, a rigorous and valid instrument with good con- rassment. Some other instruments are proxy-reported, and these
tent validity can contribute to the overall development of high- scales are answered by caregivers, family members, or profession-
quality assessment in self-neglect. However, the methodological als, whose scrutiny and knowledge of older adults are the main
qualities of content validity of all studies in this systematic re- judgment references. However, proxy-reported tools lack the capa-
view were “doubtful” or “inadequate.” No studies adhered to the bility to detect the personal attributes on the self-neglect of older
minimum 30 experts for content validity assessment suggested by adults. The reason is that the contents are considerably focused
COSMIN Risk of Bias checklist (Mokkink et al., 2018a). A com- on the measurement of external environments and behaviors that
mon phenomenon is a doubtful and inadequate methodological can be observed by others. Second, one of the inclusion criteria
quality of content validity according to numerous instrument sys- of some studies that used self-reported instrument (Abrams et al.,
tematic reviews (Gondivkar et al., 2019; Charette et al., 2020; 2018; Wang, 2018; Peng et al., 2020) is that older adults should
8 M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070

be cognitively intact. As understood, the self-neglect phenomenon Charette, M., McKenna, L.G., Maheu-Cadotte, M.A., Deschênes, M.F., Ha, L.,
is particularly common among older adults with cognitive dete- Merisier, S., 2020. Measurement properties of scales assessing new graduate
nurses’ clinical competence: a systematic review of psychometric properties. Int.
rioration. Exclusion of older adults with impaired cognitive func- J. Nurs. Stud. 110, 103734. doi:10.1016/j.ijnurstu.2020.103734.
tion may contribute to underestimation and underrecognition of Clark, A.N., Mankikar, G.D., Gray, I., 1975. Diogenes syndrome. a clinical study of
the self-neglect of older population. Therefore, we suggest that gross neglect in old age. Lancet 1 (7903), 366–368. doi:10.1016/s0140-6736(75)
91280-5.
self-reported and proxy-reported methods may be considered to Day, M.R., McCarthy, G., 2016. Self-Neglect: development and Evaluation of a Self-
be combined in one instrument with two sessions. In addition, Neglect (SN-37) measurement instrument. Arch. Psychiatr. Nurs. 30 (4), 480–
older adults with mild cognitive dysfunction should also be re- 485. doi:10.1016/j.apnu.2016.02.004.
Dong, X., 2016. Socio-demographic and socioeconomic characteristics of elder self-
tained as eligible participants when a self-neglect instrument is
neglect in an US Chinese aging population. Arch. Gerontol. Geriatr. 64, 82–89.
developed. doi:10.1016/j.archger.2016.01.007.
This systematic review has some limitations that should be Dong, X., Mendes de Leon, C.F., Evans, D.A., 2009a. Is greater self-neglect severity
associated with lower levels of physical function? J.f Aging & Health 21 (4),
noted. First, we only included studies published in English and
596–610. doi:10.1177/0898264309333323.
Chinese, thereby possibly resulting in missing some instruments Dong, X., Simon, M., 2016. Prevalence of elder self-neglect in a Chicago Chinese pop-
developed or translated in other languages. Second, although we ulation: the role of cognitive physical and mental health. Geriatr. Gerontol. Int.
conducted a systematic search strategy using the corresponding 16 (9), 1051–1062. doi:10.1111/ggi.12598.
Dong, X., Simon, M., Evans, D., 2013. Elder self-neglect is associated with increased
terms, some articles may still be left out. Third, minimal infor- risk for elder abuse in a community-dwelling population: findings from the
mation on the measurement properties of cross-cultural valid- Chicago Health and Aging Project. J Aging Health 25 (1), 80–96. doi:10.1177/
ity/measurement invariance, measurement error, criterion validity, 0898264312467373.
Dong, X., Simon, M., Fulmer, T., Mendes de Leon, C.F., Rajan, B., Evans, D.A., 2010a.
and responsiveness can be obtained from the majority of the re- Physical function decline and the risk of elder self-neglect in a community-
viewed instruments. dwelling population. Gerontologist 50 (3), 316–326. doi:10.1093/geront/gnp164.
Dong, X., Simon, M., Mendes de Leon, C., Fulmer, T., Beck, T., Hebert, L., Dyer, C.,
Paveza, G., Evans, D., 2009b. Elder self-neglect and abuse and mortality risk
5. Conclusions in a community-dwelling population. JAMA 302 (5), 517–526. doi:10.1001/jama.
2009.1109.
This systematic review provides a comprehensive overview of Dong, X., Simon, M.A., Evans, D.A., 2012a. Prevalence of self-neglect across gender,
race, and socioeconomic status: findings from the Chicago Health and Aging
the quality of measurement properties and methodological quality Project. Gerontology 58 (3), 258–268. doi:10.1159/0 0 0334256.
of self-neglect instruments for older adults. Among the eight in- Dong, X., Simon, M.A., Evans, D., 2012b. Elder self-neglect and hospitalization: find-
struments identified, none has demonstrated better quality than ings from the Chicago Health and Aging Project. J. Am. Geriatr. Soc. 60 (2), 202–
209. doi:10.1111/j.1532-5415.2011.03821.x.
any other. With this review, we recommend that future studies Dong, X., Simon, M.A., Mosqueda, L., Evans, D.A., 2012c. The prevalence of
should consider COSMIN methodology (Mokkink et al., 2018a,b; elder self-neglect in a community-dwelling population: hoarding, hygiene,
Prinsen et al., 2018; Terwee et al., 2018) as an instrument develop- and environmental hazards. J. Aging Health 24 (3), 507–524. doi:10.1177/
0898264311425597.
ment guideline. Self-reported and proxy-reported methods should Dong, X., Simon, M.A., Wilson, R.S., Mendes de Leon, C.F., Rajan, K.B., Evans, D.A.,
be adopted in one instrument to obtain the entire and accurate 2010b. Decline in cognitive function and risk of elder self-neglect: finding from
picture of self-neglect in older adults. the Chicago Health Aging Project. J. Am. Geriatr. Soc. 58 (12), 2292–2299. doi:10.
1111/j.1532-5415.2010.03156.x.
Dong, X., Xu, Y., Ding, D., 2017. Elder Self-neglect and Suicidal Ideation in an U.S.
Declaration of Competing Interest Chinese Aging Population: findings From the PINE Study. J. Gerontol. A Biol. Sci.
Med. Sci. 72 (suppl_1), S76–S81. doi:10.1093/gerona/glw229.
Floyd, F.J., Widaman, K.F., 1995. Factor analysis in the development and refinement
None. of clinical assessment instruments. Psychol. Assess. 7 (3), 286–299. doi:10.1037/
1040-3590.7.3.286.
Gentizon, J., Hirt, J., Jaques, C., Lang, P.O., Mabire, C., 2021. Instruments assessing
Funding sources medication literacy in adult recipients of care: a systematic review of mea-
surement properties. Int. J. Nurs. Stud. 113, 103785. doi:10.1016/j.ijnurstu.2020.
This work was supported by the Fundamental Research Funds 103785.
Gondivkar, S.M., Gadbail, A.R., Sarode, S.C., Gondivkar, R.S., Yuwanati, M., Sar-
for the Central Universities (Grant No. BMU2021YJ022). The funder
ode, G.S., Patil, S., 2019. Measurement properties of oral health related patient
did not play any role in the conduct or publication of the study. reported outcome measures in patients with oral cancer: a systematic review
using COSMIN checklist. PLoS ONE 14 (6), e0218833. doi:10.1371/journal.pone.
0218833.
Supplementary materials İlhan, B., Bahat, G., Saka, F., Kılıç, C., Merve Oren, M., Karan, M.A., 2018. A new
screening tool for self-neglect in community-dwelling older adults: iMSelf-
Supplementary material associated with this article can be neglect questionnaire. Aging Male 1–8. doi:10.1080/13685538.2018.1499083.
Iris, M., Conrad, K.J., Ridings, J., 2014. Observational measure of elder self-neglect. J.
found, in the online version, at doi:10.1016/j.ijnurstu.2021.104070. Elder Abuse Negl. 26 (4), 365–397. doi:10.1080/08946566.2013.801818.
Iris, M., Ridings, J.W., Conrad, K.J., 2010. The development of a conceptual model
References for understanding elder self-neglect. Gerontologist 50 (3), 303–315. doi:10.1093/
geront/gnp125.
Abrams, R.C., Lachs, M., McAvay, G., Keohane, D.J., Bruce, M.L., 2002. Predictors of Kafetz, K., Cox, M., 1982. Alcohol excess and the senile squalor syndrome. J. Am.
self-neglect in community-dwelling elders. Am. J. Psychiatry 159 (10), 1724– Geriatr. Soc. 30 (11), 706. doi:10.1111/j.1532-5415.1982.tb01984.x.
1730. doi:10.1176/appi.ajp.159.10.1724. Lee, M., Kim, K., 2014. Prevalence and risk factors for self-neglect among older
Abrams, R.C., Reid, M.C., Lien, C., Pavlou, M., Rosen, A., Needell, N., Eimicke, J., adults living alone in South Korea. Int. J. Aging Hum. Dev. 78 (2), 115–131.
Teresi, J., 2018. The Abrams geriatric self-neglect scale: introduction, valida- doi:10.2190/AG.78.2.b.
tion and psychometric properties. Int. J. Geriatr. Psychiatry 33 (1), e73–e84. Lien, C., Rosen, T., Bloemen, E.M., Abrams, R.C., Pavlou, M., Lachs, M.S., 2016. Narra-
doi:10.1002/gps.4718. tives of self-neglect: patterns of traumatic personal experiences and maladap-
Braye, S., Orr, D., Preston-Shoot, M., 2011. Conceptualising and responding to self- tive behaviors in cognitively intact older adults. J. Am. Geriatr. Soc. 64 (11),
neglect: the challenges for adult safeguarding. J. Adult Protect. 13 (4), 182–193. e195–e200. doi:10.1111/jgs.14524.
doi:10.1108/14668201111177905. Macmillan, D., Shaw, P., 1966. Senile breakdown in standards of personal and envi-
Burnett, J., Coverdale, J.H., Pickens, S., Dyer, C.B., 2006a. What is the association be- ronmental cleanliness. Br. Med. J. 2 (5521), 1032–1037. doi:10.1136/bmj.2.5521.
tween self-neglect, depressive symptoms and untreated medical conditions? J. 1032.
Elder Abuse Negl. 18 (4), 25–34. doi:10.1300/J084v18n04_04. May-Chahal, C., Antrobus, R., 2011. Engaging community support in safeguarding
Burnett, J., Regev, T., Pickens, S., Prati, L.L., Aung, K., Moore, J., Dyer, C.B., 2006b. adults from self-neglect. Br. J. Soc. Work 42 (8), 1478–1494. doi:10.1093/bjsw/
Social networks: a profile of the elderly who self-neglect. J. Elder Abuse Negl. bcr158.
18 (4), 35–49. doi:10.1300/J084v18n04_05. Middlebrook, N., Rushton, A.B., Abichandani, D., Kuithan, P., Heneghan, N.R., Falla, D.,
Cai, Z., 2015. A preliminary study aboutelderly self-neglect in China and ques- 2021. Measures of central sensitization and their measurement properties in
tionnaire compilation. Sichuan Normal University [Unpublished master disser- musculoskeletal trauma: a systematic review. Eur. J. Pain 25 (1), 71–87. doi:10.
tation]. 1002/ejp.1670.
M. Qian, Y. Shi, J. Lv et al. / International Journal of Nursing Studies 123 (2021) 104070 9

Mokkink, L.B., Terwee, C.B., Patrick, D.L., Alonso, J., Stratford, P.W., Knol, D.L., Strauss, M.E., Smith, G.T., 2009. Construct validity: advances in theory and method-
Bouter, L.M., de Vet, H.C.W., 2010. The COSMIN study reached international con- ology. Annu. Rev. Clin. Psychol. 5, 1–25. doi:10.1146/annurev.clinpsy.032408.
sensus on taxonomy, terminology, and definitions of measurement properties 153639.
for health-related patient-reported outcomes. J. Clin. Epidemiol. 63 (7), 737–745. Terwee, C.B., Mokkink, L.B., Knol, D.L., Ostelo, R.W., Bouter, L.M., de Vet, H.C., 2012.
doi:10.1016/j.jclinepi.2010.02.006. Rating the methodological quality in systematic reviews of studies on measure-
Mokkink, L.B., de Vet, H.C.W., Prinsen, C.A.C., Patrick, D.L., Alonso, J., Bouter, L.M., ment properties: a scoring system for the COSMIN checklist. Qual. Life Res. 21
Terwee, C.B., 2018a. COSMIN Risk of Bias checklist for systematic reviews of (4), 651–657. doi:10.1007/s11136-011-9960-1.
Patient-Reported Outcome Measures. Qual. Life Res. 27 (5), 1171–1179. doi:10. Terwee, C.B., Prinsen, C.A.C., Chiarotto, A., Westerman, M.J., Patrick, D.L., Alonso, J.,
1007/s11136- 017- 1765- 4. Bouter, L.M., de Vet, H.C.W., Mokkink, L.B., 2018. COSMIN methodology for eval-
Mokkink, L.B., Prinsen, C.A.C., Patrick, D.L., Alonso, J., Bouter, L.M., de Vet, H.C.W., uating the content validity of patient-reported outcome measures: a Delphi
Terwee, C.B., 2018b. COSMIN Methodology For Systematic Reviews of Patient- study. Qual. Life Res. 27 (5), 1159–1170. doi:10.1007/s11136- 018- 1829- 0.
Reported Outcome Measures (PROMs) User Manual https://www.cosmin. Wang, H., 2018. Research on Chinese version of the elder self-neglect assessment
nl/wp- content/uploads/COSMIN- syst- review- for- PROMs- manual_version- 1_ scale and its application. Hangzhou Normal University [Unpublished master dis-
feb- 2018- 1.pdf. sertation].
National Center on Elder Abuse Website, 2021. Types of Abuse ] Retrieved from Xiao, S., 1994. Theoretical foundation and research application of Social Support
https://ncea.acl.gov/Suspect-Abuse/Abuse-Types.aspx#self . Rating Scale (SSRS). J. Clin. Psychol. Med. 98–100. http://www.wanfangdata.com.
Peng, C., Zeng, T., Wu, M., Yuan, M., Chen, Y., 2020. Development of the self-neglect cn/details/detail.do?_type=perio&id=QK199400672019.
questionnaire for the aged and its reliability and validity. Chin J. Mod. Nurs. 26 Yu, M., Gu, L., Jiao, W., Xia, H., Wang, W., 2019. Predictors of self-neglect among
(02), 178–182. doi:10.3760/cma.j.issn.1674-2907.2020.02.008. community-dwelling older adults living alone in China. Geriatr. Nurs. 40 (5),
Prinsen, C.A.C., Mokkink, L.B., Bouter, L.M., Alonso, J., Patrick, D.L., de Vet, H.C.W., 457–462. doi:10.1016/j.gerinurse.2019.02.002.
Terwee, C.B., 2018. COSMIN guideline for systematic reviews of patient- Yu, M., Gu, L., Shi, Y., Wang, W., 2020. A systematic review of self-neglect and its
reported outcome measures. Qual. Life Res. 27 (5), 1147–1157. doi:10.1007/ risk factors among community-dwelling older adults. Aging Ment Health 1–12.
s11136- 018- 1798- 3. doi:10.1080/13607863.2020.1821168.
Reed, P.G., Leonard, V.E., 1989. An analysis of the concept of self-neglect. ANS Adv. Zhao, Y., 2017. Assessing self-neglect on elderly, Exploring its impact factors and the
Nurs. Sci. 12 (1), 39–53. doi:10.1097/0 0 012272-198910 0 0 0-0 0 0 07. impact on their quality of life in rural China. Anhui Medical University [Unpub-
Roe, P.F., 1977. Self-neglect. Age Ageing 6 (3), 192–194. doi:10.1093/ageing/6.3.192. lished doctoral dissertation].

You might also like