You are on page 1of 9

Brain Injury, June 2012; 26(6): 844–852

Preliminary validation of the Spanish version of the Frontal


Systems Behavior Scale (FrSBe) using Rasch analysis

ALFONSO CARACUEL1,2, ANTONIO VERDEJO-GARCÍA1,2, MARÍA JOSÉ


FERNÁNDEZ-SERRANO1, LAURA MORENO-LÓPEZ1, SANDRA SANTAGO-
RAMAJO1, IGNACIO SALINAS-SÁNCHEZ3, & MIGUEL PÉREZ-GARCÍA1,2
1
Departamento de Personalidad, Evaluación y Tratamiento Psicológico, University of Granada, Granada, Spain,
2
Institute of Neurosciences F. Olóriz, University of Granada, Granada, Spain, and 3Virgen de las Nieves Hospital,
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

Granada, Spain

(Received 11 January 2011; revised 16 June 2011; accepted 22 June 2011)

Abstract
For personal use only.

Primary objective: To explore the construct validity of the Spanish version of the Frontal Systems Behavioral Scale (FrSBe)
using Rasch modelling.
Methods: Item responses of 245 Spanish subjects were analysed using Rasch analysis: self-rating of 65 participants with
TBI or stroke (sample A), family-rating of the same 65 participants (sample B) and self-rating of 115 healthy individuals
(sample C).
Results: After removing or grouping several problematic items, the Apathy and the Executive Dysfunction sub-scales
were found to be valid measures for samples A and B and the Disinhibition sub-scale was valid for samples B and C. Person
Separation Index of reliability of sub-scales was greater than 0.83 for sample B and 0.72 for A and C. All items showed
disordered threshold categories in samples A and B and five items were ordered in sample C.
Conclusions: With a few modifications, the sub-scales of the FrSBe-Spanish version are adequate measures for the
assessment of the behavioural syndromes derived from frontal systems dysfunction in persons with brain injury. The family-
rating form is preferable to the self-rating form. Only the Disinhibition scale is a valid measure for the behavioural
assessment of the normal population. A reduction of response categories is suggested.

Keywords: FrSBe, Rasch analysis, prefrontal cortex systems, apathy, disinhibition, executive dysfunction, frontal behaviours,
traumatic brain injury, stroke

Introduction executive dysfunction is a major issue for neuropsy-


chological practice in the area of acquired brain
The prevalence rate of traumatic brain injury (TBI)
in the US is estimated to be 1893 out of 100 000 [1]. injury (ABI). The Frontal Systems Behavior Scale
Executive functions, which are importantly endorsed (FrSBe) [4], formerly known as the Frontal Lobe
by structure and function of the frontal lobes, Personality Scale (FloPS) [5], is a rating scale that
are highly sensitive to the brain damage resulting was designed to provide an estimation of overall
from traumatic injury [2]. Furthermore, 39% behavioural disturbances related to prefrontal sys-
of people after stroke have disorders of executive tems damage (total score) and three independent
functioning [3]. Therefore, the assessment of measures of specific behavioural syndromes

Correspondence: Alfonso Caracuel, PhD, Facultad de Psicologı́a, Campus de Cartuja, 18071, Granada, Spain. E-mail: acaracuel@ugr.es
ISSN 0269–9052 print/ISSN 1362–301X online ß 2012 Informa UK Ltd.
DOI: 10.3109/02699052.2012.655365
Validation of the FrSBe-Spanish version 845

associated with damage to particular prefrontal- substance abusers and healthy control participants.
subcortical (PFC) systems [6–8]. The scale is However, the scores of individuals with ABI and
composed of 46 items, which are grouped into healthy controls were moderately lower than those
the following three sub-scales: Apathy (14 items, collected for their corresponding groups in the
FrSBe-Ap), Disinhibition (15 items, FrSBe-Dis) and original norms. This was attributed to cultural
Executive dysfunction (17 items, FrSBe-Exe). There differences between Spanish and US samples [36].
is one self-rating form that is completed by the In spite of these positive findings regarding the
patient and one family form that is completed by scale’s reliability, further analysis that employs novel
an informant. Both forms assess behaviour before psychometric tools may improve the construct
(i.e. premorbid or baseline) and after frontal systems validity of the FrSBe-Spanish version. Since Rasch
damage occurred (i.e. morbid or current state). The analysis tests several measurement requirements
manual provides normative data (T scores) from a (construct validity, unidimensionality, appropriate-
sample of 436 healthy adults and their relatives [4]. ness of response categories) [37], it is a highly
The FrSBe has been used for the behavioural recommended method of refining measurement
assessment of a number of disorders involving tools [38]. Although the FrSBe is widely used
damage to PFC systems [9, 10], including frontal in both clinical and research settings, to date, no
and non-frontal ABI [5, 11, 12], Alzheimer’s studies have attempted to apply Rasch analysis to
Disease [13], Parkinson’s Disease [14, 15], multiple this scale. There is considerable scarcity of specific
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

sclerosis [16–18], amyotrophic lateral sclerosis [19] measures to assess executive dysfunction in Spanish
and substance use disorders [20–23]. Although it speakers. Some of the measures used in English-
was designed to be administered to neurological speaking countries have been translated, but they
samples, the scale has also been applied to obsessive mostly lack studies on psychometric properties and
compulsive disorder [24], schizophrenia [25, 26] validation. The aim of the current study was to
and secondary psychopathy [27]. Its use has also explore the construct validity of the Spanish version
spread among healthy populations for the assess- of the FrSBe using Rasch analysis in samples of
For personal use only.

ment of the risk of developing alcohol use disorders, participants with brain injury and the normal
maladaptative eating behaviours, financial decisions, population.
empathy and metacognitive awareness [28–35].
Concerning the reliability of the sub-scales,
the manual reports that the Cronbach’s alpha Methods
coefficients in the normal population range between
Participants and settings
0.78–0.87 for the family form and between 0.72–
0.79 for the self-rating form. Slightly greater  values Data from the following three samples were ana-
were found for samples of neurological patients, with lysed: (A) Sixty-five participants (14 women) with
the FrSBe-Exe sub-scale showing the greatest ABI (45 TBI, 20 Stroke) aged 15–65 years old
reliability indexes [4, 9]. With regard to validity, (M ¼ 30.11; SD ¼ 12.12) with 8–16 years of educa-
a factor analysis in a normative sample yielded tion (M ¼ 10.23; SD ¼ 2.75). The average time
support to the validity of the three scales. However, incurred since their injury was 22.4 months
items 33 and 43 loaded onto FrSBe-Ap, which is not (SD ¼ 20.55 months). (B) Sixty-five relatives of the
the originally assigned sub-scale for these items [5]. sample A participants (10 men) aged 25–67 years
In addition, a factor analysis of the family-rating old (M ¼ 50.55; SD ¼ 22.34) with 4–16 years of
form in a large neurological patient sample found education (M ¼ 8.23; SD ¼ 3.55). (C) One hundred
that six items (items 6, 23, 33, 36, 40 and 43) loaded and fifteen healthy participants (17 women) aged
onto a factor other than the corresponding sub-scale 18–50 years (M ¼ 30.11; SD ¼ 8.48) with 8–17 years
[10]. Both series of items were maintained in their of education (M ¼ 12.25; SD ¼ 2.65).
original scales, but the authors suggested that some The selection criteria for sample A were:
revision or elimination of specific items may be (i) documented moderate–severe TBI or stroke
warranted to refine the scales and enhance their (i.e. initial Glasgow Coma Scale 13; post-traumatic
validity [9]. amnesia greater than 24 hours or a period of
A Spanish version of the FrSBe, which was unconsciousness longer than 6 hours); (ii) time
approved by the authors and the editors of the incurred since injury over 30 days; (iii) minimum age
scale, has been used for the assessment of persons of 15 years; (iv) the absence of severe language
with ABI and substance abusers in Spanish samples comprehension problems; (v) resides at home and
[22, 36]. The self-rating form of this Spanish version substantially self-reliant in daily life activities; and
had similar reliability  values as those found in (vi) availability of a relative who was willing and
US populations. Regarding validity, this version capable of completing the scale. A consecutive series
discriminated between persons with frontal ABI, of 65 patients who met the selection criteria were
846 A. Caracuel et al.

recruited from the outpatient rehabilitation depart- in the category below by a factor of e1 ¼ 2.71 [42].
ment of the Virgen de las Nieves Hospital (Granada, Construct validity under the Rasch analysis is
Spain). They completed the scale during the first determined by examining the hierarchy of the
appointment as part of the typical assessment items in the latent construct as well as by evaluating
protocol. Healthy individuals were selected by its fit to the model [43]. Steps in conducting a Rasch
means of local advertisements and using snowball analysis and its interpretations have been explained
or chain sampling among adults from the commu- in detail by others [37, 44–46]. A brief explanation
nity. The selection criteria for the health sample of the key features of the Rasch analysis that
included the absence of a history of mental retarda- grounded the present study can be found in
tion, learning disability, psychiatric disorders, sub- Kersten et al. [47]. Rasch analysis was performed
stance abuse, neurological disorders or systemic using RUMM2020 software [48] and descriptive
diseases that might affect the central nervous statistics were calculated using SPSS V17.0 for
system. Individuals from samples A and C com- Windows.
pleted the scale by rating their own current
behaviour, whereas sample B participants rated the
current behaviour of their relatives. All participants Results
read, understood and signed an informed consent
prior to completing the scale in the presence of, and Rasch analysis of the whole scale
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

if necessary with the assistance of, a clinician. Inspection of the data revealed that only a few
missing data points were spread throughout the
Materials scale, with frequencies lower than 2% for all items.
A Spanish version of the Frontal Systems Behavior Separate analysis for each sample were conducted
Scale (FrSBe) [4] that was adapted and reproduced for the 46 items of the whole scale. The Rating
by special permission of the publisher (Psychological Scale version of the Rasch model was adopted
because there were less than 10 observations in
For personal use only.

Assessment Resources, Inc.) was used. A useful


abbreviation of the original items can be found some response categories [49]. Considering the non-
elsewhere [10]. Participants respond using a Likert significant summary chi-square item-trait interac-
scale that ranges from 1–5 (1 ¼ almost never, tion, a good overall fit to the model was found for the
2 ¼ seldom, 3 ¼ some times, 4 ¼ frequently and three samples. However° the whole scale showed
5 ¼ almost always). Items are visually divided into multidimensionality in all samples, then, this analy-
two sets. The first set (items 1–32) asks about sis was not reported and subsequent analyses were
negative or maladaptative behaviours and the second conducted examining the three sub-scales separately.
set (items 33–46) is about positive or adaptative
behaviours. Ratings from the second set are reverse- Rasch analyses of the sub-scales for each sample
scored; therefore, higher ratings indicate a greater
Sample A: Participants with ABI. The five analyses
frequency of abnormal frontal systems behaviour.
conducted are listed in Table I. The FrSBe-Ap sub-
scale fits to the model after deleting item 11 and
Analysis
grouping items 41 and 42 into one item. This
The Rasch model [39] is a probabilistic model of grouping was done because these two items showed
measurement within the Item Response or Latent high residual correlations, indicating local response
Trait Theory. Based on this model, only (i) the dependency. This grouping strategy failed for items
amount of symptom expressed by the item and 11 and 39 and, thus, the former was removed,
(ii) the subject’s disorder determine the probabilities improving the fit of the FrSBe-Ap. The FrSBe-Dis
of category choice. For this model, the probability sub-scale showed fit but its unidimensionality was
that a person endorses an item is a logistic questionable because 6.15% of t-test was significant
function of the difference between these two para- at 95% confidence (italics in Table I), while the
meters estimated from the matrix of responses [40]. criterion is typically set at a maximum of 5%.
People with low syndrome severity should endorse Regarding the FrSBe-Exe, after deleting item 36, the
item categories connected to low symptom severity. sub-scale achieved an overall fit (non-significant p
Rasch analysis tests the extent to which the observed after Bonferroni adjustment). In relation to the
pattern of responses fits the pattern expected by the reliability of the scales using Rasch analysis, the
probabilistic model. Items and persons are calibrated Person Separation Index (PSI) is an estimate
and placed on a common scale, with the logit as the that may be interpreted in a manner similar to
unit [41]. One logit can be defined as the increase Cronbach’s alpha reliability coefficient. A low PSI,
in the subject’s disorder that increases the prob- ranging from 0.73–0.74, was found for the three sub-
ability of responding in a given category rather than scales.
Validation of the FrSBe-Spanish version 847

Table I. Summary of results of the Rasch analyses of the FrSBe for participants with ABI (sample A).

Correlated
Item-trait Deleted or item Item Fit Person Fit
interaction grouped residuals Residual Residual Reliability Unidimensionality
Sub-scale #Analysis 2 (Df) p items >0.30 Mean (SD) Mean (SD) PSI Sig t-test CI

Apathy
(n ¼ 65) 1st 21.01 (14) 0.09 11 (deleted) 11–39 0.176 (1.2) 0.170 (1.3) 0.70 2.31% (6.1–22.7)
(n ¼ 65) 2nd 13.33 (12) 0.34 41 þ 42 41–42 0.470 (0.88) 0.079 (1.1) 0.74 4.62% (1.5–12.7)
(grouped)
Disinhibition
(n ¼ 65) 1st 21.79 (15) 0.11 0.041 (1.2) 0.185 (1.3) 0.73 6.15% (1.9–15.2)
Executive dysfunction
(n ¼ 65) 1st 31.9 (17) 0.01 36 (deleted) 0.230 (1.6) 0.149 (1.5) 0.71 12.31% (6.1–22.7)
(n ¼ 65) 2nd 29.03 (16) 0.02* 0.224 (1.4) 0.178 (1.5) 0.74 4.62% (1.5–12.7)

# Analysis: number of each analysis. Item-trait interaction, 2, (Df), p: summary chi-square for all items in the sub-scale, indicating the
overall fit to the model; Df: Degree of freedom. Deleted or grouped items: deleted items for item misfit or grouped into a super-item.
Correlated item residuals >0.30: items showing residual correlations above 0.3. Item Fit Residual, Mean and SD: summary of item fit
statistics; Person Fit Residual, Mean and SD: summary of person fit statistics. Reliability PSI: Person Separation Index of reliability.
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

Unidimensionality, Sig t-test CI: % of significant t-test at 95% of confidence and Confidence Interval. * non-significant p after Bonferroni
adjustment.

Table II. Summary of results of the Rasch analyses of the FrSBe for relatives (sample B).

Correlated
For personal use only.

Item-trait item Item Fit Person Fit


interaction Deleted residuals Residual Residual Reliability Unidimensionality
Sub-scale #Analysis 2 (Df) p items >0.30 Mean (SD) Mean (SD) PSI Sig t-test CI

Apathy
(n ¼ 64) 1st 18.48 (14) 0.18 0.009 (1.4) 0.088 (1.1) 0.87 3.13% (0.8–10.7)
Disinhinbition
(n ¼ 65) 1st 30.89 (15) 0.009 43 0.213 (1.4) 0.147 (1.1) 0.79 6.15% (1.9–15.2)
(n ¼ 64) 2nd 25.94 (14) 0.2 0.170 (1.3) 0.151 (1.1) 0.83 3.13% (0.8–10.7)
Executive dysfunction
(n ¼ 65) 1st 22.71 (17) 0.15 0.51 (1.0) 0.136 (1.3) 0.86 4.62% (1.5–12.7)
2
# Analysis: number of each analysis. Item-trait interaction,  , (Df), p: summary chi-square for all items in the sub-scale, indicating the
overall fit to the model; Df: Degree of freedom. Deleted items: deleted for item misfit. Correlated item residuals >0.30: items showing
residual correlations above 0.3. Item Fit Residual, Mean and SD: summary of item fit statistics; Person Fit Residual, Mean and SD:
summary of person fit statistics. Reliability PSI: Person Separation Index of Reliability. Unidimensionality, Sig t-test CI: % of significant
t-test at 95% of confidence and Confidence Interval.

obtained adequate unidimensionality. Only the


FrSBe-Dis showed fit and unidimensionality after
Sample B: Relatives of participants with ABI. The
deleting item 43.
four analyses conducted are listed in Table II. The
three sub-scales achieved all of the Rasch model
requirements after deleting item 43 due to misfit.
Hierarchy of the items on the sub-scales. Rasch
The PSI ranged between 0.83–0.87. This indicates
analysis calibrates items based on endorsement
that persons with ABI can be sorted into three
probability and person disorder. Thus, the items
separate groups of dysfunction severity (mild,
that are easier to endorse are the most representative
moderate and severe) using the FrSBe [43].
of the latent construct and are located on the side
of the higher negative location of the logit scale
Sample C: Healthy participants. The seven analyses (see Figures 1–3). The opposite location indicates
conducted are listed in Table III. Despite the that the item had a lower probability of endorse-
changes that were made in the FrSBe-Ap (item 1 ment, representing higher disorder severity. Along
deleted; items 41 and 42 grouped) and the FrSBe- with the fit to the model, this hierarchy of items
Exe (items 17 and 33 deleted), neither sub-scale was used to examine the construct validity of the
848 A. Caracuel et al.

Table III. Summary of results of the Rasch analyses of the FrSBe for control participants (sample C).

Correlated
Item-trait Deleted or item Item Fit Person Fit
interaction grouped residuals Residual Residual Reliability Unidimensionality
Sub-scale #Analysis 2 (Df) p items >0.30 Mean (SD) Mean (SD) PSI Sig t-test CI

Apathy
(n ¼ 114) 1st 37.2 (15) 0.0006 1 (deleted) 41–42 0.107 (0.97) 0.237 (0.97) 0.72 7.89% (4–14.5)
(n ¼ 114) 2nd 16 (12) 0.16 41 þ 42 0.170 (0.69) 0.210 (0.74) 0.71 6.14% (2.7–12.3)
(grouped)
Disinhinbition
(n ¼ 114) 1st 36.12 (15) 0.001 43 (deleted) 0.125 (0.94) 0.194 (0.87) 0.73 6.14% (2.7–12.3)
(n ¼ 114) 2nd 20.69 (14) 0.1 0.148 (0.92) 0.205 (0.85) 0.72 1.7% (1.6–4.8)

Executive dysfunction
(n ¼ 115) 1st 14.15 (17) 0.6 33 (deleted) 0.006 (1.7) 0.207 (1.1) 0.71 7.83% (4–14.3)
(n ¼ 115) 2nd 16.93 (16) 0.3 17 (deleted) 0.043 (1.3) 0.207 (1.1) 0.72 6.96% (3.3–13.3)
(n ¼ 114) 3rd 12.20 (15) 0.6 0.122 (1.1) 0.253 (1.1) 0.75 7.02% (3.4–13.4)

#Analysis: number of each analysis. Item-trait interaction, 2, (Df), p: summary chi-square for all items in the sub-scale, indicating the
overall fit to the model; Df: Degree of freedom. Deleted or grouped items: deleted items for item misfit or grouped into a super-item.
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

Correlated item residuals >0.30: items showing residual correlations above 0.3. Item Fit Residual, Mean and SD: summary of item fit
statistics; Person Fit Residual, Mean and SD: summary of person fit statistics. Reliability PSI: Person Separation Index of reliability.
Unidimensionality, Sig t-test CI: % of significant t-test at 95% of confidence and Confidence Interval. *non-significant p after Bonferroni
adjustment.

sub-scale. There was great concordance on item Differential Item Functioning (DIF). DIF indicates
location between the three samples; therefore, that different sub-groups within the sample respond
combined results from all samples are reported. in a different manner to an individual item, despite
For personal use only.

On the FrSBe-Ap, items 41, 42, 8, 14, 29, 1 and equal severity of the disorder being measured. Sub-
21 achieved the highest negative locations, whereas groups of participants were coded according to the
item 16 had the highest positive location. On the original normative data of the FrSBe [4]: gender,
FrSBe-Dis, the highest negative locations were for education (12 and >12 years), age (39 and >39
items 2, 4, 6, 45, 18, 12, 32 and 10, whereas the years) and diagnosis (only for the ABI sample: TBI
opposite was found for item 31. On the FrSBe-Exe, or Stroke). An ANOVA of person-item deviation
items 3, 25, 36, 7, 13, 37 and 35 were on the residuals with the above-mentioned characteristics
negative side of the latent construct and item 20 had and class intervals as factors was conducted [37]. No
the highest positive location. item showed DIF by the factors used.

Targeting. Targeting of the sub-scales to the sam-


Response categories. In order to determine whether ples was examined on the logit scale using compar-
the categorization worked as intended, threshold isons of the items and person locations. The best
ordering was inspected. A threshold is the transition targeting was found for the FrSBe-Exe sub-scale and
between two consecutive response categories. For the worst for the FrSBe-Ap sub-scale. Figures 1–3
each item, the expectation is that as the patient’s show the targeting of the FrSBe-Exe data for the
disorder severity increases, the probability of select- three samples. Targeting was most successful for the
ing each category increases in an ordered fashion relatives and least successful for the healthy
[50] from ‘almost never’ to ‘almost always’. participants.
However, all items showed disordered threshold
categories in samples A and B, and only five items
were ordered for sample C. This can typically be Discussion
managed by collapsing adjacent categories. Different The first aim of the study was to explore the
re-scoring patterns were attempted by reducing the construct validity of the Spanish version of the
number of response categories from five to four. FrSBe and its sub-scales using Rasch analysis. These
However, most items continued to show disordered analyses were used to describe item response
thresholds. Finally, a 3-point response scale showed characteristics of the self-ratings of persons with
adequate ordering in most of the items. These brain injury, relatives’ ratings of these participants
changes did not improve the overall fit of the sub- and the self-ratings of healthy individuals.
scales; therefore, these analyses are not detailed in Theoretically, more than one latent construct is
the manuscript. expected in the FrSBe [6]. This has been confirmed
Validation of the FrSBe-Spanish version 849
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

Figure 1. Person-threshold map: Distribution of participants with ABI using self-rating form (upper part of the graph) and item thresholds
for the FrSBe-Exe subscale (lower part of the graph).
For personal use only.

Figure 2. Person-threshold map: Distribution of participants with ABI rated by their relatives (upper part of the graph) and item thresholds
for the FrSBe-Exe subscale (lower part of the graph).

using the Rasch model and, thus, the whole scale changes were needed within each sub-scale in order
cannot be considered a unidimensional instrument. to achieve both a perfect fit and unidimensionality.
The main implication of this is that a sum-score of Some of these proposed changes were previously
the 46 items included in the FrSBe does not suggested in the literature. First, during the process
constitute a valid and meaningful measure. Rather of development of the original scale, an independent
than an overall score, Rasch analysis supports the expert rater sorted most of the items into the same
use of a behavioural profile [51] of frontal systems sub-scales proposed by the authors, with the excep-
dysfunction formed by the scores of the three sub- tion of items 11, 20, 31, 33, 34, 35 and 43. Then, a
scales. subsequent factor analysis in a normative sample
The construct validity of the sub-scales for persons showed that five of these items were correctly
with brain injury is supported by the results from assigned by the authors, but items 33 and 43 loaded
Rasch analysis, with the exception of the self-rating onto a sub-scale other than the originally assigned
form of the Disinhibition sub-scale. However, some sub-scale [5]. The current Rasch analysis also found
850 A. Caracuel et al.
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

Figure 3. Person-threshold map: Distribution of healthy participants (upper part of the graph) and item thresholds for the FrSBe-Exe
subscale (lower part of the graph).

that several items (items 1, 11, 17, 33, 36 or 43) fail to these items reflect pathognomonic signs of frontal
For personal use only.

fit to the model. These results raise concern about systems disorder, including items 31 (find that food
potential problems with the coherence between has no taste or smell), 20 (make up fantastic stories when
the content of the item and the latent trait [52]. unable to remember something) and 16 (lose control of
The deletion of these items improved unidimension- my urine or bowels and it doesn’t seem to bother me).
ality and reliability of the three sub-scales, supporting This excessive specificity might be problematic
their poor contribution to the latent traits. However, for targeting the sub-scales to healthy or non-
several hypotheses might explain the misfits found neurological populations (see Figure 3).
across samples. For example, problems derived from Regarding the index of reliability, only the
unclear and subjective content, negative wording or relatives’ ratings had a PSI greater than 0.80 to
the use of more than one statement might impact on adequately classify syndrome severity into the three
the items’ behaviour. Furthermore, since grouping meaningful groups of mild, moderate and severe.
items with lack of local independency improved the fit Taking into account construct validity, reliability
of the Apathy sub-scale, it was suggested to reword and targeting of the authorised FrSBe-Spanish
items 41 (get involved with activities spontaneously) version, the family-rating form achieved all require-
and 42 (do things without being requested to do so) into ments of the Rasch model of measurement
a single item. after deleting item 43 (s/he is sensitive to the needs
The construct validity of the sub-scales for normal of other people). There was no DIF by gender,
populations was supported only for the Disinhibition age, education or diagnostic, further supporting the
sub-scale. Unidimensionality for the Apathy and psychometric properties of the scale.
Executive dysfunction sub-scales was not achieved. However, with respect to response categories,
In these healthy participants, some behaviours 41 items from the healthy participants’ sample
contained in these sub-scales may be connected showed disordered thresholds. This lack of order
to dimensions other than the functioning of the indicates that participants failed to use the 5-point
prefrontal cortex systems. scale in a manner that is consistent with the metric
The construct validity of the three sub-scales was estimate of the underlying construct [37]. The
also supported by the hierarchy of items within each fact that, similar to persons with brain injury,
sub-scale. All items on the negative side of the logit healthy individuals’ responses showed disordered
scales were the most representative and common in responses indicates that this limitation of the scale
clinical practice of each latent construct. As further is not linked to the degree of brain damage-
support, several infrequent items fell on the positive related disturbance. Threshold disorder may indi-
extreme of the logit scale and these are the typical cate that more categories exist in the scale than
symptoms of the greatest dysfunctions. Some of are needed to describe the construct [53]. As
Validation of the FrSBe-Spanish version 851

recommended by some authors [52], simplifying the Declaration of Interest: The authors report no
response format can be a useful strategy for conflicts of interest. The authors alone are respon-
improving the precise assessment of behaviour. sible for the content and writing of the paper.
These preliminary findings may yield relevant
clinical and psychometric implications. The FrSBe-
SA is the only tool for the assessment of executive
References
functioning in Spanish individuals with ABI that
has demonstrated fulfilment of the stringent valida- 1. Tagliaferri F, Compagnone C, Korsic M, Servadei F,
tion criteria used by the Rasch analysis. Because Kraus J. A systematic review of brain injury epidemiology
in Europe. Acta Neurochirurgica 2006;148:255–268.
executive dysfunction is one of the most common
2. Stuss DT, Levine B. Adult clinical neuropsychology: Lessons
problems experienced by ABI sufferers, this scale from studies of the frontal lobes. Annual Review of
guarantees an appropriate clinical assessment for Psychology 2002;53:401–433.
a substantial amount of potential Spanish-speaking 3. Nys GMS, van Zandvoort MJE, de Kort PLM, Jansen BPW,
clients. The FrSBe-SA is also a valid measure for the de Haan EHF, Kappelle LJ. Cognitive disorders in acute
stroke: Prevalence and clinical determinants. Cerebrovascular
assessment of rehabilitation outcomes, such that
Disease 2007;23:408–416.
it may allow carrying out comparative studies of 4. Grace J, Malloy PF. Frontal Systems Behavior Scale (FrSBe).
results of rehabilitation programmes implemented in Professional manual. Lutz, FL: Psychological Assessment
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

different countries where the instrument is Resources, Inc; 2001.


available [54]. 5. Grace J, Stout JC, Malloy PF. Assessing frontal lobe
behavioral syndromes with the Frontal Lobe Personality
A number of limitations of this study must be Scale. Assessment 1999;6:269–284.
addressed in future research endeavours. Certain 6. Cummings JL. Frontal-subcortical circuits and human
aspects of the results should be replicated using behavior. Archives of Neurology 1993;50:873–880.
a larger sample size. For instance, the absence of 7. Masterman DL, Cummings JL. Frontal-subcortical circuits:
DIF by gender or diagnosis should be replicated The anatomic basis of executive, social and motivated
behaviors. Journal of Psychopharmacology 1997;11:
For personal use only.

in samples that include a greater number of females 107–114.


and participants with stroke. Future studies should 8. Tekin S, Cummings JL. Frontal-subcortical neuronal
also test a shortened Likert scale of three or four circuits and clinical neuropsychiatry: An update. Journal of
response categories, assess the construct validity of Psychosomatic Research 2002;53:647–654.
the premorbid rating form in neurological popula- 9. Malloy P, Grace J. A review of rating scales for measuring
behavior change due to frontal systems damage. Cognitive
tions or check DIF by treatment time. In addition, and Behavioral Neurology 2005;18:18–27.
it is important to note that the results were obtained 10. Stout JC, Ready RE, Grace J, Malloy PF, Paulsen JS. Factor
in a sample of Spanish speakers in Spain and, analysis of the Frontal Systems Behavior Scale (FrSBe).
therefore, replications with Latin-American popula- Assessment 2003;10:79–85.
11. Lane-Brown AT, Tate RL. Measuring apathy after traumatic
tions are warranted to further explore the cross-
brain injury: Psychometric properties of the Apathy
cultural validity of the scale. Future research should Evaluation Scale and the Frontal Systems Behavior Scale.
also test the design of different versions of the Brain Injury 2009;23:999–1007.
scale for individuals with ABI and their relatives or 12. Reid-Arndt SA, Nehl C, Hinkebein J. The Frontal Systems
informants. Behaviour Scale (FrSBe) as a predictor of community
integration following a traumatic brain injury. Brain Injury
2007;21:1361–1369.
13. Malloy P, Tremont G, Grace J, Frakey L. The Frontal
Systems Behavior Scale discriminates frontotemporal demen-
Conclusions tia from Alzheimer’s disease. Alzheimer’s and Dementia
The Rasch analysis of the Spanish version of the 2007;3:200–203.
14. Denheyer M, Kiss ZH, Haffenden AM. Behavioral effects of
FrSBe raised mild construct validity concerns that subthalamic deep brain stimulation in Parkinson’s disease.
were previously discussed within the framework of Neuropsychologia 2009;47:3203–3209.
the development of the original scale. The deletion 15. Marsh L, Biglan K, Gerstenhaber M, Williams JR.
of a minimal amount of items and the grouping Atomoxetine for the treatment of executive dysfunction in
of two items improved the overall fit to the Rasch Parkinson’s disease: A pilot open-label study. Movement
Disorders 2009;24:277–282.
model of the three sub-scales. The construct validity 16. Basso MR, Shields IS, Lowery N, Ghormley C, Combs D,
of the three sub-scales was supported for the family- Arnett PA, et al. Self-reported executive dysfunction,
rating form, but only for the Apathy and the neuropsychological impairment, and functional outcomes in
Executive dysfunction sub-scales for the self-rating multiple sclerosis. Journal of Clinical and Experimental
form. Only the Disinhibition scale was a valid Neuropsychology 2008;30:920–930.
17. Chiaravalloti ND, DeLuca J. Assessing the behavioral
measure for the behavioural assessment of the consequences of multiple sclerosis: An application of the
normal population. A reduction of response cate- frontal systems behavior scale (FrSBe). Cognitive and
gories is suggested. Behavioral Neurology 2003;16:54–67.
852 A. Caracuel et al.

18. Goverover Y, Chiaravalloti N, DeLuca J. The relationship 36. Caracuel A, Verdejo-Garcı́a A, Vilar-Lopez R, Perez-
between self-awareness of neurobehavioral symptoms, cog- Garcia M, Salinas I, Cuberos G, et al. Frontal behavioral
nitive functioning, and emotional symptoms in multiple and emotional symptoms in Spanish individuals with
sclerosis. Multiple Sclerosis 2005;11:203–212. acquired brain injury and substance use disorders. Archives
19. Grossman A, Woolley-Levine S, Bradley W, Miller R. of Clinical Neuropsychology 2008;23:447–454.
Detecting neurobehavioral changes in amyotrophic lateral 37. Tennant A, Conaghan PG. The Rasch measurement model
sclerosis. Amyotrophic Lateral Sclerosis 2007;8:56–61. in rheumatology: What is it and why use it? When should it be
20. Spinella M. Relationship between drug use and prefrontal- applied, and what should one look for in a Rasch paper?
associated traits. Addiction Biology 2003;8:67–74. Arthritis Care and Research 2007;57:1358–1362.
21. Verdejo-Garcı́a A, Bechara A, Recknor EC, Pérez-Garcı́a M. 38. Bond TG, Fox CM. Applying the Rasch Model:
Executive dysfunction in substance dependent individuals Fundamental measurement in the human sciences. 2nd ed.
during drug use and abstinence: An examination of the Mahwah, NJ: Lawrence Erlbaum; 2007.
behavioral, cognitive and emotional correlates of addiction. 39. Rasch G. Probabilistic models for some intelligence and
Journal of the International Neuropsychological Society attainment tests. Chicago, IL: University of Chicago Pr (Tx);
2006;12:405–415. 1980.
22. Verdejo-Garcı́a A, Pérez-Garcı́a M. Substance abusers’ self- 40. Lawton G, Lundgren-Nilsson A, Biering-Sorensen F,
awareness of the neurobehavioral consequences of addiction. Tesio L, Slade A, Penta M, et al. Cross-cultural validity of
Psychiatry Research 2008;158:172–180. FIM in spinal cord injury. Spinal Cord 2006;44:746–752.
23. Verdejo-Garcı́a A, Rivas-Pérez C, López-Torrecillas F, 41. Tesio L. Measuring behaviours and perceptions: Rasch
Pérez-Garcı́a M. Differential impact of severity of drug use analysis as a tool for rehabilitation research. Journal of
on frontal behavioral symptoms. Addictive Behaviors Rehabilitation Medicine 2003;35:105–115.
Brain Inj Downloaded from informahealthcare.com by EBSCO on 05/16/12

2006;31:1373–1382. 42. Decruynaere C, Thonnard J, Plaghki L. Measure of experi-


24. Batistuzzo MC, Taub A, Nakano E, D’Alcante CC, mental pain using Rasch analysis. European Journal of Pain
de Mathis ME, Hoexter MQ, et al. Performance of patients 2007;11:469–474.
with refractory obsessive-compulsive disorder in the Frontal 43. Linacre JM. Understanding Rasch measurement: Optimizing
rating scale category effectiveness. Journal of Applied
Systems Behavior Scale. Neurocase 2009;15:157–162.
Measurement 2002;3:85–106.
25. Kawada R, Yoshizumi M, Hirao K, Fujiwara H, Miyata J,
44. Fox CM, Jones JA. Uses of Rasch modeling in counseling
Shimizu M, et al. Brain volume and dysexecutive behavior
psychology research. Journal of Counseling Psychology
in schizophrenia. Progress in Neuro-Psychopharmacology
1998;45:30–45.
For personal use only.

and Biological Psychiatry 2009;33:1255–1260.


45. Hagquist C, Bruce M, Gustavsson JP. Using the Rasch
26. Yoshizumi M, Hirao K, Ueda K, Murai T. Insight in social
model in nursing research: An introduction and illustrative
behavioral dysfunction in schizophrenia: Preliminary study.
example. International Journal of Nursing Studies 2009;46:
Psychiatry and Clinical Neurosciences 2008;62:669–676.
380–393.
27. Ross SR, Benning SD, Adams Z. Symptoms of executive
46. Pallant JF, Tennant A. An introduction to the Rasch
dysfunction are endemic to secondary psychopathy: An
measurement model: An example using the Hospital
examination in criminal offenders and noninstitutionalized
Anxiety and Depression Scale (HADS). British Journal of
young adults. Journal of Personality Disorders 2007;21:
Clinical Psychology 2007;46:1–18.
384–399. 47. Kersten P, Ashburn A, George S, Low J. The Subjective
28. Hoerold D, Dockree PM, O’Keeffe FM, Bates H, Pertl M, Index for Physical and Social Outcome (SIPSO) in stroke:
Robertson IH. Neuropsychology of self-awareness in young Investigation of its subscale structure. BMC Neurology
adults. Experimental Brain Research 2008;186:509–515. 2010;10:26.
29. Lyvers M, Czerczyk C, Follent A, Lodge P. Disinhibition 48. Andrich D, Lyne A, Sheridan B, Luo G. RUMM2020. Perth:
and reward sensitivity in relation to alcohol consumption by RUMM Laboratory; 2003.
university undergraduates. Addiction Research and Theory 49. Linacre JM. Comparing ‘Partial Credit’ and ‘Rating Scale’
2009;17:668–677. models. Rasch Measurement Transactions 2000;14:768.
30. Lyvers M, Thorberg FA, Ellul A, Turner J, Bahr M. Negative 50. Wilson M. Constructing measures: An item response
mood regulation expectancies, frontal lobe related behaviors modelling approach. London: Lawrence Erlbaum
and alcohol use. Personality and Individual Differences Associates; 2005.
2010;48:332–337. 51. Tesio L. Functional assessment in rehabilitative medicine:
31. Spinella M. Prefrontal substrates of empathy: Psychometric Principles and methods. Europa Medicophysica 2007;43:
evidence in a community sample. Biological Psychology 515–523.
2005;70:175–181. 52. Nilsson AL, Sunnerhagen KS, Grimby G. Scoring alter-
32. Spinella M. Measuring the executive regulation of emotion natives for FIM in neurological disorders applying
with self-rating scales in a nonclinical population. Journal of Rasch analysis. Acta Neurologica Scandinavica 2005;111:
General Psychology 2007;134:101–111. 264–273.
33. Spinella M, Lyke J. Executive personality traits and eating 53. Bode RK, Heinemann AW, Semik P. Measurement proper-
behavior. International Journal of Neuroscience 2004;114: ties of the Galveston Orientation and Amnesia Test (GOAT)
83–93. and improvement patterns during inpatient rehabilitation.
34. Spinella M, Yang B, Lester D. Prefrontal system dysfunction The Journal of Head Trauma Rehabilitation 2000;15:
and credit card debt. International Journal of Neuroscience 637–655.
2004;114:1323–1332. 54. Caracuel A, Bateman A, Teasdale TW, Verdejo-Garcı́a A,
35. Spinella M, Yang B, Lester D. Prefrontal cortex dysfunction Pérez-Garcı́a M. Spanish, French, and British Cross-cultural
and attitudes toward money: A study in neuroeconomics. Validation of the European Brain Injury Questionnaire.
Journal of Socio-Economics 2008;37:1785–1788. The Journal of Head Trauma Rehabilitation. Ahead of print.

You might also like