You are on page 1of 12

Symptom Distress Profiles in

Hospitalized Patients in Sweden:


A Cross-Sectional Study
Ingela Henoch, Richard Sawatzky, Hanna Falk, Isabell Fridh, Eva Jakobsson Ung,
Elisabeth Kenne Sarenmalm, Anneli Ozanne, Joakim Öhlén, Kristin Falk

Correspondence to Ingela Henoch Abstract: Symptom distress profiles of patients with a variety of diagnoses at two
E-mail: ingela.henoch@gu.se hospitals in Sweden were examined using a point-prevalence cross-sectional sur-
vey design. The sample included 710 patients present on internal medicine, sur-
Ingela Henoch gery, geriatric, and oncology acute care hospital wards of each hospital on a single
Associate Professor day. Symptom distress data were collected via structured interviews using a 0–10
Institute of Health and Care Sciences numeric rating scale (NRS). Fatigue was the most prevalent symptom, experienced
Sahlgrenska Academy
by 76.2% of the patients, followed by pain (65.2%) and sleeping difficulties (52.8%).
University of Gothenburg
Symptoms were fairly distressing (median NRS 5–6). Patients experiencing high
Box 457, SE-405 30
distress from fatigue and pain were more likely to be female, living alone, and to
Göteborg, Sweden
have more symptoms. Latent class analysis revealed three symptom distress pro-
Centre for Person-Centred Care (GPCC)
files that differed with respect to the degree of distress and number of symptoms.
Sahlgrenska Academy
The profiles were not substantially differentiated by diagnoses. Symptom distress
University of Gothenburg
Gothenburg, Sweden
needs to be assessed and treated on an individual basis, rather than predicting
distress levels based on diagnosis alone. ß 2014 Wiley Periodicals, Inc.
Richard Sawatzky
Keywords: hospitals; point prevalence survey; acute care; symptoms; symptom
Associate Professor
distress; symptom experience; symptom profile; symptom cluster; pain; fatigue
Trinity Western University School of
Research in Nursing & Health, 2014, 37, 512–523
Nursing
Vancouver, Canada Accepted 26 August 2014
Centre for Health Evaluation and DOI: 10.1002/nur.21624
Outcome Sciences Published online 12 October 2014 in Wiley Online Library (wileyonlinelibrary.com).
Providence Health Care
Vancouver, Canada
Troublesome symptoms are the most common reason for seeking hospital care,
Hanna Falk and many patients report multiple co-occurring symptoms (Kris & Dodd, 2004;
Institute of Health and Care Sciences Tranmer et al., 2003; Wadensten, Frojd, Swenne, Gordh, & Gunningberg, 2011).
Sahlgrenska Academy Symptom experience includes prevalence, frequency, intensity, duration and level
University of Gothenburg
of distress (Fu, McDaniel, & Rhodes, 2007; Rhodes, McDaniel, Homan, Johnson, &
Gothenburg, Sweden
Madsen, 2000). Patients' symptom experience in hospital settings is most often
Institute of Neuroscience and Physiology
studied as the prevalence of separate symptoms within the context of specific
Sahlgrenska Academy
University of Gothenburg medical diagnoses, in particular, cancer. However, recent research suggests that
Gothenburg, Sweden symptom experience may not be disease-specific, and that symptoms may appear
concurrently in symptom clusters. The purpose of this study was to examine
Isabell Fridh symptom profiles in general hospital settings in Sweden in order to increase our
Institute of Health and Care Sciences understanding of hospitalized patients' experience of symptom distress across
Sahlgrenska Academy different medical diagnoses and to determine the number and characteristics of
University of Gothenburg groups of patients with different symptom distress patterns.
Gothenburg, Sweden
School of Health Sciences
University of Borås Symptom Prevalence
Borås, Sweden
Although various aspects of symptom experience have been measured, the most
Note: Additional authors are listed on the last page. frequently used design in symptom studies seems to be the measurement of


C 2014 Wiley Periodicals, Inc.
SYMPTOM DISTRESS PROFILE IN HOSPITALIZED PATIENTS/ HENOCH ET AL. 513

symptom prevalence in patients with a particular diagnosis. degree of suffering experienced as a result of a symptom
For example, Nordgren and Sorensen (2003), found that the (Rhodes & Watson, 1987). Tishelman et al. (2005) and
most prevalent symptom in patients with heart failure in the Tishelman, Lovgren, Broberger, Hamberg, and Sprangers
last 6 months of life was breathlessness, which was experi- (2010) have shown that patients evaluate symptom intensity
enced by 90% of patients. In a systematic review, Teunis- and symptom distress at different levels, which indicates
sen et al. (2007) focused on patients with incurable cancer that they should be measured separately.
and found that fatigue, pain, lack of energy, weakness, and Visual analogue scales (VAS) and numerical rating
loss of appetite were the most frequent symptoms. scales (NRS) are common ways of assessing symptom
Symptom prevalence has also been studied in intensity. Mantha, Thisted, Foss, Ellis, and Roizen (1993)
patients with diagnoses that are often co-occurring (e.g., suggested a cut-off point for a pain NRS of greater than 3,
Janssen, Spruit, Uszko-Lencer, Schols, & Wouters, 2011; and a score less than 3 was considered an indicator of
Spichiger et al., 2011). Pain, breathlessness, and fatigue analgesic success. Although there is no recommendation
were prevalent in more than 50% of a sample of patients for interpretation of symptom distress scores, one could
with cancer, AIDS, heart disease, chronic obstructive assume that hospitalized patients would experience
disease (COPD), or renal disease (Solano, Gomes, & reduced symptom distress if the care provided is effective,
Higginson, 2006). In addition to these symptoms, insomnia and that, similar to pain intensity, the goal of care might be
has been identified as a prevalent symptom in patients with no symptom distress above 3 on an NRS of 0–10.
chronic heart failure, COPD, or chronic renal failure (Jans- Given that most research to date has focused
sen, Spruit, Wouters, & Schols, 2008). on symptom prevalence and intensity, there is a lack of
Although some symptoms are prevalent across a knowledge about levels and patterns of symptom distress,
range of different diagnoses, there are also differences especially for general hospital unit patients with different,
across diagnoses. For example, when hospitalized cancer and often multiple, diagnoses. In particular, it is unknown
and non-cancer patients were compared, patients with can- whether there are commonly occurring profiles of symptom
cer had a significantly higher prevalence of pain, nausea, distress or, if so, to what extent these profiles are explained
unpleasant taste, constipation, and vomiting (Tranmer by different diagnoses and demographic characteristics of
et al., 2003), and in patients with other diseases, the preva- patients.
lence of shortness of breath and coughing was significantly
higher. There were no significant differences in the preva-
Symptom Clusters or Profiles
lence of psychological symptoms.
Due to the co-occurrence of symptoms (Dodd, Miaskowski,
& Lee, 2004; Dodd, Miaskowski, & Paul, 2001; Kim,
Symptom Number and Severity
McGuire, Tulman, & Barsevick, 2005; Miaskowski,
Research to date has predominantly focused on individual Aouizerat, Dodd, & Cooper, 2007), Miaskowski, Dodd, and
symptoms, but Spichiger et al. (2011) found that, on aver- Lee (2004) argued that the new frontier of symptom
age, hospitalized patients experienced 13 symptoms on research is the study of symptom clusters or profiles.
admission, falling to 9 symptoms by 6 and 10 days after Miaskowski et al. (2006) described two conceptual
admission. Lack of energy was the most prevalent and fre- approaches to symptom cluster research: (a) identification
quent, and pain was the most severe. In several studies of symptom profiles, or associations among different
(Janssen et al., 2011; Spichiger et al., 2011), severity has symptoms (Henoch, Ploner, & Tishelman, 2009; Skerman,
been used interchangeably with intensity, as described by Yates, & Battistutta, 2009), and (b) identification of differ-
Rhodes and Watson (1987). A study of 80 patients with ent subgroups of patients, based on their experience of
chronic heart failure (CHF) and 105 patients with COPD specific symptom profiles. The first approach assumes that
revealed that the mean number of symptoms with a severity particular symptom profiles are representative of the entire
score above 30 mm on a 100 mm visual analog scale was population (i.e., there is a homogeneous pattern of co-
9.1 for the CHF group and 8.1 for the COPD group (Jans- occurring symptoms). The second approach assumes that
sen et al., 2011). The most severe symptoms in both there are sub-populations with differing symptom profiles
patient groups were dyspnea, fatigue, and muscle weak- (the pattern of correlations among the symptoms is hetero-
ness, but the COPD patients experienced significantly geneous in the population). When the second approach
higher severity of dyspnea. Thus, previous research indi- was used by Miaskowski et al. (2006) in patients with
cates that regardless of diagnoses, patients often experi- cancer, four distinct subgroups of patients with different
ence co-occurring symptoms of varying severity. patterns of symptom experience were identified: (a) all
symptoms at a low level, (b) low level of pain but high level
of fatigue, (c) low level of fatigue but high level of pain,
Symptom Distress
and (d) all symptoms at a high level. In the present study,
While symptom intensity or severity refers to the degree of we used the second approach, with a specific focus on
discomfort of a symptom, symptom distress pertains to the symptom distress.

Research in Nursing & Health


514 RESEARCH IN NURSING & HEALTH

Profiles of Symptom Distress variety of reasons, and a further 431 declined to participate
or did not complete the interviews. The remaining 710 com-
The prevalence of distress related to symptoms in hospital-
pleted the interviews. The overall response rate was 38%
ized patients in the palliative stage (Sigurdardottir &
(see Fig. 1).
Haugen, 2008) and pain in hospitalized patients (Wadens-
Compared to the total population of the selected
ten et al., 2011) has previously been examined in point
wards, the sample had a similar gender distribution (46.8%
prevalence studies (i.e., a cross-sectional study undertaken
male in the sample and 46.1% in the non-participating
during 1 day). However, to our knowledge there are no
group), but the sample was younger (p ¼ .02), and a greater
studies of subgroups of hospitalized patients grouped
proportion of the non-participating patients died within
according to levels of symptom distress or profiles of symp-
a year (18.5% vs. 29.3%, p < .001). Sixty-four percent
tom distress (Rhodes & Watson, 1987).
were retired. The most prevalent reason for admission was
To date, research on symptom clusters and profiles
experiencing symptoms (49%). Demographic and clinical
has focused predominantly on cancer patients. Knowledge
characteristics of the patients are presented in Table 1.
about symptom distress profiles is needed in order to iden-
tify vulnerable groups of patients. In this study, we exam-
ined symptom profiles in acute care hospital settings in Instruments
Sweden. We explored the characteristics of patients who
The following items were obtained from the medical
reported high distress for similar symptom profiles and
records: reason for admission (i.e., planned, referred, symp-
compared them to those who reported low distress. The
toms, accident, or other) and the main diagnosis according
aims of the study were to:
to International Classification of Diseases (ICD-10) by the
1. describe levels of symptom distress in hospitalized World Health Organisation (WHO, 2010). National registry
patients, mortality data were obtained 1 year after the data collection
2. identify different symptom distress profiles, and days.
3. determine the extent to which demographic characteris- The remaining data were collected in structured inter-
tics, number of symptoms, and medical diagnoses views. A demographic form was used to obtain information
explain different symptom distress profiles. about age, gender, living situation (i.e., living alone, living at
home, or in residential care), highest level of education,
employment situation, and immigrant status (i.e., born in
Sweden or elsewhere).
Methods
A Swedish translation of the Edmonton Symptom
The data for this study originated from two cross-sectional Assessment Scale (ESAS) (Bruera, Kuehn, Miller, Selmser,
surveys in Sweden performed identically, each during the & Macmillan, 1991; Nekolaichuk, Watanabe, & Beaumont,
course of a single day. The first survey was conducted 2008), which has previously been used in Sweden
at a university hospital on one day in February 2011 (Astradsson, Granath, Heedman, & Starkhammar, 2001),
and the second at a county hospital on one day in was adapted to assess the following symptoms: pain,
September 2011. dyspnea, fatigue, sleeping difficulties, loss of appetite,
depression, and anxiety. Adaptation involved changing the
item about drowsiness to sleeping difficulties, because
Sample
sleep was considered important in a sample admitted to
In total, around 80 hospital wards were involved, covering hospital. This instrument was administered via structured
internal medicine, surgery, geriatric, and oncology depart- interviews.
ments. Psychiatric and intensive care departments were The patients were asked to respond to three ques-
excluded, as it was assumed that for ethical or communica- tions related to each symptom. The first concerned the
tion reasons these departments did not care for patients prevalence of the symptom (i.e., whether the symptom was
who would be able to participate in the study. The sample present or absent), except for the loss of appetite item. In
included patients on acute hospital wards that provided Swedish, a question about appetite is ambiguous; appetite
care for a mixture of patients. All patients over the age of is always present, but it could be good or bad. When a
18 who had been admitted to the selected wards before symptom was present, patients answered two additional
7 a.m. on the collection day at the university hospital and questions, in accordance with the Memorial Symptom
before 9 a.m. on the collection day at the county hospital Assessment Scale (MSAS) (Browall, Kenne Sarenmalm,
were included in the study. Those unable to communicate Nasic, Wengstrom, & Gaston-Johansson, 2013; Portenoy
were excluded. et al., 1994). The first additional question measured symp-
On the data collection days, 1,874 patients had been tom intensity, for example, “how severe is your pain?” The
admitted to the selected hospital wards. Of these, 733 were second measured distress, for example, “how distressing
not available for interview because they were being cared is your pain?” Intensity and distress were assessed on
for on other wards or had been excluded by staff for a an 11-point numeric rating scale (NRS), ranging from 0,

Research in Nursing & Health


SYMPTOM DISTRESS PROFILE IN HOSPITALIZED PATIENTS/ HENOCH ET AL. 515

Paents admied to the hospitals at


the data collecon day
Hospital 1: 1241
Hospital 2: 633
Total: 1874

Paents not available for interview or


excluded by the staff for any reason:

Hospital 1: 523
Hospital 2: 210
Total: 733

Paents invited to parcipate in the


interviews

Hospital 1: 718
Hospital 2 423
Total: 1141
Paents declining to parcipate in the
interviews

Hospital 1: 215
Hospital 2: 208
Total: 423
Paents included in the study

Hospital 1: 503
Hospital 2: 215
Total: 718
Paents not compleng the interviews

Hospital 1: 5
Hospital 2: 3
Total: 8

Paents compleng the interviews

Hospital 1: 498
Hospital 2: 212

Total: 710

FIGURE 1. Flow chart of the sample.

no intensity/distress, to 10, worst possible intensity/distress. study was conducted 2 months prior to the first data collec-
For the aims of the present study, we analyzed results of tion day in order to refine the logistics.
the distress scale. For patients who did not report a given One of the hospitals was located close to the univer-
symptom, the distress score was set at 0. sity, but the other hospital was a county hospital that is
located 160 km from the university. The students were
transported there by bus. Consequently, the data collection
Procedures
started 2 hours later in the county hospital.
Data were collected by nursing students who were at the On arrival at the wards, the students were told of any
end of their third year of an undergraduate nursing program. patients who should be excluded based on the exclusion
The students attended workshops on campus to receive criteria. The students then provided the eligible patients
training in data collection prior to the data collection day. with verbal and written information about the study and
On the data collection days, the research team was present obtained each patient's informed consent prior to data
at the hospitals to support the students as needed. A pilot collection. The study was conducted in accordance with

Research in Nursing & Health


516 RESEARCH IN NURSING & HEALTH

Table 1. Characteristics of the Sample (N ¼ 710) and of Subgroups With Low and High Symptom Distress Levels for Both Pain
and Fatigue

Mean (SD)

Total (N ¼ 710) Low Pain and Fatigue Distress (n ¼ 207) High Pain and Fatigue Distress (n ¼ 243)

Number of symptoms 3.0 (2.0) 2.0 (1.0) 5.0 (1.0)  


Age 67.0 (17.2) 67.4 (15.7) 66.6 (17.3)

Median (Range)

Total (N ¼ 710) Low Pain and Fatigue Distress (n ¼ 207) High Pain and Fatigue Distress (n ¼ 243)

Number of symptoms 4 (0–7) 2 (0–7) 5 (2–7)


Age 69.0 (18–99) 69.0 (21–95) 69.0 (18–95)

n (%)

Total (N ¼ 710) Low Pain and Fatigue Distress (n ¼ 207) High Pain and Fatigue Distress (n ¼ 243)

Male 332 (46.8) 117 (56.5) 97 (39.9)


Female 378 (53.2) 90 (43.5) 146 (60.1)
Living alone 335 (47.2) 80 (38.6) 120 (49.2)
Born in Sweden 625 (88.0) 180 (87.0) 212 (87.2)

n (%)

Total Low Pain and Fatigue High Pain and Fatigue


(N ¼ 710) Distress (n ¼ 207) Distress (n ¼ 243)

Infections 44 (6.2) 9 (4.3) 18 (7.4)


Tumors 155 (21.8) 40 (19.3) 55 (22.6)
Blood, blood-forming 38 (5.4) 9 (4.3) 11 (4.5)
Endocrine, nutritional, metabolic 144 (20.3) 41 (19.8) 46 (18.9)
Mental, behavioral, neurodevelopmental 50 (7.0) 16 (7.7) 23 (9.5)
Nervous system 56 (7.9) 18 (8.7) 17 (7.0)
Circulatory system 331 (46.6) 101 (48.8) 110 (45.3)
Respiratory system 104 (14.6) 28 (13.5) 31 (12.8)
Digestive system 93 (13.1) 30 (14.5) 33 (13.5)
Musculoskeletal system, connective tissue 97 (13.7) 21 (10.1) 49 (20.2) 
Genitourinary system 95 (13.4) 27 (13.0) 26 (10.7)
Symptoms, signs, abnormal clinical or lab findings 69 (9.7) 19 (9.2) 24 (9.9)
Injury, poisoning, or consequence of external harm 102 (14.2) 28 (13.5) 35 (14.4)
External causes of morbidity 126 (17.7) 36 (17.4) 40 (16.5)
Factors influencing health status/contact with health services 97 (13.7) 27 (13.0) 37 (15.2)

Note. SD, standard deviation. Difference between groups:  p < .05, 


p < .01, 
p < .001.

the Helsinki declaration (World Medical Association, 2008). two-thirds of the sample. Following Mantha et al. (1993),
Ethical approval was obtained from the Regional Ethics who used a cut-off of 3 for pain on a scale of 1–10, and
Committee (Ref. No. 604-10). Miaskowski et al. (2006), who made a division into sub-
groups according to high and low levels of pain and fatigue
using the original 0–10 response scale. Two groups
Analytical Strategies
were extracted for comparison: Group 1 with pain and
This first aim was addressed using frequencies, means, fatigue 3; and Group 2 with pain and fatigue >3. Patients
and standard deviations to describe patients' characteristics who reported high distress on one symptom but not the
and their levels of distress for each symptom. other, that is, pain 3 and fatigue >3 or pain >3 and
To address the second aim of identifying symptom fatigue 3, were not included in this comparison.
distress profiles, the patients were grouped (a) according For the second approach, latent class analysis was
to the most prevalent symptoms, and (b) based on latent done using the MPlus 7.0 (Muthén & Muthén, 2013) soft-
classes with different symptom profiles. ware, to determine whether there were relatively homo-
In the first approach, pain and fatigue were identified geneous subgroups of patients who had similar symptom
as the most prevalent symptoms, present in the more than profiles. The distributions of the variables then were

Research in Nursing & Health


SYMPTOM DISTRESS PROFILE IN HOSPITALIZED PATIENTS/ HENOCH ET AL. 517

examined to determine whether linear modeling could be is indicative of the quality of classification, was taken into
applied in latent class analysis. Symptom distress on the consideration (Lubke & Muthén, 2007) and the model's
original 0–10 scale could not be treated as a continuous parameters estimated with reasonable accuracy (i.e., the
variable in multivariate analysis because responses were standard errors should not be exceedingly large).
far from normally distributed. To mitigate this, we catego- The third aim, to compare demographics, symptom
rized the symptom distress responses into five ordinal cate- numbers, and medical diagnoses of group members, was
gories: 0 ¼ symptom distress score of 0; 1 ¼ score of 1–3; explored separately for each of the two sets of groups
2 ¼ score of 4–6; 3 ¼ score of 7–8; and 4 ¼ score of 9–10. depicted above. We first compared the high-distress and
These variables were subsequently specified as ordinal var- low-distress groups (created using symptom distress score
iables in latent class analysis. A latent class analysis cut-offs on both pain and fatigue of above or below 3) using
approach to symptom clusters is based on the premise that t-tests and Chi square tests at an alpha level of .05. A simi-
correlations among multiple symptoms arise in part lar comparison was made across the latent classes identi-
because of different subgroups within the population. This fied by the latent class analysis. We used multinomial
approach involves adding latent classes until a threshold in logistic regression with pseudo-class draws to determine
the improvement of model fit is reached. whether the latent class symptom distress profiles were
The latent class model was specified using a propor- explained by any significant differences in demographic
tional odds logistic link function, with all item thresholds characteristics, number of symptoms, and prevalence of
allowed to vary across the latent classes. According to a certain diagnostic categories (Bandeen-Roche, Miglioretti,
conventional proportional odds model, there were four Zeger, & Rathouz, 1997; Muthén & Muthén, 2007).
thresholds per symptom variable, with threshold 0 repre-
senting category 4 versus all categories <4; threshold 1
representing categories 4 to 3 versus all categories <3, and
Results
so on.
A robust maximum likelihood estimation method Fatigue was the most prevalent symptom, experienced by
(MLR) (Muthén & Muthén, 2013) was used to fit the model. 76.2% of the patients, followed by pain (65.2%) and sleep-
The number of latent classes was determined by comparing ing difficulties (52.8%). Among the patients who reported
models with k and k  1 classes, where k is the number of the presence of symptoms, the median score for symptom
latent classes in the model. The model with the greatest distress was 5 or 6, for all symptoms except for loss of
number of latent classes that contribute to improved fit, appetite, which was 4 (SD 3.3) (Table 2).
relative to the model with one fewer latent class, was con- For the first approach to identify symptom profiles,
sidered to be the best fit. Support for a k-class model over Group 1, with both pain and fatigue distress 3, consisted
a model with k  1 classes was ascertained based on of 207 individuals. Group 2, with both pain and fatigue dis-
the following criteria: (a) a smaller Bayesian Information tress >3, consisted of 243 individuals. In comparison of
Criterion (BIC), (b) a statistically significant Vuong-Lo- group characteristics, as seen in Table 1, the high-distress
Mendell-Rubin likelihood ratio test (VLMR LRT) (Henson, group had more women, people living alone, people living
Reise, & Kim, 2007; Lo, Mendell, & Rubin, 2001; Vuong, in residential care (not shown), and people diagnosed with
1989), and (c) a statistically significant bootstrapped likeli- diseases of the musculoskeletal system. This group also
hood ratio test (McLachlan & Peel, 2000; Nylund, Asparou- had a higher number of symptoms (median of 5 vs. 2,
tiov, & Muthen, 2007). In addition, the entropy value, which p  .001).

Table 2. Number of Patients Reporting Symptoms and Levels of Symptom Distress in Patients Reporting Symptoms (N ¼ 710)

Number Reporting Distress of Symptom (Possible Range 1–10)

Symptom n % Mean SD Median Range

Pain 463 65.2 6.04 2.7 6 0–10


Dyspnea 240 33.8 5.04 2.9 5 0–10
Fatigue 541 76.2 5.24 2.9 5 0–10
Sleeping difficulties 375 52.8 5.54 2.9 6 0–10
Nausea 207 29.2 5.02 2.8 5 0–10
Depression 332 46.9 5.39 2.8 5 0–10
Anxiety 322 45.4 5.21 2.8 5 0–10
Loss of appetite All patients included 2.55 3.3 0 0–10

Note. SD, standard deviation. Distress of each reported symptom was measured on a numerical rating scale ranging from 0 (no
distress) to 10 (worst possible distress).

Research in Nursing & Health


518 RESEARCH IN NURSING & HEALTH

Latent class analysis resulted in the identification We then investigated whether the latent class symp-
of three latent classes with different symptom profiles. The tom distress profiles were explained by any significant
relative fit of the latent class analyses with 1, 2, 3, and 4 differences in demographic characteristics, number of
latent classes is shown in Table 3. The lowest BIC value symptoms, and prevalence of certain diagnostic categories
was obtained for the 3-class model. Although the BLRT (Aim 3). The results, shown in Table 4, suggest that the
continued to suggest a relative improvement in fit when a latent classes were very similar in most respects. The only
4-class model was specified, the BIC was greater and the exceptions were that people in class 2 were more likely
VLMR LRT was not statistically significant. In addition, the than those in class 1 to have an infection (odds ratio [OR]
precision of several parameters in the 4-class model was 3.3, 95% confidence interval [CI] 1.2–9.4) or neoplasm (OR
poor, with relatively large standard errors. The 3-class 1.8; CI 1.1–2.8), and those in class 3 were more likely than
model was thus retained as the most trustworthy model, those in class 1 to be female (OR 1.8; CI 1.2–2.9). In addi-
with relative proportions of latent class membership of .32, tion, patients in classes 2 and 3 reported a greater number
.46, and .22 for latent classes 1 (low symptom distress), of symptoms (means of 4.3 and 5.6, respectively) than
2 (moderate symptom distress), and 3 (high symptom those in class 1 (mean of 1.6). All these differences
distress), respectively. The classes differed significantly in remained statistically significant in multivariate logistic
overall symptom profiles (Fig. 2). In comparison to class 1, regression using pseudo-class draws. There were no sta-
the symptom profiles for classes 2 and 3 also were charac- tistically significant differences between classes 2 and 3 on
terized by greater symptom distress associated not only any variables.
with fatigue and pain but with sleep problems, loss of appe-
tite, depression and anxiety.
Those with the first profile (class 1) less frequently
Discussion
reported distress for any symptoms, in comparison to peo- In this study of hospitalized patients, most patients reported
ple in the other two classes. Distress associated with pain significant symptom distress, with values of 5 or higher on a
was most prevalent for this profile but occurred in less than 1–10 scale for all symptoms except appetite. Fatigue and
50% of the patients and was most frequently rated at or pain were the most prevalent symptoms. Fatigue, pain,
less than 6 on the symptom distress scale. Only 11.2% sleeping difficulties, depression, and anxiety were prevalent
rated their distress associated with pain to be greater than in more than 45% of the patients. In these patients, the
6, as is shown by the top two stacks of the bar chart for median score on the 10-point NRS was 5 or 6. This high
pain in this class. level of distress is considerably above a score of 3, which
For the second profile (class 2), symptom distress has been described by Mantha et al. (1993) as a pain score
was greater than in class 1. Of those who reported symp- cut-off for analgesic success. Although such a cut-off point
toms, the level of symptom distress most frequently has not been reported for other symptoms, it could be
reported was in the mid-range of the scale (4–8), with very argued that many of the patients in the present study did
few reporting the highest levels of symptom distress (9 or not have sufficient symptom alleviation, despite being
10). Compared to classes 1 and 2, class 3 included a rela- hospitalized and under the care of professionals.
tively greater percentage of people reporting the highest As expected, the patients with high levels of pain and
levels of symptom distress (levels 9–10); 40% and 38% fatigue also experienced a higher number of other symp-
reported distress levels above 8 for fatigue and pain, toms. This finding supports other evidence that symptoms
respectively. occur in clusters (Dodd et al., 2001, 2004; Kim et al., 2005;

Table 3. Relative Fit for Models of Up to Four Latent Classes

Class Proportionsa
VLMR BLRT
K P LL BIC LR p-value p-value Entropy C1 C2 C3 C4

1 32 7,130 14,469 1.0


2 65 6,791 14,009 674 .01 .01 .73 .61 .39
3 98 6,670 13,985 224 .761 .01 .74 .32 .49 .19
4 131 6,697 14,073 127 .764 .01 .77 .13 .13 .34 .40

Note. N ¼ 710. K ¼ number of latent classes in the model. P ¼ number of parameters. LL ¼ log likelihood. BIC ¼ Bayesian Information
Criterion. LR ¼ Likelihood ratio of 2-, 3- and 4-class models. VLMR ¼ Vuong-Lo-Mendel-Rubin likelihood ratio test. BLRT ¼ Bootstrapped
likelihood ratio test. C1–C4 ¼ classes 1–4. The bold row indicates the selected 3-class model.
a
Probability of latent class membership predicted by the model. The classification of individuals based on their posterior probabilities
of latent class membership is shown as latent class proportions. The proportions may not add up to 1 due to rounding off.

Research in Nursing & Health


SYMPTOM DISTRESS PROFILE IN HOSPITALIZED PATIENTS/ HENOCH ET AL. 519

Class 1 Class 2 Class 3


100 100 100

80 80 80

Percentage
60 60 60

40 40 40

20 20 20

0 0 0

Depression

Depression
Pain
Dyspnea
Fatigue

Nausea

Depression
Appetite

Pain
Dyspnea
Fatigue

Nausea
Appetite

Pain
Dyspnea
Fatigue

Nausea
Appetite
Sleep prob.

Sleep prob.

Sleep prob.
Anxiety

Anxiety

Anxiety
Symptom distress levels
1-3
4-6
7-8
9-10

FIGURE 2. Comparison of symptom frequencies and symptom distress categories across latent clas-
ses. Notes. Category 0 (no distress) is not shown. The height of the bar is representative of symptom
prevalence. The shading indicates the level of symptom distress as per the legend.

Miaskowski et al., 2007). Spichiger et al. (2011) found an people living alone than people living with others. This
average of 13 symptoms in advanced cancer patients on was consistent with the gender difference between class 1
admission to a hospital, which decreased to 9 during the (relatively less symptom distress) and class 3 (relatively
stay. In the present study, most patients across diagnoses greater symptom distress). The higher level of symptom
in the present study experienced four or more symptoms, experience for women is consistent with previous research,
confirming that symptom relief ought to be a target of for example Clark, Smith, Lovell, and Currow (2012), who
intervention. found that women in palliative care reported higher levels of
The high symptom distress level for fatigue could be pain intensity than did men. Kirkova, Rybicki, Walsh, and
explained by difficulty alleviating fatigue during hospitaliza- Aktas (2012) explored symptom prevalence in advanced
tion. Although there are effective interventions (Barsevick cancer patients and found that men had a higher overall
et al., 2013; Wenzel et al., 2013) and clinical guidelines for prevalence of sleep problems than women, whereas nau-
fatigue management (Borneman et al., 2011), fatigue is a sea, anxiety, and vomiting were more prevalent for women.
common and distressing symptom that has a major impact Our findings suggest that it is important to identify poten-
on daily life, and our findings suggest it is still an underrated tially vulnerable groups of patients in order to alleviate their
healthcare problem. Efforts are being made to increase symptom distress. One such group could be women living
knowledge of cancer-related fatigue, to improve the preci- alone.
sion of measurement, and to implement effective interven- The three symptom distress profiles identified in latent
tions among patients with cancer (Barsevick et al., 2013). class analysis differed mainly in the presence of symptoms
In the present study, fatigue was reported by 76% of the and severity of symptom distress but were similar across
patients, most of whom did not have cancer. Clinicians in most diagnoses. The latent classes were very similar within
acute care should attend to fatigue as a significant concern the diagnostic categories (with the exception of tumors and
for all their patients. circulatory diseases). Although this may be in part because
The two approaches to grouping patients by symptom disease-specific symptoms were not measured, these find-
profiles produced groupings with some similarities. The ings are consistent with the definition of symptom distress
group of patients with distress scores above 3 on pain and as a subjective illness experience and challenge reliance
fatigue included relatively more women than men and more on disease classification as the basis for symptom

Research in Nursing & Health


520 RESEARCH IN NURSING & HEALTH

Table 4. Characteristics of the Three Symptom Distress Profiles Identified in Latent Class Analysis

Mean (SD)

Latent Class 1 (n ¼ 229) Latent Class 2 (n ¼ 349) Latent Class 3 (n ¼ 132)

Number of symptoms 1.6 (1.4)2,3 4.3 (1.6)1,3 5.6 (1.6)1,2


Age 69.0 (16.8) 65.9 (19.5) 66.0 (19.4)

%a

Latent Class 1 (n ¼ 229) Latent Class 2 (n ¼ 349) Latent Class 3 (n ¼ 132)


3
Gender 46.2 54.8 60.91
Living alone 56.93 52.8 44.51
Born in Sweden 12.6 9.23 18.02

%b

Latent Class 1 Latent Class 2 Latent Class 3


(n ¼ 229) (n ¼ 349) (n ¼ 132)

Infections 2.82 8.11 7.0


Tumors 18.42 28.01 20.3
Blood, blood-forming 5.4 6.2 6.2
Endocrine, nutritional, metabolic 20.0 21.1 20.3
Mental, behavioral, neurodevelopmental 6.8 7.1 7.4
Nervous system 9.0 7.5 7.2
Circulatory system 49.6 48.0 45.2
Respiratory system 10.43 15.9 18.81
Digestive system 14.4 12.8 11.7
Musculoskeletal system, connective tissue 12.9 13.0 16.8
Genitourinary system 11.9 14.1 14.2
Symptoms, signs, abnormal clinical or lab findings 7.8 11.4 10.4
Injury, poisoning, or consequence of external harm 18.5 12.2 12.4
External causes of morbidity 22.5 16.0 14.2
Factors influencing health status/contact with health services 10.8 15.4 14.1

Note SD, standard deviation.. 1,2,3Statistically significant difference (p < .05) from class 1, 2, or 3 respectively, based on bivariate
multinomial logistic regression with pseudo-class draws.
a
Referent is male; living alone; born in Sweden.
b
Referent is without this problem.

assessment and management. Our finding that symptom Further research is needed to determine the extent to which
distress profiles are not necessarily specific to diseases is the patterns and profiles of symptom distress apply to the
consistent with other evidence of the prevalence of severe most severely ill and to other hospital-based samples.
symptoms regardless of diagnosis (Janssen et al., 2008; There was a lower participation rate in the county
Solano et al., 2006) and suggests that assessments of hospital, which could be because the data collection started
symptom distress should not be driven exclusively by a pri- 2 hours later in the morning, by which time a larger propor-
ori information about a patient's diagnosis. Clinicians are tion of the patients may have been discharged or relocated
advised, therefore, to base their care planning on patients' for diagnostic testing. If the data collection had started
narratives of their symptom experience (Ekman et al., 2011) earlier, the participation rate in the county hospital might
and patient-reported outcome measures (Greenhalgh, have been higher, and this could have affected the results.
Long, & Flynn, 2005; Snyder et al., 2012). We also caution against comparing the symptom dis-
tress results from the present study to symptom intensity
results in other research. As noted earlier, symptom inten-
Limitations
sity and symptom distress can co-occur at different levels
A significantly larger proportion of non-participating patients and should be measured separately (Tishelman et al.,
was older and died within a year of the data collection day. 2005, 2010).
This indicates that the non-participating patients were Latent class analysis assumes that correlations
more severely ill than the present sample, and it could be among the symptom distress variables arise because of
assumed that the overall levels of symptom distress would latent classes (heterogeneity) in the sample. Our finding of
be even higher if the non-participators had been included. multiple latent classes is consistent with this assumption.

Research in Nursing & Health


SYMPTOM DISTRESS PROFILE IN HOSPITALIZED PATIENTS/ HENOCH ET AL. 521

However, it is possible that correlations among the symp- 46, 131–141. doi: 10.1016/j.jpainsymman.2012.07.023, S0885-
tom distress variables were a result of unmeasured factors 3924(12)00502-7[pii]
other than those analyzed here. Also, it is possible that Bruera, E., Kuehn, N., Miller, M. J., Selmser, P., & Macmillan, K.
additional latent classes may have been identified had (1991). The Edmonton Symptom Assessment System (ESAS): A
the sample been larger. Further investigation with larger simple method for the assessment of palliative care patients.
Journal of Palliative Care, 7, 6–9.
samples is recommended to gain a better understanding of
correlations among symptom distress variables in hetero- Clark, K., Smith, J., Lovell, M., & Currow, D. C. (2012). Longitudinal
geneous populations. pain reports in a palliative care population. Journal of Palliative
Medicine, 15, 1335–1341. doi: 10.1089/jpm.2012.0299
Finally, it should be noted that, given the exploratory
nature of these analyses, the statistical significance levels Dodd, M. J., Miaskowski, C., & Lee, K. A. (2004). Occurrence of
were not adjusted for multiple comparisons. Additional symptom clusters. Journal of National Cancer Institute Mono-
graphs, 32, 76–78. doi: 10.1093/jncimonographs/lgh0082004/32/
research is needed to replicate the symptom profiles and to
76[pii]
confirm the group differences reported here.
Dodd, M. J., Miaskowski, C., & Paul, S. M. (2001). Symptom clusters
and their effect on the functional status of patients with cancer.
Oncolology Nursing Forum, 28, 465–470.
Conclusion
Ekman, I., Swedberg, K., Taft, C., Lindseth, A., Norberg, A., Brink,
The most noteworthy finding in the present study was that a E., … Sunnerhagen, K. S. (2011). Person-centered care—Ready
high percentage of patients experienced pain, fatigue, and for prime time. European Journal of Cardiovascular Nursing, 10,
other symptoms at a level that required treatment, regard- 248–251. doi: 10.1016/j.ejcnurse.2011.06.008, S1474-5151(11)
00129.-0[pii]
less of diagnosis, and despite being hospitalized for care to
address those symptoms. The results further suggest that Fu, M. R., McDaniel, R. W., & Rhodes, V. A. (2007). Measuring
symptom occurrence and symptom distress: Development of the
symptom distress profiles are similar across different diag-
Symptom Experience Index. Journal of Advanced Nursing, 59,
noses. This is consistent with the notion that symptoms
623–634. doi: 10.1111/j.1365.-2648.2007.04335.x, JAN4335[pii]
are subjective experiences that should be assessed in a
Greenhalgh, J., Long, A. F., & Flynn, R. (2005). The use of patient
dialogue with the patient and not assumed to be high or low
reported outcome measures in routine clinical practice:
based on diagnosis. Routine and comprehensive symptom
Lack of impact or lack of theory? Social Science and Medi-
assessment is recommended, with the goal of increasing cine, 60, 833–843. doi: 10.1016/j.socscimed.2004.06.022,
care providers' focus on symptom alleviation, thereby S0277953604002898[pii]
reducing symptom distress (Sarna, 1998). Henoch, I., Ploner, A., & Tishelman, C. (2009). Increasing stringency
in symptom cluster research: A methodological exploration
of symptom clusters in patients with inoperable lung cancer.
References Oncology Nursing Forum, 36, E282–E292. doi: 10.1188/09.ONF.
E283-E292, 6344302457064554[pii]
Astradsson, E., Granath, L., Heedman, P. A., & Starkhammar, H.
Henson, J. M., Reise, S. P., & Kim, K. H. (2007). Detecting mixtures
(2001). Cancer patients hospitalised for palliative reasons. Symp-
from structural model differences using latent variable
toms and needs presented at a university hospital. Supportive
mixture modeling: A comparison of relative model fit statistics.
Care in Cancer, 9, 97–102. doi: 10.1007/s005200000209
Structural Equation Modeling, 14, 202–226. doi: 10.1080/
Bandeen-Roche, K., Miglioretti, D. L., Zeger, S. L., & Rathouz, P. J. 10705510709336744
(1997). Latent variable regression for multiple discrete outcomes.
Journal of the American Statistical Association, 92, 1375–1386. Janssen, D. J. A., Spruit, M. A., Wouters, E. F. M., & Schols, J. M.
doi: 10.2307/2965407 G. A. (2008). Daily symptom burden in end-stage chronic organ
failure: A systematic review. Palliative Medicine, 22, 938–948.
Barsevick, A. M., Irwin, M. R., Hinds, P., Miller, A., Berger, A., Jacob- doi: 10.1177/0269216308096906
sen, P., … Cella, D. (2013). Recommendations for high-priority
research on cancer-related fatigue in children and adults. Journal Janssen, D. J., Spruit, M. A., Uszko-Lencer, N. H., Schols, J. M., &
of the National Cancer Institute, 105, 1432–1440. doi: 10.1093/ Wouters, E. F. (2011). Symptoms, comorbidities, and health care
jnci/djt242 in advanced chronic obstructive pulmonary disease or chronic
heart failure. Journal of Palliative Medicine, 14, 735–743. doi:
Borneman, T., Koczywas, M., Sun, V., Piper, B. F., Smith-Idell, C.,
10.1089/jpm.2010.0479
Laroya, B., … Ferrell, B. (2011). Effectiveness of a clinical inter-
vention to eliminate barriers to pain and fatigue management Kim, H. J., McGuire, D. B., Tulman, L., & Barsevick, A. M. (2005).
in oncology. Journal of Palliative Medicine, 14, 197–205. doi: Symptom clusters: Concept analysis and clinical implications for
10.1089/jpm.2010.0268 cancer nursing. Cancer Nursing, 28, 270–282.

Browall, M., Kenne Sarenmalm, E., Nasic, S., Wengstrom, Y., & Gas- Kirkova, J., Rybicki, L., Walsh, D., & Aktas, A. (2012).
ton-Johansson, F. (2013). Validity and reliability of the Swedish Symptom prevalence in advanced cancer: Age, gender,
version of the Memorial Symptom Assessment Scale (MSAS): An and performance status interactions. American Journal of
instrument for the evaluation of symptom prevalence, character- Hospice and Palliative Care, 29, 139–145. doi: 10.1177/
istics, and distress. Journal of Pain and Symptom Management, 10499091114109651049909111410965

Research in Nursing & Health


522 RESEARCH IN NURSING & HEALTH

Kris, A. E., & Dodd, M. J. (2004). Symptom experience of adult Symptom occurrence and symptom distress. Cancer Nursing,
hospitalized medical-surgical patients. Journal of Pain and 23, 49–54.
Symptom Management, 28, 451–459. doi: 10.1016/j.jpainsym-
Rhodes, V. A., & Watson, P. M. (1987). Symptom distress—The
man.2004.01.015, S0885-3924(04)00336.-7[pii]
concept: Past and present. Semininars in Oncology Nursing, 3,
Lo, Y. T., Mendell, N. R., & Rubin, D. B. (2001). Testing the number 242–247. doi: 10.1016/S0749-2081(87)80014-1
of components in a normal mixture. Biometrika, 88, 767–778. doi:
Sarna, L. (1998). Effectiveness of structured nursing assessment of
10.1093/biomet/88.3.767
symptom distress in advanced lung cancer. Oncology Nursing
Lubke, G., & Muthén, B. (2007). Performance of factor mixture mod- Forum, 25, 1041–1048.
els as a function of model size, covariate effects, and class-
Sigurdardottir, K. R., & Haugen, D. F. (2008). Prevalence of distress-
specific parameters. Structural Equation Modeling, 14, 26–47.
ing symptoms in hospitalised patients on medical wards: A
doi: 10.1080/10705510709336735
cross-sectional study. BMC Palliative Care, 7, 16. doi: 10.1186/
Mantha, S., Thisted, R., Foss, J., Ellis, J. E., & Roizen, M. F. (1993). 1472.-684X-7-16, 1472-684X-7-16[pii]
A proposal to use confidence intervals for visual analog scale Skerman, H. M., Yates, P. M., & Battistutta, D. (2009). Multivariate
data for pain measurement to determine clinical significance. methods to identify cancer-related symptom clusters. Research
Anesthesia & Analgesia, 77, 1041–1047. in Nursing & Health, 32, 345–360. doi: 10.1002/nur.20323
McLachlan, G. J., & Peel, D. (2000). Finite mixture models. Wiley Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Green-
series in probability and statistics. Applied probability and statis- halgh, J., Halyard, M. Y., … Santana, M. (2012). Implementing
tics section (Vol. xxii). New York: Wiley. patient-reported outcomes assessment in clinical practice: A
Miaskowski, C., Aouizerat, B. E., Dodd, M., & Cooper, B. (2007). review of the options and considerations. Quality of Life
Conceptual issues in symptom clusters research and their impli- Research, 21, 1305–1314. doi: 10.1007/s11136-011-0054-x
cations for quality-of-life assessment in patients with cancer. Solano, J. P., Gomes, B., & Higginson, I. J. (2006). A comparison
Journal of the National Cancer Institute. Monographs, 37, 39–46. of symptom prevalence in far advanced cancer, AIDS, heart
doi: 10.1093/jncimonographs/lgm003 disease, chronic obstructive pulmonary disease and renal
disease. Journal of Pain and Symptom Management, 31, 58–69.
Miaskowski, C., Dodd, M., & Lee, K. (2004). Symptom clusters: The
doi: 10.1016/j.jpainsymman.2005.06.007
new frontier in symptom management research. Journal of
National Cancer Institute. Monographs, 32, 17–21. doi: 10.1093/ Spichiger, E., Muller-Frohlich, C., Denhaerynck, K., Stoll, H., Hanti-
jncimonographs/lgh023 kainen, V., & Dodd, M. (2011). Symptom prevalence and
changes of symptoms over ten days in hospitalized patients with
Miaskowski, C., Cooper, B. A., Paul, S. M., Dodd, M., Lee, K.,
advanced cancer: A descriptive study. European Journal of
Aouizerat, B. E., … Bank, A. (2006). Subgroups of patients with
Oncology Nursing, 15, 95–102. doi: 10.1016/j.ejon.2010.06.005,
cancer with different symptom experiences and quality-of-life
S1462-3889(10)00097.-9[pii]
outcomes: A cluster analysis. Oncology Nursing Forum, 33,
E79–E89. doi: 10.1188/06.ONF.E79-E89 Teunissen, S. C., Wesker, W., Kruitwagen, C., de Haes, H. C., Voest,
E. E., & de Graeff, A. (2007). Symptom prevalence in patients
Muthén, B., & Muthén, L. (2007). Wald test of mean equality for
with incurable cancer: A systematic review. Journal of Pain
potential latent class predictors in mixture modeling. Retrieved
and Symptom Management, 34, 94–104. doi: 10.1016/j.
from http://www.statmodel.com/download/MeanTest1.pdf
jpainsymman.2006.10.015, S0885-3924(07)00201.-1[pii]
Muthén, B., & Muthén, L. (2013). MPlus (version 7.1). Los Angeles,
Tishelman, C., Degner, L. F., Rudman, A., Bertilsson, K., Bond, R.,
CA: Statmodel.
Broberger, E., … Levealahti, H. (2005). Symptoms in patients
Nekolaichuk, C., Watanabe, S., & Beaumont, C. (2008). The with lung carcinoma: Distinguishing distress from intensity.
Edmonton Symptom Assessment System: A 15-year retrospec- Cancer, 104, 2013–2021. doi: 10.1002/cncr.21398
tive review of validation studies (1991–2006). Palliative Medicine,
Tishelman, C., Lovgren, M., Broberger, E., Hamberg, K., &
22, 111–122. doi: 10.1177/026921630708765922/2/111
Sprangers, M. A. (2010). Are the most distressing concerns of
Nordgren, L., & Sorensen, S. (2003). Symptoms experienced in the patients with inoperable lung cancer adequately assessed?
last six months of life in patients with end-stage heart failure. A mixed-methods analysis. Journal of Clinical Oncology, 28,
European Journal of Cardiovascular Nursing, 2, 213–217. doi: 1942–1949. doi: 10.1200/JCO.2009.23.3403JCO.2009.23.3403
S1474515103000598
Tranmer, J. E., Heyland, D., Dudgeon, D., Groll, D., Squires-Gra-
Nylund, K. L., Asparoutiov, T., & Muthen, B. O. (2007). Deciding on ham, M., & Coulson, K. (2003). Measuring the symptom experi-
the number of classes in latent class analysis and growth mixture ence of seriously ill cancer and noncancer hospitalized patients
modeling: A Monte Carlo simulation study. Structural Equation near the end of life with the Memorial Symptom Assessment
Modeling, 14, 535–569. Scale. Journal of Pain and Symptom Management, 25, 420–429.
doi: S0885392403000745
Portenoy, R. K., Thaler, H. T., Kornblith, A. B., Lepore, J. M., Fried-
lander-Klar, H., Kiyasu, E., … Scher, H. (1994). The Memorial Wadensten, B., Frojd, C., Swenne, C. L., Gordh, T., & Gunningberg,
Symptom Assessment Scale: An instrument for the evaluation L. (2011). Why is pain still not being assessed adequately?
of symptom prevalence, characterisitics and distress. European Results of a pain prevalence study in a university hospital in
Journal of Cancer, 30A, 1326–1336. doi: 10.1016/0959-8049(94) Sweden. Journal of Clinical Nursing, 20, 624–634. doi: 10.1111/
90182-1 j.1365-2702.2010.03482.x

Rhodes, V. A., McDaniel, R. W., Homan, S. S., Johnson, M., & Mad- Wenzel, J. A., Griffith, K. A., Shang, J., Thompson, C. B., Hedlin, H.,
sen, R. (2000). An instrument to measure symptom experience: Stewart, K. J., … Mock, V. (2013). Impact of a home-based

Research in Nursing & Health


SYMPTOM DISTRESS PROFILE IN HOSPITALIZED PATIENTS/ HENOCH ET AL. 523

walking intervention on outcomes of sleep quality, emotional World Medical Association. (2008). The Code of Ethics of the World
distress, and fatigue in patients undergoing treatment for Medical Association. Retrieved from http://www.wma.net/en/
solid tumors. Oncologist, 18, 476–484. doi: 10.1634/theoncolo- 30publications/10policies/b3/.
gist.2012-0278
Vuong, Q. H. (1989). Likelihood ratio tests for model selection
WHO. (2010). International Classification of Diseases (ICD). and non-nested hypotheses. Econometrica, 57, 307–333. doi:
Retrieved from http://www.who.int/classifications/icd/en/ 10.2307/1912557

Acknowledgements
Support for the study was provided by the Health and Medical Care Committee of the Regional Executive Board, Västra Göta-
land Region, Sweden; Ulla-Carin Lindquist Foundation, Sweden; and Sahlgrenska University Hospital Foundations, Gothenburg,
Sweden.

Eva Jakobsson Ung Joakim Öhlén


Associate Professor Professor
Centre for Person-Centred Care (GPCC) Centre for Person-Centred Care (GPCC)
Sahlgrenska Academy Sahlgrenska Academy
University of Gothenburg University of Gothenburg
Gothenburg, Sweden Gothenburg, Sweden; Institute of Health and Care Sciences
Institute of Health and Care Sciences Sahlgrenska Academy
Sahlgrenska Academy University of Gothenburg
University of Gothenburg Gothenburg, Sweden
Gothenburg, Sweden Palliative Research Centre
Ersta Sköndal University College and Ersta Hospital
Elisabeth Kenne Sarenmalm Stockholm, Sweden
Research and Development Centre
Skaraborg Hospital Kristin Falk
Skövde, Sweden Centre for Person-Centred Care (GPCC)
Palliative Research Centre Sahlgrenska Academy
Ersta Sköndal University College and Ersta Hospital University of Gothenburg
Stockholm, Sweden Gothenburg, Sweden
Institute of Health and Care Sciences
Anneli Ozanne Sahlgrenska Academy
Institute of Neuroscience and Physiology University of Gothenburg
Sahlgrenska Academy Gothenburg, Sweden
University of Gothenburg
Gothenburg, Sweden

Research in Nursing & Health

You might also like