You are on page 1of 9

Psychological Services In the public domain

2014, Vol. 11, No. 1, 105–113 DOI: 10.1037/a0032780

Endorsed and Anticipated Stigma Inventory (EASI): A Tool for Assessing


Beliefs About Mental Illness and Mental Health Treatment Among Military
Personnel and Veterans

Dawne Vogt Brooke A. L. Di Leone and Joyce M. Wang


National Center for Posttraumatic Stress Disorder, VA Boston National Center for Posttraumatic Stress Disorder, VA Boston
Healthcare System, Boston, Massachusetts and Boston Healthcare System, Boston, Massachusetts
University School of Medicine

Nina A. Sayer Suzanne L. Pineles


Minneapolis VA Health Care System, Minneapolis, Minnesota National Center for Posttraumatic Stress Disorder, VA Boston
and University of Minnesota, Minneapolis Healthcare System, Boston, Massachusetts and Boston
University School of Medicine

Brett T. Litz
Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System,
Boston, Massachusetts and Boston University School of Medicine

Many military personnel and veterans who would benefit from mental health treatment do not seek care,
underscoring the need to identify factors that influence initiation and retention in mental health care. Both
endorsed and anticipated mental health stigma may serve as principal barriers to treatment seeking. To
date, most research on mental health stigma in military and veteran populations has relied on nonvali-
dated measures with limited content coverage and confounding in the assessment of different domains of
mental health stigma. This article describes the development and psychometric evaluation of the
Endorsed and Anticipated Stigma Inventory (EASI), which was designed to assess different dimensions
of stigma-related beliefs about mental health among military and veteran populations. Findings based on
a national sample of U.S. veterans deployed in support of Operation Enduring Freedom (OEF) in
Afghanistan or Operation Iraqi Freedom (OIF) in Iraq suggest that the EASI is a psychometrically sound
instrument. Specifically, results revealed evidence for the internal consistency reliability, content valid-
ity, convergent and discriminant validity, and discriminative validity of EASI scales. In addition,
confirmatory factor analysis results supported the proposed factor structure for this inventory of scales.

Keywords: stigma, barriers to care, VA health care use, veterans, military

Servicemembers are at risk for a range of mental health prob- 2005; Lapierre, Schwegler, & LaBauve, 2007; Milliken, Auchter-
lems due to their potential exposure to traumatic events during lonie, & Hoge, 2007). Despite the relatively high availability of
deployment. For example, findings indicate that a substantial mi- free or low-cost mental health services in both military and De-
nority of servicemembers deployed in support of the recent wars in partment of Veterans Affairs (VA) health care settings, many
Afghanistan and Iraq report symptoms consistent with posttrau- servicemembers and veterans who might benefit from treatment do
matic stress disorder (PTSD), depression, and alcohol abuse after not make use of available mental health services. For example, in
returning from deployment (Hoge et al., 2004; Kang & Hyams, a national sample of veterans deployed in support of Operation

This article was published Online First November 25, 2013. Medicine; Brett T. Litz, Massachusetts Veterans Epidemiology Research and
Dawne Vogt, Women’s Health Sciences Division, National Center for Post- Information Center, VA Boston Healthcare System and Department of Psychiatry,
traumatic Stress Disorder, VA Boston Healthcare System, Boston, Massachusetts, Boston University School of Medicine.
and Department of Psychiatry, Boston University School of Medicine; Brooke This research was supported, in part, by a Department of Veterans
A. L. Di Leone and Joyce M. Wang, Women’s Health Sciences Division, National Affairs Health Sciences Research and Development Service grant (DHI
Center for Posttraumatic Stress Disorder, VA Boston Healthcare System; Nina A. 06-225-2; Gender, Stigma, and Other Barriers to VHA Use for OEF/OIF
Sayer, Center for Chronic Disease Outcomes Research, Minneapolis VA Health Veterans; Principal Investigator: Dawne Vogt, PhD).
Care System, Minneapolis, Minnesota, and Departments of Medicine and Psychi- Correspondence concerning this article should be addressed to Dawne S.
atry, University of Minnesota, Minneapolis; Suzanne L. Pineles, Women’s Health Vogt, PhD, National Center for Posttraumatic Stress Disorder (116B-3),
Sciences Division, National Center for Posttraumatic Stress Disorder, VA Boston VA Boston Healthcare System, 150 South Huntington Avenue, Boston,
Healthcare System and Department of Psychiatry, Boston University School of MA 02130. E-mail: dawne.vogt@va.gov
105
106 VOGT, DI LEONE, WANG, SAYER, PINELES, AND LITZ

Enduring Freedom (OEF; Afghanistan) or Operation Iraqi Free- mental health care (Vogt, 2011). Therefore, the field would also
dom (OIF; Iraq), nearly half (47%) of individuals with probable benefit from the availability of measures that address perceptions
posttraumatic stress disorder (PTSD) or major depression had not of stigma independent of its perceived impact on treatment seek-
received any mental health care in the previous year and only 30% ing.
of those who had initially sought care reported having received a To address this gap, we developed and validated an instrument
minimally adequate amount of care (Schell & Marshall, 2008). that assesses a broad range of mental health beliefs that may have
Consequently, it is important for administrators, decision-makers, implications for servicemembers’ and veterans’ use of mental
leaders, and clinicians to identify and understand the factors that health care. Specifically, this instrument, called the Endorsed and
influence initiation and retention in mental health treatment among Anticipated Stigma Inventory (EASI) builds on prior conceptual-
military and veteran populations. izations of stigma put forth in the literature and addresses both
A review of the broader literature suggests two key facets of personal beliefs about mental illness and mental health treatment
stigma that may influence treatment seeking. The first facet, re- (i.e., endorsed stigma) and concerns about being stigmatized by
ferred to as endorsed stigma, is a key component of the self-stigma others for having a mental health problem (i.e., anticipated
process that reflects the extent to which an individual has incor- stigma). In the instrument development phase (Part 1), we defined
porated negative beliefs about the stigmatizing attribute (in this the stigma constructs that were the focus of this project and
case, beliefs about mental illness and mental health treatment) into operationalized these constructs via initial item development. In
his or her own personal belief system (Corrigan & Rao, 2012; Part 2, we examined the item and scale characteristics of the
Link, 1987). The second facet, which draws from Corrigan and resulting scales. Part 3 was an examination of evidence for con-
colleagues’ extensive body of work on public stigma related to vergent and discriminant validity, as well as the smaller literature
mental illness (e.g., Corrigan, 2004; Corrigan & Rusch, 2002) and on mental health stigma in discriminative validity. Part 4 was an
is referred to as anticipated stigma, reflects the extent to which an examination of the factor structure of the instrument using confir-
individual anticipates that he or she will be devalued or discredited matory factor analyses.
by others in the community for having the stigmatized attribute
(Earnshaw & Chaudoir, 2009; Earnshaw & Quinn, 2012; Markow- Method and Results
itz, 1998).
Although the military and veteran literature on mental health
Part 1: Instrument Development
stigma is somewhat more limited than the broader civilian litera-
ture, there is reason to believe that stigma may be an especially Defining the target construct and its content domains. We
powerful deterrent to service use among military and veteran used a rational approach to test construction that emphasized
populations. Specifically, it has been suggested that the high value content validity (Haynes, Richard, & Kubany, 1995; Jackson,
placed on competence, confidence, and “emotional toughness” in 1971; Nunnally & Bernstein, 1994). Our first step in the develop-
the military may contributed to increased stigma in these popula- ment of the EASI was to clearly define the core components of the
tions (Nash, Silva, & Litz, 2009; Sayer et al., 2009). Moreover, the targeted stigma constructs and elaborate on their content domains.
military includes a large proportion of young men, a group that has Our initial conceptualization of stigma-related beliefs about mental
been found to be especially uncomfortable with acknowledging illness and mental health treatment in military and veteran popu-
mental health problems and seeking care (Addis & Mahalik, 2003; lations drew from the broader literature on stigma (e.g., Cooper,
Greene-Shortridge, Britt, & Castro, 2007; Mojtabai, Olfson, & Corrigan, & Watson, 2003; Corrigan, 2004; Corrigan & Rusch,
Mechanic, 2002; Porter & Johnson, 1994). 2002; Earnshaw & Chaudoir, 2009; Earnshaw & Quinn, 2012;
Despite the potential relevance of both forms of stigma, research Leaf, Bruce, & Tischler, 1986; Link & Phelan, 2001; Mansfield,
on military and veteran populations has focused nearly exclusively Addis, & Courtenay, 2005; Sirey et al., 2001), as well as the more
on anticipated stigma as a barrier to care, paying far less attention limited literature on mental health stigma among members of the
to the role of self-stigma in service use (Vogt, 2011). The lack of military and veterans (e.g., Britt, 2000; Britt et al., 2008; Greene-
research on this topic may be accounted for, at least in part, by the Shortridge et al., 2007; Pietrzak, Johnson, Goldstein, Malley, &
lack of validated measures designed to assess different compo- Southwick, 2009).
nents of self-stigma that are relevant for these populations. As a Synthesizing what have largely been separate research areas, we
consequence, most military and veteran research to date has relied identified three potential components of endorsed stigma that may
on brief, nonvalidated measures that do not provide a broad as- be especially salient for military and veteran populations. These
sessment of stigma-related barriers to care or that confound the components include: (a) beliefs about mental illness (Brown, 2008;
assessment of different stigma components within a single scale Corrigan, Lickey, Campion, & Rashid, 2000; Day, Edgren, &
(Vogt, 2011). Another limitation is the lack of scales that assess Eshleman, 2007; Link, Phelan, Bresnahan, Stueve, & Pescosolido,
stigma independent of its perceived impact on service use. Find- 1999); (b) beliefs about mental health treatment (Leaf et al., 1986;
ings based on measures that require respondents to evaluate the Pirkis, Blood, Francis, & McCallum, 2006); and (c) beliefs about
impact that stigma has on their service use, such as the widely used help-seeking for mental health problems (Mansfield et al., 2005;
Perceived Stigma and Barriers to Care for Psychological Problems Ojeda & Bergstresser, 2008; Perlick & Manning, 2006; Waldron,
scale (Britt, 2000), are important in their ability to highlight the 1997). As conceptualized in this measure, content domains within
extent to which servicemembers and veterans perceive stigma as a the beliefs about mental illness construct reflect beliefs about the
barrier to care. However, some individuals may not feel comfort- character and competence of people with mental health problems,
able acknowledging or not even realize the role that their own or as well as one’s level of comfort interacting with people with
others’ biases about mental illness play in their willingness to seek mental illness. Content domains in the beliefs about mental health
ENDORSED AND ANTICIPATED STIGMA INVENTORY 107

treatment construct include beliefs about talk therapy, medication, Experts were asked to provide judgments regarding the content sat-
and mental health providers. Content domains in the beliefs about uration of each item with respect to its content domain and to identify
help-seeking construct include beliefs about the legitimacy of items that were confusing, poorly written, or had overlapping content.
seeking help for mental health problems, as well as level of In cases where redundancy was identified, the item that was judged as
comfort with being in the “patient” role. most comprehensible and concise was retained. The end result of
Based on our review of this literature, we identified two general these steps was a newly refined pool of eight items per component, all
components of anticipated stigma related to mental health problems: clearly expressed and heavily saturated with the desired content.
(a) concern about stigma from loved ones, and (b) concern about Given that military personnel are typically required to have at least a
stigma in the workplace. Content domains within the concern about high school diploma, items were targeted to a high school grade level.
public stigma from loved ones construct reflect individuals’ beliefs An examination of the scale’s readability confirmed that all scales
about the consequences of having a mental health problem for family were appropriate for use with samples that have completed at least a
members’ and friends’ level of comfort being around them and ninth-grade education. Specifically, the Flesch-Kincaid Grade Level
perceptions of their character and competence. Content domains score (Flesch, 1949) was 7.2 for the Beliefs about Mental Illness scale,
within the concern about stigma in the workplace construct reflect 8.4 for the Beliefs about Mental Health Treatment scale, 6.7 for the
individuals’ beliefs about the consequences of having a mental health Beliefs about Treatment Seeking scale, 8.3 for the Concerns about
problem for supervisors’ and coworkers’ level of comfort being Stigma from Loved Ones scale, and 9.1 for the Concerns about
around them and perceptions of their character and competence, as Stigma in the Workplace scale.
well as potential career consequences. Although concerns about
stigma from loved ones are likely to be relevant for both current and
Part 2: Initial Item and Scale Analyses
former military personnel, concerns about mental health stigma in the
workplace may be an especially salient barrier to care for current Using data generated from a national mail survey of OEF/OIF
military personnel given the negative consequences that having a veterans, we first calculated frequency distributions and examined
mental health problem may have on servicemembers’ military ca- skewness and kurtosis for all items in the EASI. Next, we computed
reers. classical-test-theory-oriented item and scale characteristics (Aiken,
Item development. Guided by the above definitions, and with 1994; Anastasi, 1988; Nunnally & Bernstein, 1994), with the goal of
ongoing reference to the broader literature, we developed an initial identifying any items that detracted from reliability and should be
pool of items to reflect the content of each of these core components: considered for elimination. Once item sets were finalized, means,
(a) beliefs about mental illness, (b) beliefs about mental health treat- standard deviations, and ranges were calculated for each scale (see
ment, (c) beliefs about treatment-seeking, (d) concerns about stigma Table 1).
from loved ones, and (e) concerns about stigma in the workplace. Participants. The emphasis in instrument development is to
Items were framed as statements (e.g., “If I had a mental health achieve a sample that has broad dispersion on the attributes that are
problem and family/friends knew about it, they would think less of the focus of the psychometric inquiry and ample representation of the
me”) and a 5-point Likert-type response format, ranging from 1 kinds of persons for whom the instrument is intended (Nunnally &
(strongly disagree) to 5 (strongly agree) was selected to allow re- Bernstein, 1994). Potential participants were randomly selected from
spondents to indicate their level of agreement with each statement. No a Defense Manpower Data Center (DMDC) roster of all U.S. OEF/
reverse-scored items were included, but positively phrased filler items OIF veterans who had experienced a deployment in support of either
(e.g., “If I had a mental health problem and family/friends knew about OEF or OIF, and were separated from military service at the time of
it, they would be supportive of me”) were included to reduce nega- the survey. All participants had returned from deployment between
tivity bias. Scales were scored so that higher scores were indicative of January 2007 and January 2009. To allow for gender-stratified anal-
greater stigma in each of the domains assessed in this inventory of yses, the sample was stratified on gender (50% men, 50% women). A
scales. modification of the Dillman, Smyth, and Christian (2009) mail survey
A table of specifications (Aiken, 1994) was developed to identify procedure was used for data collection, involving up to five contacts
key domains within each component and aid in the orderly construc- and a $20 prepaid gift card incentive in the first mailing of the survey.
tion of item statements or questions across content areas. More spe- Of 2,950 potential participants, 461 could not be located and 17
cifically, different aspects of each component were identified, and responded to indicate that they were ineligible for the study (i.e., not
items were written to systematically represent each content domain. OEF/OIF veterans). Among the remaining 2,472 individuals believed
The initial item sets along with the formal definition from which they to have received the survey, 707 returned completed surveys for a
were derived were reviewed by content and psychometric experts. response rate of 29%. We compared survey responders with nonre-

Table 1
Item and Scale Characteristics of the EASI

Variable n Mean SD Range Alpha

Beliefs about mental illness 677 18.13 5.65 8–34 .86


Beliefs about mental health treatment 676 19.43 5.43 8–37 .84
Beliefs about treatment seeking 681 21.17 6.85 8–40 .86
Concerns about stigma from loved ones 672 18.56 7.59 8–39 .92
Concerns about stigma in the workplace 679 23.81 7.56 8–40 .93
108 VOGT, DI LEONE, WANG, SAYER, PINELES, AND LITZ

sponders on demographic and military characteristics drawn from whether individuals with and without probable PTSD, depression, and
DMDC data to explore potential nonresponse bias. Overall, findings alcohol abuse differed on the stigma scales.
revealed few differences and those differences that were observed
were generally small and unlikely to influence the specific associa-
Additional Measures
tions under examination in this study. Differences between responders
and nonresponders were small with regard to gender (Cramer’s ␾ ⫽ Marlowe-Crowne Social Desirability Scale (Crowne & Mar-
⫺0.11), age (r ⫽ .190) race (Cramer’s ␾ ⫽ ⫺0.041), military rank lowe, 1960). A 13-item instrument (␣ ⫽. 84) was used to mea-
(Cramer’s V ⫽ 0.146), education (Cramer’s ␾ ⫽ 0.187), marital status sure an individual’s tendency to describe himself/herself favorably
(Cramer’s ␾ ⫽ ⫺.071), military branch (Cramer’s V ⫽ 0.079), and or in a socially desirable manner. Scores were computed as the
duty status (Cramer’s ␾ ⫽ 0.005). Of the 707 respondents who number of item responses in the keyed direction based on a
provided completed surveys, 702 veterans who had returned their true/false like response like response format. Higher scores indi-
surveys prior to the initiation of this study were included in the current cate more social desirability. Sample items are “I have never
analyses. intensely disliked anyone,” “I sometimes feel resentful when I
The sample was composed of 57% women and 43% men, and was don’t get my way,” and “There have been occasions when I took
primarily Caucasian (66%), with 16% identifying as African Ameri- advantage of someone” (reverse scored). The estimate of internal
can. The mean age was 37.52 (SD ⫽ 9.99), and 40% of participants consistency reliability for this scale was .79 in the current sample.
reported having a college degree. Approximately 79% were deployed PTSD Checklist–Military Version (PCL; Weathers, Litz,
from Active Duty and 21% were from the National Guard or Reserve Herman, Huska, & Keane, 1993). The PCL was used to assess
components. Veterans from all branches of service were included: posttraumatic stress symptomatology related to stressful deployment
Army (50%), Air Force (24%), Navy (18%), and Marines (8%). experiences. The 17 items are directly adapted from the Diagnostic
Further details about this sample and the methodology are available and Statistical Manual of Mental Disorders (DSM–IV; American
from the first author. Psychiatric Association, 1994) to assess reexperiencing, avoidance
Results. Calculation of frequency distributions and examination and emotional numbing, and hyperarousal symptoms. Respondents
of skewness and kurtosis in the full sample revealed no problems with were asked to rate how much they have been bothered by each
dispersion on these items. Thus, we next examined estimates of symptom in the past 6 month. Coefficient alpha was .97 in the current
internal consistency reliability and associated statistics for each scale. sample. Based on commonly used criteria for classifying probable
As indicated in the last column of Table 1, internal consistency PTSD among OEF/OIF veterans (Tanielian & Jaycox, 2008), those
reliability estimates for all scales exceeded .80 and were, therefore, who had a minimum score of 50 (139 participants, 21% of total
considered acceptable. Item-total correlation values were also all sample) were identified as having probable PTSD.
acceptable, with values of at least .40 for all items within each scale, Beck Depression Inventory–Primary Care (Beck, Ward,
exceeding the minimum threshold for acceptability (i.e., .30; Nun- Mendelson, Mock, & Erbaugh, 1961). An adapted version of
the 7-item Beck Depression Inventory-Primary Care was used to
nally & Bernstein, 1994). Specifically, item-total correlation values
index depression symptoms (Beck, Steer, Ball, Ciervo, & Kabat,
ranged from .47 to .75 for the Beliefs about Mental Illness scale
1997). This measure consists of seven statements extracted from the
(average value ⫽ .61), .43 to .70 for the Beliefs about Mental Health
original Beck Depression Inventory (Beck et al., 1961) but with a
Treatment Scale (average value ⫽ .58), .46 to .71 for the Beliefs about
variation in the response format; unlike the original Beck instrument,
Treatment Seeking scale (average value ⫽ .61), .66 to .80 for the
each item is rated on a 5-point scale, with anchors ranging from 1 ⫽
Concerns about Stigma from Loved Ones scale (average value ⫽ .72),
strongly disagree to 5 ⫽ strongly agree. Sample items include “In the
.60 to .84 for the Concerns about Stigma in the Workplace scale
last 6 months, I have felt like a failure,” and “In the last 6 months, I
(average value ⫽ .76). Together, these findings provide evidence for
have had thoughts of killing myself.” Scores on the original Beck
the internal consistency reliability of the scales included in the EASI.
Depression Inventory have correlated well with clinicians’ judgments
of depression intensity (Beck, Steer, & Garbin, 1988). The coefficient
Part 3: Evidence for Validity alpha for this brief form of the measure is .91. The standard, empir-
ically tested cut-off for the BDI-PC is a score of 4 for maximum
Having created a content-saturated and internally consistent inven- clinical efficiency, specificity, and sensitivity (Beck et al., 1997; Steer,
tory of endorsed and anticipated stigma scales (see Appendix for the Cavalieri, Leonard, & Beck, 1999). Based on a commensurate cut-off
40-item EASI), we next turned attention to examining evidence for to the BDI-PC’s score of 4, those who endorsed a 4 or greater on at
the validity of this measure based on the same sample of OEF/OIF least four of the seven items (263 participants, 39%) were classified as
veterans. Associations among the three endorsed stigma scales and having probable depression.
two anticipated stigma scales were examined to confirm their con- CAGE. The CAGE (Ewing, 1984) is a 4-item questionnaire that
vergent validity. Associations between the endorsed and anticipated assesses the presence of clinically significant alcohol use. A correla-
scales were examined to confirm their discriminant validity. Further tion of .89 has been shown between CAGE scores and diagnoses
evidence of discriminant validity was sought in terms of the associ- when using the dichotomous, two-item cutoff method for scoring
ation between these scales and a measure of social desirability. A final (Bradley, Kivlahan, Bush, McDonell, & Fihn, 2001). Coefficient
set of analyses was conducted to examine the discriminative validity alpha was .68 in the current sample. Based on commonly used criteria
of these scales with respect to mental health symptomatology, as it is for classifying probable alcohol abuse (Buchsbaum, Buchanan, Cen-
well-established that individuals with mental health problems report tor, Schnoll, & Lawton, 1991), those who had a minimum score of 2
more stigma-related concerns than those without mental health prob- (106 participants, 16%) were identified as having probable alcohol
lems (e.g., Hoge et al., 2004). Specifically, analyses examined abuse.
ENDORSED AND ANTICIPATED STIGMA INVENTORY 109

Results. As indicated in Table 2, none of the correlations among a second-order factor structures that included two higher-level con-
either endorsed or anticipated stigma scales exceeded .70, suggesting structs corresponding to endorsed and anticipated stigma and five
that each scale addresses unique content (Kline, 2005). The highest first-order factors corresponding to the five proposed scales, and (d) a
correlation was observed between the two anticipated stigma scales, second-order factor structure that included a single overriding second-
but these scales still shared less than half of their variance with one order stigma factor and five first-order factors corresponding to the
another (R ⫽ .64; R-squared ⫽ .41). In support of the convergent and five proposed scales. We conducted analyses using MPlus Version
discriminant validity of endorsed and anticipated stigma scales rela- 3.11 (Muthén & Muthén, 2004) and applied maximum likelihood
tive to other scales in this inventory (Campbell & Fiske, 1959), the estimation.
average correlations observed among the three endorsed scales (.54) The model that corresponded to the five proposed scales provided
and the correlation between the two anticipated scales (.64) both better fit to the data than any of the alternative model structures that
exceeded the average correlations observed between endorsed and were tested, as indicated in the results presented in Table 4. Although
anticipated stigma scales (.29). the chi square statistics for all models were significant (p ⬍ .05), this
Given that the EASI assesses beliefs that may portray individuals in is common in larger samples and indices based on the noncentral chi
an unfavorable light (e.g., “I don’t feel comfortable around people square (i.e., RMSEA and CFI) are considered more relevant to inter-
with mental health problems”), it is possible that this set of scales may preting fit under these circumstances (Browne & Cudeck, 1993). The
be affected by a general tendency to respond in a socially desirable RMSEA for the five-factor model demonstrated good fit (Browne &
manner. Thus, we also examined the association between these scales Cudeck, 1993; Hu & Bentler, 1998; Steiger, 1990), and the Compar-
and a measure of socially desirable response style. As indicated in ative Fit Index (CFI; Bentler, 1990) approached the recommended
Table 2, associations between these scales were in the modest range, value of .90 (Byrne, 1994). Likewise, the Standardized Root Mean
suggesting that responses on these scales are, at least to a small extent, Square Residual (SRMR) was well below the minimum recom-
negatively related to a general tendency to respond in a more socially mended values of .10 (Hu & Bentler, 1998) for the five-factor model.
desirable manner. In addition, all items proposed to load on each of the five factors had
Prior research indicates that individuals with mental health prob- critical ratios that exceeded 2.00 and all standardized factor loadings
lems endorse more concerns about stigma. Thus, evidence for dis- for each of the five factors exceeded .40 (average of .64 for Beliefs
criminative validity would be provided to the extent that individuals about Treatment, .66 for Beliefs about Treatment-Seeking, and .66 for
with probable mental health problems report more stigma on the Beliefs about Mental Illness, .76 for Concern about Stigma from
EASI scales than individuals who do not meet criteria for mental Loved Ones, and .79 for Concerns about Stigma in the Workplace).
health problems. For the purpose of this analysis, individuals who met In contrast, fit indices for both the two-factor and one-factor models
criteria for probable PTSD, depression, or substance abuse (n ⫽ 139 were indicative of poor fit and chi square difference tests demon-
for PTSD, n ⫽ 263 for depression, and n ⫽ 106 for substance abuse) strated superior fit for the five-factor model relative to either the
were compared with individuals who did not meet criteria for these two-factor or one-factor models. Fit was also weaker for the two
mental health conditions. As indicated in Table 3, mean differences second-order factor structures that were tested. It is noteworthy,
were observed on most EASI scales for those with and without these however, that the second-order factor structure that specified two
probable mental health conditions, suggesting that individuals with higher-level factors corresponding to endorsed and anticipated stigma
mental health problems endorsed more stigma than those who did not demonstrated only slightly worse fit than the five-factor model, pro-
report symptoms consistent with PTSD, depression, or alcohol abuse. viding support for the broader distinction that has been drawn be-
tween endorsed and anticipated stigma. Further details regarding these
Part 4: Factor Structure factor solutions are available from the first author.

Part 4 was an examination of the factor structure of the EASI.


Summary and Discussion
Confirmatory factor analyses were conducted to examine the pro-
posed five-factor structure underlying the five scales of the EASI, as The goal of this study was to create a theoretically grounded and
it compares with other plausible factor structures. Specifically, this psychometrically strong measure of stigma-related mental health be-
model was compared with: (a) a two-factor model that specified two liefs that could be used with military and veteran populations. Evi-
separate endorsed and anticipated stigma factors, (b) a one-factor dence for the content validity, internal consistency reliability, conver-
model that specified one large factor subsuming all stigma scales, (c) gent and discriminant validity, discriminative validity, and factor

Table 2
Correlations Among EASI Scales

Variable 1 2 3 4 5 6

1. Beliefs about mental illness — .55ⴱ .47ⴱ .51ⴱ .36ⴱ ⫺.13ⴱ


2. Beliefs about mental health treatment — .61ⴱ .49ⴱ .37ⴱ ⫺.25ⴱ
3. Beliefs about treatment seeking — .48ⴱ .38ⴱ ⫺.24ⴱ
4. Concerns about stigma from loved ones — .64ⴱ ⫺.31ⴱ
5. Concerns about stigma in the workplace — ⫺.25ⴱ
6. Social desirability —
Note. ns ranged from 646 – 681.

p ⬍ .05.
110 VOGT, DI LEONE, WANG, SAYER, PINELES, AND LITZ

Table 3
Mean Differences on EASI Scales for Individuals With and Without Mental Health Problems

Above threshold Below threshold


Study Variables Mean SD n Mean SD n df t r

Probable PTSD
Beliefs about mental illness 17.46 5.63 136 18.18 5.63 513 647 1.32 .05
Beliefs about mental health treatment 21.60 6.36 135 18.74 5.04 515 648 ⫺5.54ⴱ .21
Beliefs about treatment seeking 22.51 7.42 135 20.83 6.66 519 652 ⫺2.55ⴱ .10
Concerns about stigma from loved ones 22.23 8.12 133 17.42 7.08 511 642 ⫺6.78ⴱ .26
Concerns about stigma in workplace 27.20 7.66 138 22.75 7.28 511 647 ⫺6.30ⴱ .24
Probable depression
Beliefs about mental illness 18.40 5.76 253 17.89 5.54 403 654 ⫺1.11 .04
Beliefs about mental health treatment 20.48 5.83 252 18.67 5.03 404 654 ⫺4.21ⴱ .16
Beliefs about treatment seeking 22.38 7.31 253 20.33 6.48 407 658 ⫺3.76ⴱ .15
Concerns about stigma from loved ones 20.93 8.08 250 16.93 6.79 401 649 ⫺6.78ⴱ .26
Concerns about stigma in workplace 26.09 7.72 253 22.22 7.04 404 655 ⫺6.60ⴱ .25
Probable alcohol abuse
Beliefs about mental illness 17.75 5.63 103 18.14 5.64 553 654 .64 .03
Beliefs about mental health treatment 20.13 5.63 106 19.24 5.41 548 652 ⫺1.55 .06
Beliefs about treatment seeking 22.65 6.98 104 20.87 6.81 556 658 ⫺2.45ⴱ .10
Concerns about stigma from loved ones 19.89 8.05 102 18.26 7.42 547 647 ⫺2.01ⴱ .08
Concerns about stigma in workplace 25.39 7.43 105 23.41 7.54 551 654 ⫺2.48ⴱ .10

p ⬍ .05.

structure of the EASI was provided. The full inventory takes less than struct that has received less attention in the military and veteran
10 minutes to complete. As such, it offers an efficient tool for literature.
assessing dimensions of both endorsed and anticipated mental health Although initial psychometric support for of the EASI is encour-
stigma that are likely to have implications for mental health treatment. aging, additional research is needed to further explore its psychomet-
Findings based on the EASI can be applied to inform public health ric properties. For example, evidence is needed for the test–retest
interventions targeted at reducing mental health stigma among mili- reliability of this suite of scales, and it will be important to validate the
tary and veteran populations. Specifically, this scale can be used to psychometric characteristics of the EASI in other military and veteran
pinpoint specific components of stigma that require attention in public samples, including current servicemembers and other veteran cohorts
health campaigns. For example, if negative beliefs about treatment (e.g., Vietnam veterans). In addition, though this measure was spe-
seeking are found to be a key barrier to care, this would suggest the cifically developed for use in military and veteran populations, future
need for interventions targeted at encouraging and normalizing help- research should examine its generalizability to other groups with high
seeking. Alternatively, the findings that negative beliefs about mental base-rate mental health problems. Future studies should also explore
illness or mental health treatment are particularly common would how this measure relates to other measures that address related aspects
underscore the importance of efforts aimed at correcting mispercep- of mental health stigma, such as the Perceived Stigma and Barriers to
tions about people with mental illness and educating military person- Care for Psychological Problems measure (Britt, 2000). It will be
nel and veterans about the benefits of mental health treatment. Scales especially important to evaluate how the endorsed stigma scales
from the EASI may also be applied to identify subpopulations that assessed in the EASI relate to measures of other components of the
would benefit most from public health interventions. For example, if self-stigmatization process. For example, an important research ques-
men were identified as more likely to hold negative beliefs about tion pertains to the impact of endorsed stigma on the self-esteem of
mental health treatment than women, it would suggest a greater need individuals who experience mental health problems, as internalized
for interventions targeted to male rather than female veterans. More- stigma is likely to be a key mechanism through which negative beliefs
over, the EASI assesses anticipated stigma from loved ones, a con- about mental illness and mental health treatment have their impact on

Table 4
Goodness-of-Fit Indices for Five-, Two-, and One-Factor Models

Model fit Comparison


Model ␹ 2
df RMSEA CFI SRMR Models ␹diff
2
dfdiff

1. Five-factor model 2455.32 730 .06 .89 .05
2. Two-factor first-order model 5289.65ⴱ 739 .09 .71 .08 1 vs. 2 2834.33ⴱ 9
3. One-factor first-order model 7517.34ⴱ 740 .12 .57 .10 1 vs. 3 5062.02ⴱ 10
4. Two-factor second-order model 2484.10ⴱ 734 .06 .89 .05 1 vs. 4 28.68ⴱ 4
5. One-factor second-order model 2606.04ⴱ 735 .06 .88 .06 1 vs. 5 150.72ⴱ 5
Note. N ⫽ 698.

p ⬍ .05.
ENDORSED AND ANTICIPATED STIGMA INVENTORY 111

treatment seeking. It is also important to recognize that responses to Brown, S. A. (2008). Factors and measurement of mental illness stigma: A
EASI scales are modestly associated with concerns about social psychometric examination of the Attribution Questionnaire. Psychiatric
desirability. Thus, researchers who use this inventory of scales in Rehabilitation Journal, 32, 89 –94. doi:10.2975/32.2.2008.89.94
future studies may wish to consider controlling for social desirability Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model
fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation
as appropriate.
models (pp. 136 –162). Beverly Hills, CA: Sage.
Finally, it is important to recognize that not all mental health beliefs
Buchsbaum, D., Buchanan, R., Centor, R., Schnoll, S., & Lawton, M.
addressed in the EASI necessarily represent beliefs that are based on (1991). Screening for alcohol abuse using CAGE scores and likelihood
biased or inaccurate appraisals. For example, the concern that there ratios. Annals of Internal Medicine, 115, 774 –777.
may be negative career consequences if supervisors or coworkers Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/
know about mental health problems is often a valid concern for Windows: Basic concepts, applications, and programming. Thousand
military personnel, given that commanding officers may use medical Oaks, CA: Sage.
records to inform decisions about whether a servicemember is fit to Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant
perform specific job responsibilities (Porter & Johnson, 1994; Rosen validation by the multitrait–multimethod matrix. Psychological Bulletin,
& Corcoran, 1978). Likewise, some personal beliefs about mental 56, 81–105. doi:10.1037/h0046016
Cooper, A. E., Corrigan, P. W., & Watson, A. C. (2003). Mental illness
illness and mental health treatment may be valid. For example, con-
stigma and care seeking. Journal of Nervous and Mental Disease, 191,
cerns about the negative side effects of medication for mental health
339 –341. doi:10.1097/01.NMD.0000066157.47101.22
problems may be quite well-founded in some cases. Corrigan, P. W. (2004). How stigma interferes with mental health care.
In conclusion, the EASI is a new inventory that assesses mental American Psychologist, 59, 614 – 625. doi:10.1037/0003-066X.59.7.614
health beliefs that may be particularly salient for military and veteran Corrigan, P. W., Lickey, S. E., Campion, J., & Rashid, F. (2000). Mental
populations. It is our hope that the availability of these scales will spur health team leadership and consumers’ satisfaction and quality of life.
further research on the role of mental health stigma in servicemem- Psychiatric Services, 51, 781–785. doi:10.1176/appi.ps.51.6.781
bers’ and veterans’ willingness to seek mental health treatment, and Corrigan, P. W., & Rao, D. (2012). On the self-stigma of mental illness:
inform interventions aimed at addressing aspects of mental health Stages, disclosure, and strategies for change. Canadian Journal of Psy-
stigma that serve as barriers to care. chiatry, 57, 464 – 469.
Corrigan, P. W., & Rusch, L. C. (2002). Mental illness stereotypes and clinical
care: Do people avoid treatment because of stigma? Psychiatric Rehabili-
References tation Skills, 6, 312–334. doi:10.1080/10973430208408441
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability
Addis, M. E., & Mahalik, J. R. (2003). Men, masculinity, and the contexts independent of psychopathology. Journal of Consulting Psychology, 24,
of help seeking. American Psychologist, 58, 5–14. doi:10.1037/0003- 349 –354. doi:10.1037/h0047358
066X.58.1.5 Day, E. N., Edgren, K., & Eshleman, A. (2007). Measuring stigma toward
Aiken, L. R. (1994). Psychological testing and assessment (8th ed.). mental illness: Development and application of the mental illness stigma
Boston, MA: Allyn & Bacon. scale. Journal of Applied Social Psychology, 37, 2191–2219. doi:
American Psychiatric Association. (1994). Diagnostic and Statistical Man- 10.1111/j.1559-1816.2007.00255.x
ual of Mental Disorders (4th ed.). Washington, DC: Author. Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, mail, and
Anastasi, A. (1988). Psychological testing (6th ed.). New York, NY: mixed-mode surveys: The tailored design method (3rd ed.). New York, NY:
Macmillan. Wiley.
Beck, A. T., Steer, R. A., Ball, R., Ciervo, C. A., & Kabat, M. (1997). Use Earnshaw, V. A., & Chaudoir, S. R. (2009). From conceptualizing to
of the Beck Anxiety and Depression Inventories for primary care with measuring HIV stigma: A review of HIV stigma mechanisms measures.
medical outpatients. Assessment, 4, 211–219. AIDS and Behavior, 13, 1160 –1177. doi:10.1007/s10461-009-9593-3
Beck, A. T., Steer, R. A., & Garbin, M. G. (1988). Psychometric properties of Earnshaw, V. A., & Quinn, D. M. (2012). The impact of stigma in
the Beck Depression Inventory: Twenty-five years later. Clinical Psychol- healthcare on people living with chronic illnesses. Journal of Health
ogy Review, 8, 77–100. doi:10.1016/0272-7358(88)90050-5 Psychology, 17, 157–168. doi:10.1177/1359105311414952
Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An Ewing, J. A. (1984). Detecting alcoholism: The CAGE questionnaire.
inventory for measuring depression. Archives of General Psychiatry, 4, Journal of the American Medical Association, 252, 1905–1907. doi:
561–571. doi:10.1001/archpsyc.1961.01710120031004 10.1001/jama.1984.03350140051025
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psycho- Flesch, R. (1949). The art of readable writing. New York, NY: Harper and
logical Bulletin, 107, 238 –246. doi:10.1037//0033-2909.107.2.238 Brothers.
Bradley, K., Kivlahan, D., Bush, K., McDonell, M., & Fihn, S. (2001). Greene-Shortridge, T. M., Britt, T. W., & Castro, C. A. (2007). The stigma of
Variations on the CAGE alcohol screening questionnaire: Strengths and mental health problems in the military. Military Medicine, 172, 157–161.
limitations in VA general medical patients. Alcoholism: Clinical and Ex- Haynes, S. N., Richard, D. R., & Kubany, E. S. (1995). Content validity in
perimental Research, 25, 1472–1478. doi:10.1111/j.1530-0277.2001 psychological assessment: A functional approach to concepts and methods.
.tb02149.x Psychological Assessment, 7, 238 –247. doi:10.1037/1040-3590.7.3.238
Britt, T. W. (2000). The stigma of psychological problems in a work environ- Hoge, C. W., Castro, C. A., Messer, S. C., McGurk, D., Cotting, D. I., &
ment: Evidence from the screening of service members returning from Koffman, R. L. (2004). Combat duty in Iraq and Afghanistan, mental health
Bosnia. Journal of Applied Social Psychology, 30, 1599 –1618. doi:10.1111/ problems, and barriers to care. The New England Journal of Medicine, 351,
j.1559-1816.2000.tb02457.x 13–22. doi:10.1056/NEJMoa040603
Britt, T. W., Greene-Shortridge, T. M., Brink, S., Nguyen, Q. B., Rath, J., Cox, Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling:
A. L. . . . Castro, C. A. (2008). Perceived stigma and barriers to care for Sensitivity to underparameterized model misspecification. Psychological
psychological treatment: Implications for reactions to stressors in different Methods, 3, 424 – 453. doi:10.1037//1082-989X.3.4.424
contexts. Journal of Social and Clinical Psychology, 27, 317–335. doi: Jackson, D. N. (1971). The dynamics of structured personality tests.
10.1521/jscp.2008.27.4.317 Psychological Review, 78, 229 –248. doi:10.1037/h0030852
112 VOGT, DI LEONE, WANG, SAYER, PINELES, AND LITZ

Kang, H. K., & Hyams, K. C. (2005). Mental health care needs among to mental health treatment. In J. E. Grant & M. N. Potenza (Eds.), The
recent war veterans. New England Journal of Medicine, 352, 1289. textbook of men’s mental health (pp. 389 – 417). Arlington, VA: Amer-
doi:10.1056/NEJMp058024 ican Psychiatric Publishing.
Kline, R. B. (2005). Principles and practice of structural equation mod- Pietrzak, R. H., Johnson, D. C., Goldstein, M. B., Malley, J. C., & Southwick,
eling. New York: Guilford Press. S. M. (2009). Perceived stigma and barriers to mental health care utilization
Lapierre, C. B., Schwegler, A. F., & LaBauve, B. J. (2007). Posttraumatic among OEF-OIF veterans. Psychiatric Services, 60, 1118 –1122. doi:
stress and depression symptoms in soldiers returning from combat 10.1176/appi.ps.60.8.1118
operations in Iraq and Afghanistan. Journal of Traumatic Stress, 20, Pirkis, J., Blood, R. W., Francis, C., & McCallum, K. (2006). On-screen
933–943. doi:10.1002/jts.20278 portrayals of mental illness: Extent, nature, and impacts. Journal of
Leaf, P. J., Bruce, M. L., & Tischler, G. L. (1986). The differential effect Health Communication, 11, 523–541. doi:10.1080/10810730600755889
of attitudes on the use of mental health services. Social Psychiatry, 21, Porter, T. L., & Johnson, W. B. (1994). Psychiatric stigma in the military.
187–192. doi:10.1007/BF00583999 Military Medicine, 159, 602– 605.
Link, B. G. (1987). Understanding labeling effects in the area of mental Rosen, H., & Corcoran, J. F. (1978). The attitudes of USAF officers toward
disorders: An assessment of the effects of expectations of rejection. Amer- mental illness: A comparison with mental health professionals. Military
ican Sociological Review, 52, 96 –112. doi:10.2307/2095395 Medicine, 143, 570 –574.
Link, B. G., & Phelan, J. C. (2001). Conceptualizing stigma. Annual Review of Sayer, N. A., Friedemann-Sanchez, G., Spoont, M., Murdoch, M., Parker,
Sociology, 27, 363–385. doi:10.1146/annurev.soc.27.1.363 L. E., Chiros, C., & Rosenheck, R. (2009). A qualitative study of determi-
Link, B. G., Phelan, J. C., Bresnahan, M., Stueve, A., & Pescosolido, B. A. nants of PTSD treatment initiation in veterans. Psychiatry, 72, 238 –255.
(1999). Public conceptions of mental illness: Labels, causes, dangerous- Schell, T. L., & Marshall, G. N. (2008). Survey of individuals previously
ness, and social distance. American Journal of Public Health, 89, 1328 – deployed for OEF/OIF. In T. Tanielian & L. H. Jaycox (Eds.), Invisible
1333. doi:10.2105/AJPH.89.9.1328 wounds of war: Psychological and cognitive injuries, their consequences,
Mansfield, A. K., Addis, M. E., & Courtenay, W. (2005). Measurement of and services to assist recovery (pp. 87–115). Santa Monica, CA: RAND
men’s help seeking: Development and evaluation of the barriers to help Center for Military Health Policy Research.
seeking scale. Psychology of Men & Masculinity, 6, 95–108. doi: Sirey, J. A., Bruce, M. L., Alexopoulos, G. S., Perlick, D. A., Friedman,
10.1037/1524-9220.6.2.95 S. J., & Meyers, B. S. (2001). Stigma as a barrier to recovery: Perceived
Markowitz, F. E. (1998). The effects of stigma on the psychological well-being stigma and patient-rated severity of illness as predictors of antidepres-
and life satisfaction of persons with mental illness. Journal of Health and sant drug adherence. Psychiatric Services, 52, 1615–1620. doi:10.1176/
Social Behavior, 39, 335–347. doi:10.2307/2676342 appi.ps.52.12.1615
Milliken, C. S., Auchterlonie, J. L., & Hoge, C. W. (2007). Longitudinal Steer, R. A., Cavalieri, T. A., Leonard, D. M., & Beck, A. T. (1999). Use
assessment of mental health problems among active and reserve component of the Beck Depression Inventory for Primary Care to screen for major
soldiers returning from the Iraq war. Journal of the American Medical depression disorders. General Hospital Psychiatry, 21, 106 –111. doi:
Association, 298, 2141–2148. doi:10.1001/jama.298.18.2141 10.1016/S0163-8343(98)00070-X
Mojtabai, R., Olfson, M., & Mechanic, D. (2002). Perceived need and help- Steiger, J. H. (1990). Structural model evaluation and modification: An
seeking in adults with mood, anxiety, or substance use disorders. Archives internal estimation approach. Multivariate Behavioral Research, 25,
of General Psychiatry, 59, 77– 84. doi:10.1001/archpsyc.59.1.77 173–180. doi:10.1207/s15327906mbr2502_4
Muthén, L. K., & Muthén, B. O. (2004). Mplus: The comprehensive Tanielian, T., & Jaycox, L. H. (2008). Invisible wounds of war: Psycho-
modeling program for applied researchers. User’s guide (3rd ed.). Los logical and cognitive injuries, their consequences, and services to assist
Angeles, CA: Muthén & Muthén. recovery. Santa Monica, CA: RAND Corporation. doi:10.1037/
Nash, W. P., Silva, C., & Litz, B. T. (2009). The historic origins of military e527612010-001
and veteran mental health stigma and the stress injury model as a means Vogt, D. (2011). Mental health-related beliefs as a barrier to service use for
to reduce it. Psychiatric Annals, 39, 789 –794. doi:10.3928/00485713- military personnel and veterans: A review. Psychiatric Services, 62,
20090728-05 135–142. doi:10.1176/appi.ps.62.2.135
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). Waldron, I. (1997). Changes in gender roles and gender differences in health
New York, NY: McGraw-Hill. behavior. In D. Gochman (Ed.), Handbook of health behavior research
Ojeda, V. D., & Bergstresser, S. M. (2008). Gender, race-ethnicity, and (Vol. 1, pp. 303–328). New York, NY: Plenum Press.
psychosocial barriers to mental health care: An examination of perceptions Weathers, F., Litz, B., Herman, D., Huska, J., & Keane, T. M. (1993, October).
and attitudes among adults reporting unmet need. Journal of Health and The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility.
Social Behavior, 49, 317–334. doi:10.1177/002214650804900306 Paper presented at the Annual Convention of the International Society for
Perlick, D. A., & Manning, M. R. (2006). Overcoming stigma and barriers Traumatic Stress Studies, San Antonio, TX.
ENDORSED AND ANTICIPATED STIGMA INVENTORY 113

Appendix
Items From the Endorsed and Anticipated Stigma Inventory (EASI)

Beliefs About Mental Illness 4. Most mental health problems can be dealt with without
seeking professional help.
1. People with mental health problems cannot be counted on.
5. Seeing a mental health provider would make me feel weak.
2. People with mental health problems often use their health
problems as an excuse. 6. I would think less of myself if I were to seek mental
health treatment.
3. Most people with mental health problems are just faking
their symptoms. 7. If I were to seek mental health treatment, I would feel
stupid for not being able to fix the problem on my own.
4. I don’t feel comfortable around people with mental health
problems. 8. I wouldn’t want to share personal information with a
mental health provider.
5. It would be difficult to have a normal relationship with
someone with mental health problems.
Concerns About Stigma From Loved Ones
6. Most people with mental health problems are violent or If I had a mental health problem and friends and family knew
dangerous. about it, they would . . .

7. People with mental health problems require too much atten- 1. . . . think less of me.
tion.
2. . . . see me as weak.
8. People with mental health problems can’t take care of
themselves. 3. . . . feel uncomfortable around me.

Beliefs About Mental Health Treatment 4. . . . not want to be around me.

1. Medications for mental health problems are ineffective. 5. . . . think I was faking.

2. Mental health treatment just makes things worse. 6. . . . Be afraid that I might be violent or dangerous.

3. Mental health providers don’t really care about their patients. 7. . . . think that I could not be trusted.

4. Mental health treatment generally does not work. 8. . . . avoid talking to me.

5. Therapy/counseling does not really help for mental health Concerns About Stigma in the Workplace
problems.
If I had a mental health problem and people at work knew about it . . .
6. People who seek mental health treatment are often re-
quired to undergo treatments they don’t want. 1. My coworkers would think I am not capable of doing my job.

7. Medications for mental health problems have too many 2. People at work would not want to be around me.
negative side effects.
3. My career/job options would be limited.
8. Mental health providers often make inaccurate assump-
tions about patients based on their group membership 4. Coworkers would feel uncomfortable around me.
(e.g., race, sex, etc.).
5. A Supervisor might give me less desirable work.
Beliefs About Treatment Seeking
6. A Supervisor might treat me unfairly.
1. A problem would have to be really bad for me to be
7. People at work would think I was faking.
willing to seek mental health care.
8. Co-workers would avoid talking to me.
2. I would feel uncomfortable talking about my problems
with a mental health provider.
Received August 6, 2012
3. If I had a mental health problem, I would prefer to deal Revision received January 28, 2013
with it myself rather than to seek treatment. Accepted January 28, 2013 䡲

You might also like