You are on page 1of 13

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/232593659

Development and evaluation of the Gender Role Conflict Scale


Short Form (GRCS-SF)

Article  in  Psychology of Men & Masculinity · April 2012


DOI: 10.1037/a0025550

CITATIONS READS

49 6,058

4 authors, including:

Stephen R. Wester David L Vogel


University of Wisconsin - Milwaukee Iowa State University
45 PUBLICATIONS   2,292 CITATIONS    129 PUBLICATIONS   7,593 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Interventions to Promote Adaptive Help-Seeking View project

Psychological Help-Seeking View project

All content following this page was uploaded by David L Vogel on 22 May 2014.

The user has requested enhancement of the downloaded file.


Psychology of Men & Masculinity © 2011 American Psychological Association
2012, Vol. 13, No. 2, 199 –210 1524-9220/11/$12.00 DOI: 10.1037/a0025550

Development and Evaluation of the Gender Role Conflict Scale


Short Form (GRCS-SF)

Stephen R. Wester David L. Vogel


University of Wisconsin-Milwaukee Iowa State University

James M. O’Neil Lindsay Danforth


University of Connecticut University of Wisconsin–Milwaukee

Within the literature on the psychology of men, the gender role conflict (GRC)
paradigm has been one of the most productive research programs explaining the impact
of restrictive gender roles in men’s lives. Despite recent efforts aimed at understanding
GRC from a multicultural perspective, few studies have examined the factor structure
of the primary measure of GRC, the Gender Role Conflict scale (GRCS), using diverse
samples of men. That was one goal of this research; the second is the development of
a short form of the GRCS, the GRCS-SF, designed to address concerns about item
content of the GRCS. Confirmatory factor analyses supported the four-factor model of
the GRC construct, both as experienced by men of color as well as replicated within the
GRCS-SF. Items used in the GRCS-SF reflect greater conflict, increased situational
focus, and potential clinical use. The meaning of these findings, as well as their
implications for therapy with men, is discussed.

Keywords: Gender Role Conflict, short form, validation, factor analyses

In 1996, Professional Psychology: Re- ature is the construct of gender role conflict
search and Practice published a paper entitled (GRC; e.g., O’Neil, 2008). GRC is a condi-
“The New Psychology of Men” in which Ron- tion in which rigid or overly restrictive male
ald Levant outlined an emerging area of the- gender roles conflict with incompatible situ-
ory, research, and practice devoted to under- ational demands and lead to negative conse-
standing how the socially defined construct of quences for men and those around them (see
masculinity impacts men, women, and society O’Neil, Good, & Holmes, 1995, for review).
at large (Levant, 1996). One of the burgeon- Four overall patterns of male GRC have been
ing areas of research within this extant liter- identified (O’Neil et al., 1995), each repre-
senting a unique aspect of the socialized tra-
ditional male role deemed to lead to conflict
for men. The first pattern—success, power,
This article was published Online First September 26, 2011.
Stephen R. Wester and Lindsay Danforth, Department of and competition (SPC)— examines the degree
Educational Psychology, University of Wisconsin- to which men are socialized to focus on per-
Milwaukee; David L. Vogel, Department of Psychology, sonal achievement through competitive ef-
Iowa State University; James M. O’Neil, Department of forts. The second pattern, restricted emotion-
Educational Psychology, University of Connecticut.
The Gender Role Conflict Research Program is now ality (RE), discusses the degree to which men
summarized online in 24 informational files for researchers’ are taught to avoid verbally expressing their
use. The Web site address is: http//web.uconn.edu/joneil/. feelings so as to avoid appearing weak and
Individuals seeking to use this scale in their work should
contact Dr. James M. O’Neil, Department of Educational
vulnerable. The third pattern, restricted affec-
Psychology, University of Connecticut. E-mail: james tionate behavior between men (RABBM), ex-
.o’neil@uconn.edu plores how men are socialized to have diffi-
Correspondence concerning this article should be ad- culties expressing their care and concern for
dressed to Dr. Stephen R. Wester, Department of Educa-
tional Psychology, 753 Enderis Hall, University of Wiscon-
other men. Finally, the fourth pattern, conflict
sin–Milwaukee, 2400 East Hartford Avenue, Milwaukee, between work and family relationships
WI 53201. E-mail: srwester@uwm.edu (CBWFR), discusses the degree to which men
199
200 WESTER, VOGEL, O’NEIL, AND DANFORTH

struggle with balancing the demands associ- factors. In a more recent review, O’Neil (2008)
ated with work, school, and family relations. confirmed these findings by summarizing the
An illustrative example of how GRC mani- results of studies using more diverse samples of
fests in the lives of men is the expression of men; coefficient alphas for all four subscales
tender emotions. Boys are taught to avoid this continued to range from the low 70s to the low
behavior for fear of having their masculinity 90s, therefore “not vary[ing] very much from
questioned, and many learn to present a more the first tests of reliability back in the early
instrumental, stoic demeanor to others as a re- 1980s” (O’Neil, 2008, p. 371).
sult. Society at large rewards adherence to this These reviews are clear: All four GRCS sub-
aspect of the male gender role—instrumentality scales have been positively correlated with neg-
and stoicism can often contribute to career ad- ative intrapersonal consequences for men, most
vancement and success in athletic endeavors. notably depression, anxiety, stress, measures of
However, as young men enter into interper- self-esteem, substance use and abuse, as well as
sonal, as well as potentially romantic, relation- alexthymia and shame. Higher levels of both
ships, they are expected to be more open and RE and RABBM have also been associated with
expressive with their partners. Difficulties may decreased relationship intimacy, marital prob-
occur, therefore, as they experience conflict be- lems, and lower levels of social connectedness
tween the demands of their socialization and the (e.g., O’Neil, in press; Wester & Vogel, in
demands of the situation. Some men experience press). Similarly, SPC has been linked with
conflict and confusion as a result— hallmarks of negative outcomes but it also positively predicts
GRC. They are perplexed about how to bal- higher levels of self esteem in certain popula-
ance what they understand as masculinity tions (e.g., collegians; Wester, Christianson,
with the differing demands of external situa- Vogel, & Wei, 2007), while CBWFR prediction
tions (e.g., Violanti, 2007; Wester, Arndt, Se- of negative outcomes varies across different age
divy, & Arndt, 2010). In other words, mascu- groups (e.g., Norwalk, Vandiver, White, &
line behaviors and ideals that allow them to Englar-Carlson, 2011), potentially because
succeed in certain areas, such as their job, younger men have not yet developed significant
may conflict with expectations in other areas stress in the areas of family and career. GRC
(i.e., interpersonal relationships). Thus, GRC has also been operationalized through diagnos-
theory stresses the importance of understand- tic schemas and case studies (O’Neil, 1990,
ing how behaviors associated with a tradition- 2006, 2008), and has been the basis for the
ally socialized male gender role interfere with development of therapeutic models designed for
positive outcomes in situations that require clinicians working with male clients (e.g.,
more nontraditional actions. O’Neil, 2006), including fathers (O’Neil & Lu-
More than 230 separate studies have been jan, 2009), police officers (Wester & Lyubel-
conducted exploring the nature of GRC as it is sky, 2005), college men (O’Neil & Crapser,
experienced by men, as well as the variables 2011) male members of the military (Brooks,
associated with that experience (e.g., see 1998), and transgendered persons (Wester, Mc-
O’Neil, 2008; O’Neil, in press, as well as Donough, White, Vogel, & Taylor, 2010).
Wester & Vogel, in press, for reviews). The At the same time, however, while the con-
predominant scale used in the research is the struct of GRC has been very influential in both
Gender Role Conflict Scale (GRCS; O’Neil, research and clinical domains, the experience of
Helms, Gable, David, & Wrightsman, 1986). It GRC may vary for men as a function of addi-
consists of 37 items spread across four sub- tional identity variables such as race (e.g.,
scales representing the domains described. Carter, Williams, Juby, & Buckley, 2005;
Early work demonstrated that the each of these Wester, Kuo, & Vogel, 2006) and sexual orien-
subscales had acceptable reliabilities across tation (e.g., Wester, Pionke, & Vogel, 2005).
several studies, with coefficient alphas ranging While early results suggest that GRC is an ex-
from the low 70s to the low 90s (RE: .81–.91; cellent construct for understanding how men of
RABBM: .82–.88; SPC: .83–.89; CBWFR: .73– color experience tensions between the male
.87; see O’Neil et al., 1995). Test-retest reli- gender role stemming from their cultural of
abilities over a 1-month interval ranged from origin and the dominant culture (e.g., Wester,
the low .70s to the mid .80s across the four 2008; Wester & Vogel, in press), it stands to
GENDER ROLE CONFLICT SCALE SHORT FORM 201

reason that the cross-cultural applicability of the GRC construct, given the demonstrated appli-
GRCS needs to be examined. Indeed, Norwalk cability across cultures (e.g., Wester, 2008). It
et al. (2011) determined that, while the factor also allowed us to test several of the specific
structure containing the four subscales was items identified by Norwalk et al. (2011) as
largely confirmed, several items on the GRCS problematic. Finally, we examined the correla-
seemed to be eliciting different responses from tions between the original GRCS and the
participants as a function of race. Accordingly, GRCS-SF in order to ensure we captured the
Norwalk and colleagues (2011) recommended content of the construct.
psychometric exploration of GRCS to ensure
that each item articulates GRC as it applies
across cultures–something that has not been Method
done since the inception of this construct in
1981. There were two steps to the development of
Questions have also been raised in the extant the GRCS-SF. We first conducted an explor-
literature regarding the degree to which the atory factor analysis (EFA) in order to examine
items used for the GRCS really measure conflict the factor structure and item fit of the GRCS
between the socialized male gender role and with a large, distinctly multicultural sample.
situational demands rather than merely sub- Our goal in Step 1 was to retain the highest
scription to the male gender role ideology con- loading items from each of O’Neil et al.’s
flict (e.g., Betz & Fitzgerald, 1993; Thompson (1986) subscales that preserved the original
& Pleck, 1995). O’Neil (2008) argued that GRC construct design. We next conducted confirma-
did not address ideology per se, and that the tory factor analysis (CFA) so as to examine the
GRCS items were designed to assess GRC pri- construct validity of this revised scale. Across
marily within the man and in an interpersonal both of those steps, item content of the highest
context with an equal mix of items relating to loading items will be reviewed so as to poten-
men’s thoughts, feelings, and behaviors that tially address published criticisms.
result in negative psychological outcomes. A
psychometric examination, and potential revi- Participants and Procedures
sion, of the GRCS using a diverse sample might
allow for increased clarity with regard to the Data for this study was collected as part of
measurement of conflict across the four sub- previously published, yet unrelated, investiga-
scales. tions: Wester, Christianson, Vogel, and Wei,
(2007); Wester, Kuo, and Vogel, (2006);
Current Study Wester, Vogel, Wei, and McLain (2006), as
well as Wester et al. (2005). These data sets
Given these concerns regarding the GRCS were chosen in order to provide a larger multi-
items, the purpose of this research was to de- cultural sample; in order to ensure the highest
velop a revised version of the Gender Role degree of anonymity, the only information that
Conflict Scale, the Gender Role Conflict Scale was removed from these databases were GRCS
Short Form (GRCS-SF). Such a scale could (a) scores and demographic information. This re-
reduce the factorial variance across diverse sulted in a sample of 1415 participants.
groups, and (b) potential examine the distribu- Because these were separate, unrelated stud-
tion of items measuring conflict across the four ies conducted over a period of 2 years, there
subscales. We did not undertake this process to was no consistency in the conduction of the
reinvent the construct of GRC; rather, we research or the administration of the GRCS.
wanted to develop a shorter, more cultural ap- Participants of the Wester et al. (2006) research
plicable measure of GRC that potentially unites completed the questionnaires on paper in face-
men of different backgrounds rather than differ- to-face settings, whereas Wester et al.’s (2005)
entiates between them based on aspects of iden- surveys were collected online. Wester et al.
tity such as race, ethnicity, and sexual orienta- (2007) collected their data through a college
tion. We chose to create a short form rather than undergraduate mass-testing procedure, while
revising all 37 items, because doing so would Wester et al. (2006) collected data through their
allow us to retain the theoretical basis of the respective middle schools. In each case, the
202 WESTER, VOGEL, O’NEIL, AND DANFORTH

GRCS was part of a large battery of question- The RE subscale had an alpha of .82, and a
naires rather than being specifically positioned. 4-week test–retest reliability of .76. The
Item selection sample: Exploratory factor RABBM subscale had an alpha of .83, and a
analysis. To select which of the 37 original 4-week test–retest reliability of .86. Finally,
GRCS items should be included on the short the CBWFR subscale had an alpha of .75, and
form, we employed a randomly selected sample a 4-week test–retest reliability of .72. Addi-
of 399 participants from our total sample of tionally, O’Neil and Owen (1994) reported
1415. Of this subsample, 3 (⬍1%) did not re- that, across 11 studies, the SPC subscale had
port their racial background. However, 227 an average alpha of .86, the RE subscale had
(57%) self-described as Caucasian, 75 (19%) an average alpha of .84, the RABBM subscale
self-described themselves as African Ameri- had an average alpha of .84, and the CBWFR
can, 84 (21%) self-described as Asian Ameri- subscale had an average alpha of .80. Further,
can, 2 (⬍1%) as Hispanic American, and fi- the average alpha across studies for the GRCS
nally 8 (2%) endorsed the “other” category. total score was .88 (O’Neil et al., 1995;
Furthermore, 199 (50%) self-described as gay O’Neil & Owen, 1994). Convergent and di-
or bisexual, while 188 (47%) self-described as vergent validity has been demonstrated, as
heterosexual. Twelve (3%) declined to describe documented by O’Neil (2008).
their sexual orientation. In summary, this sam-
ple was 57% Caucasian, 41% racial/ethnic mi- Results
nority, 47% heterosexual, and 50% nonhetero-
sexual. Exploratory Factor Analysis
Item confirmation sample: Confirmatory
factor analysis. We employed the responses Following the procedures of Wei, Russell,
of our remaining 1031 to conduct a confirma- Mallinckrodt, and Vogel (2007), we conducted
tory factor analysis (CFA) of those items result- an exploratory factor analysis with Sample 1 to
ing from our EFA. For this subsample, 35 (3%) examine the factor structure of the GRCS. Be-
did not report their racial background. At the cause extensive research supports O’Neil et
same time, 704 (68%) self-described as Cauca- al.’s (1986) four-factor model (e.g., O’Neil,
sian, 167 (16%) self-described as African 2008), we constrained the model to four factors.
American, 92 (9%) self-described as Asian Since those four factors tend to be moderately
American, 15 (1%) as Hispanic American, and, correlated, we employed direct oblimin rota-
finally, 28 (3%) endorsed the “other” category. tion and excluded those items that did not
Furthermore, 617 (60%) of our participants self- reach the factor-loading cutoff of .4. The four
described as gay or bisexual, while 402 (39%) factors that emerged corresponded to RE
self-described as heterosexual. In summary, (eigenvalue 8.1, 21.7%), SPC (eigenvalue 4,
68% of the participants were Caucasian, 26% 10.8%), RABBM (eigenvalue 2.5, 6.6%), and
racial/ethnic minority, 39% heterosexual, and CBWFR (eigenvalue 2.1, 5.6%). The total
60% nonheterosexual. variance explained was 44.7%, and the rota-
tion converged after seven iterations. Each of
Measure these factors showed a number of strong load-
ings (see Table 1).
Gender role conflict. We measured the In reviewing the results of this EFA, our
gender role conflict of our participants using the goal in selecting items for the development of
GRCS (O’Neil, et al., 1986; O’Neil, 2008), the short form was to retain items from each
which is a measure of men’s reactions to the subscale while strengthening the factor struc-
inconsistent and unrealistic gender role expec- ture and reducing the potential for cross-
tations they face. It consists of 37 items divided loading. Our expressed purpose, therefore,
into four subscales. Respondents rate their was to select the strongest loading items from
agreement with each item on a 6-point Likert each subscale while also maintaining the the-
scale (1 ⫽ “strongly disagree” to 6 ⫽ “strongly oretical content and independence of that sub-
agree”). Original development of the GRCS in- scale. This process allowed us to shorten the
dicated that the SPC subscale had an alpha of scale by removing items with lower loadings
.85, and a 4-week test–retest reliability of .84. (⬍.60) that may be directly linked to differ-
GENDER ROLE CONFLICT SCALE SHORT FORM 203

Table 1
Gender Role Conflict Scale Factors and Loadings From Exploratory Factor Analysis
Eigenvalue Loading
Factor 1: Restricted Emotionality 5.6
(2) I have difficulty telling others I care about them. .65
(6) Strong emotions are difficult for me to understand. .58
(9) Expressing feelings makes me feel open to attack by other people. .58
(13) Talking (about my feelings) during sexual relations is difficult for me. .70
(15) I have difficulty expressing my emotional needs to my partner. .75
(19) I have difficulty expressing my tender feelings. .75
(22) Telling others of my strong feelings is not part of my sexual behavior. .66
(25) I often have trouble finding words that describe how I am feeling. .52
(29) I do not like to show my emotions to other people. .68
(30) Telling my partner my feelings about him/her during sex is difficult for me. .68
Factor 2: Success, Power, and Competition 4.0
(1) Moving up the career ladder is important to me. .48
(5) Making money is part of my idea being a successful man. .63
(8) I sometimes define my personal value by my career success. .55
(12) I evaluate other people’s value by their level of achievement and success. .55
(14) I worry about failing and how it affects my doing well as a man. .46
(18) Doing well all the time is important to me. .41
(21) I often feel that I need to be in charge of those around me. .53
(23) Competing with others is the best way to succeed. .63
(24) Winning is a measure of my value and personal worth. .70
(28) I strive to be more successful than others. .70
(32) I am often concerned about how others evaluate my performance at work or school. .51
(34) Being smarter or physically stronger than other men is important to me. .70
(37) I like to feel superior to other people. .71
Factor 3: Restrictive Affectionate Behavior Between Men 2.5
(3) Verbally expressing my love to another man is difficult for me. .48
(7) Affection with other men makes me tense. .71
(10) Expressing my emotions to other men is risky. .58
(16) Men who touch other men make me uncomfortable. .75
(20) Hugging other men is difficult for me. .75
(26) I am sometimes hesitant to show my affections for other men because of how
others might perceive me. .51
(33) Being very personal with other men makes me feel uncomfortable. .76
(35) Men who are overly friendly to me make me wonder about their sexual preferences
(men or women). .62
Factor 4: Conflicts Between Work and Family Relations 2.1
(4) I feel torn between my hectic work schedule and caring for my health. .60
(11) My career, job, or school affects the quality of my leisure or family life. .41
(17) Finding time to relax is difficult for me. .63
(27) My needs to work or study keep me from my family or leisure more than I would
like. .79
(31) My work or school often disrupts other parts of my life (home, health, leisure, etc). .78
(36) Overwork and stress, caused by a need to achieve on the job or in school, affects/
hurts my life. .66

entiations between our participants based on scale a coefficient alpha of .80. These reli-
identity variables. Four items from each of ability estimates met Ponterotto and Ruckde-
the four subscales were retained, resulting schel’s (2007, p. 1003) cutoff for “moderate”
in 16 items total (see Table 2). With regard to (RE, CBWFR, RABBM) or “good” (SPC)
reliability, the revised RE and CBWFR sub- internal consistency for short (⬍6 item)
scales returned coefficient alphas of .77, scales and large sample sizes.
while the revised RABBM returned a coeffi- It should be noted here that there have been
cient alpha of .78 and the revised SPC sub- questions raised in the extant literature regard-
204 WESTER, VOGEL, O’NEIL, AND DANFORTH

Table 2
Gender Role Conflict Short Form Items and Loadings From Exploratory Factor Analysis
Loading
Factor 1: Restricted Emotionality
(13) Talking (about my feelings) during sexual relations is difficult for me. .70
(15) I have difficulty expressing my emotional needs to my partner. .75
(19) I have difficulty expressing my tender feelings. .75
(29) I do not like to show my emotions to other people. .68
Factor 2: Success, Power, and Competition
(24) Winning is a measure of my value and personal worth. .70
(28) I strive to be more successful than others. .70
(34) Being smarter or physically stronger than other men is important to me. .70
(37) I like to feel superior to other people. .71
Factor 3: Restrictive Affectionate Behavior Between Men
(7) Affection with other men makes me tense. .71
(16) Men who touch other men make me uncomfortable. .75
(20) Hugging other men is difficult for me. .75
(33) Being very personal with other men makes me feel uncomfortable. .76
Factor 4: Conflicts Between Work and Family Relations
(17) Finding time to relax is difficult for me. .63
(27) My needs to work or study keep me from my family or leisure more than I would like. .79
(31) My work or school often disrupts other parts of my life (home, health, leisure, etc). .78
(36) Overwork and stress, caused by a need to achieve on the job or in school, affects/hurts my life. .66

ing the degree to which the items used for the disclosures. The items loading on the SPC sub-
GRCS really measure conflict (e.g., Betz & scale measure more indirect conflicts in the
Fitzgerald, 1993; Thompson & Pleck, 1995) form of competition between individual men
between the socialized male gender role and and other individuals as part of striving for
situational demands rather than merely assess- success. The items on CBWFR clearly represent
ing subscription to the male gender role ideol- conflicts between situations such as work or
ogy. O’Neil (2008) argued that the GRCS items school and familial demands.
assess GRC primarily within the man and in an Finally, we examined the resulting items in
interpersonal context with an equal mix of items order to confirm whether or not the items iden-
relating to men’s thoughts, feelings, and behav- tified by Norwalk et al. (2011) as contributing to
iors that result in negative psychological out- factorial variance between the Caucasian and
comes. The 16 items retained at this step in the African American participants had been in-
process all seemed to adequately address the cluded or excluded by our analyses. Norwalk et
operational definitions of GRC. As an example, al. (2011) noted that, for their two samples,
one item on the RE subscale, I have difficulty items 1, 4, 5, 8, 9, 11, 12, 13, 14, 18, 21, 22, 25,
expressing my emotional needs to my partner, 26, 28, 32, 35, and 37 (see Table 1) had large
addresses the conflict experienced between the standardized residuals while also failing to meet
male gender role regarding both stoicism as their effect size criterion. Our item reduction
well as emotional control and the situational eliminated all but three of these items: 13, 28,
demands of an interpersonal relationship–a and 37 were retained in the final GRCS-SF. The
theme echoed across the three other items. In- remaining 13 items we retained (see Table 2)
deed, the RABBM subscale now contains only provided lower loading across studies and so
items that directly measure the socialized con- their removal should increase the applicability
flicts regarding the restriction against physical of the new GRCS-SF across populations.
expression of affection between men. The one
potential exception, Being very personal with Confirmatory Factor Analysis
other men makes me feel uncomfortable, can be
interpreted as the sharing of closeness between A confirmatory factor analysis was conducted
individual men in intimate communications or on the resultant 16-item GRCS-SF using the max-
GENDER ROLE CONFLICT SCALE SHORT FORM 205

imum likelihood method in LISREL 8.54. Recall the GRCS, we also chose to examine the corre-
that we employed the responses of our remaining lations between the four subscales from the
1031 to conduct this CFA. Since researchers have 37-item GRCS and the four new subscales de-
suggested that sample sizes of 200 or greater are veloped for the GRCS-SF. A new sample of
adequate for CFA (e.g., Kline, 2005; Quintana & participants was collected: 495 collegians from
Maxwell, 1999), the present sample size was a small Midwestern urban institution completed
deemed adequate for the analyses. In summary, the GRCS at the beginning of the semester and
68% of the participants were Caucasian, 26% ra- the GRCS-SF at the end of the semester. The
cial/ethnic minority, 39% heterosexual, and 60% research was described as part of a larger “scale
nonheterosexual. development” study, and the GRC items were
Since the data did not fit requirements for scattered among an addition 200 distracter
normality, ␹2(2, N ⫽ 1,031) ⫽ 1448.85, p ⬍ items. This new sample of collegian participants
.001, the scaled chi-square statistic was used to was 48% freshman, 25% sophomore, 14% ju-
adjust for the impact of nonnormality (Satorra nior, and 11% senior. Participants were 89%
& Bentler, 2010). In addition, we followed rec- Caucasian, and 11% racial/ethnic minority;
ommendations to report the comparative fit in- 77% were single, and 21% were in a committed
dex (CFI), the Tucker Lewis Index (TLI), the relationship.
Root Mean Square Error of Approximation Correlations between the two versions are
(RMSEA) with 90% confidence intervals, and provided in Table 4. As can be seen from this
the Standardized Root Mean Square Residual data, all four GRCS-SF subscales significantly
(SRMR). Criteria for acceptable fit have ranged correlated with their original GRCS subscales.
from CFIs and TLIs greater than or equal to .90 Additionally, just as with the GRCS, the indi-
and RMSEA and SRMR less than or equal to vidual GRCS-SF subscales significantly corre-
.10 (e.g., Hu & Bentler, 1999), to more conser- lated with each other, albeit sharing only a small
vative criteria of CFIs and TLIs greater or equal amount of variance. This suggests that the
to .95, RMSEA less than or equal to .06, and GRCS-SF captures the construct that was ini-
SRMR less than or equal to .08 (e.g., Hu & tially measured by the GRCS and that the indi-
Bentler, 1999; Quintana & Maxwell, 1999). Re- vidual subscales measure independent, yet re-
searchers (e.g., Schermelleh-Engel, Moosbrug- lated, constructs. Said another way, as expected
ger, & Müller, 2003; Weston & Gore, 2006) the four original subscales correlated with their
have also argued that model evaluation must shorter versions (i.e., RE with RE, SPC with
take into account sample size, number of de- SPC, etc.). Again as expected, the four shorter
grees of freedom, and theoretical bases for the subscales also correlated with each (i.e., RE
models rather than solely relying on conserva- with RABBM, SPC, CBWFR etc.) but in a
tive interpretation of fit indices. manner suggesting a much lower overlap in
The four-factor model using the GRCS-SF pro- variability than demonstrated with the original
vided a good fit for the data: scaled ␹2(98, GRCS.
N ⫽ 1,031) ⫽ 430.83, p ⬍ .001; CFI ⫽ .96;
TLI ⫽ .96; RMSEA ⫽ .057 (90% confidence Proxy Variables
interval [CI] ⫽ .057 to .063); SRMR ⫽ .05. As
shown in Table 3, the measured items loadings on Questions could be raised with regard to both
the latent variables were all statistically signifi- within-group and between-groups differences in
cant, p ⬍ .001. This four-factor model using the short form scores. Did our heterosexual partic-
short form fit the data better than a one-factor ipants respond differently to the items than our
model, scaled ␹2(104, N ⫽ 1,031) ⫽ 2147.77, p ⬍ nonheterosexual participants? Did our Cauca-
.001; CFI ⫽ .78; TLI ⫽ .78; RMSEA ⫽ .14 (90% sian participants respond differently than our
confidence interval [CI] ⫽ .13 to .14); SRMR ⫽ racial/ethnic minority participants? We recog-
.11. nize that such comparisons are often common-
place, ostensibly aimed at understanding the
Initial Validity differing impact of the socialized male gender
role across a range of diversity variables. This
In order to further demonstrate that the new type of comparative approach seems similar to
GRCS-SF captures the construct measured by what Quintana, Troyano, and Taylor (2001) la-
206 WESTER, VOGEL, O’NEIL, AND DANFORTH

Table 3
Gender Role Conflict Short Form Items and Loadings From Confirmatory Factor Analysis
Unstandardized Standardized
Measured variables factor loading SE factor loading
Factor 1: Restricted Emotionality
(13) Talking (about my feelings) during sexual relations is
difficult for me. 1.0 .00 .78
(15) I have difficulty expressing my emotional needs to my
partner. .99 .05 .77
(19) I have difficulty expressing my tender feelings. .97 .04 .76
(29) I do not like to show my emotions to other people. .70 .06 .55
Factor 2: Success, Power, and Competition
(24) Winning is a measure of my value and personal worth. 1.1 .01 .65
(28) I strive to be more successful than others. .99 .10 .65
(34) Being smarter or physically stronger than other men is
important to me. .97 .10 .63
(37) I like to feel superior to other people. .88 .10 .58
Factor 3: Restrictive Affectionate Behavior Between Men
(7) Affection with other men makes me tense. 1.0 .00 .68
(16) Men who touch other men make me uncomfortable. 1.1 .08 .73
(20) Hugging other men is difficult for me. 1.2 .08 .77
(33) Being very personal with other men makes me feel
uncomfortable. 1.14 .08 .77
Factor 4: Conflicts Between Work and Family Relations
(17) Finding time to relax is difficult for me. 1.0 .00 .69
(27) My needs to work or study keep me from my family or
leisure more than I would like. 1.1 .07 .74
(31) My work or school often disrupts other parts of my life
(home, health, leisure, etc). 1.2 .07 .85
(36) Overwork and stress, caused by a need to achieve on the job
or in school, affects/hurts my life. .96 .07 .66

beled the use of proxy variables rather than albeit unintended, consequence (e.g., Messick,
actual psychological constructs to explain find- 1995) of reliance on proxy variables is the use
ings. In effect, sexual orientation or race, rather of a deficit model to understand the results,
than variables associated with either race or “polarizing so-called opposites” (McGoldrick
sexual orientation, but more directly related to & Giordano, 1996, p. 23), and the labeling of
GRC, could become the explanation for any one group as worse or less than the other group
demonstrated differences. Indeed, a potential, (e.g., Fiske, 1998). Given that it was our goal to
develop a measure of GRC that did not accen-
tuate differences based on diversity variables,
Table 4 we therefore explicitly avoided such compari-
Correlations Between the Subscales of the GRCS sons between groups on aspects of identity.
and the GRCS-SF
Discussion
Variable RE RAB CBWF SPC

RE (short) .94 .53ⴱⴱ .30ⴱⴱ .24ⴱⴱ Within the growing extant literature on the
RAB (short) .48ⴱⴱ .93ⴱⴱ .30ⴱⴱ .39ⴱⴱ psychology of men, GRC has emerged as a
CBWF (short) .29ⴱⴱ .96ⴱ .96ⴱ .38ⴱⴱ construct critical to understanding the degree
SPC (short) .23ⴱⴱ .41ⴱⴱ .39ⴱⴱ .90ⴱ
to which traditional male gender role social-
Note. GRCS ⫽ Gender Role Conflict Scale; GRCS-SF ⫽ ization teaches men values, ideals, and behav-
Gender Role Conflict Scale-Short Form; RE ⫽ restricted iors that might conflict with the demands of
emotionality; RAB ⫽ restricted affectionate behavior be-
tween men; CBWF ⫽ conflict between work and family certain situations. As such, the measurement
relations; SPC ⫽ success, power, and competition. of that GRC construct provides researchers,

p ⱕ .01. ⴱⴱ p ⱕ .05. theorists, scholars, and clinicians with an im-
GENDER ROLE CONFLICT SCALE SHORT FORM 207

portant predictive tool, one that has recently not retained, and items measuring this now
been applied to understanding the gender role reside exclusively on the RE subscale,
experience of men of diverse backgrounds. thereby measuring conflict regarding the ex-
However, this poses some challenges, given pression of emotions within the context of an
that some (e.g., Norwalk et al., 2011) have interpersonal relationship. These improve-
suggested that several items on the original ments make the assessment more valid in
GRCS seem to differentiate between groups terms of actual conflict that men experience
of men based on identity variables such as because of socialized gender roles. All told,
race. Our goal was to develop a measure of each of the four scales now directly measure
GRC that eliminates those items while also conflicts between the expectations of the so-
maintaining their four-factor structure of cialized male gender role and either interper-
GRC proposed by O’Neil et al. (1986). This sonal actions or situational demands.
new version, the GRCS-SF, demonstrated
good model fit, strong correlations between Research Implications
its subscales and those of the original GRCS,
and similar levels of reliability with a large, The GRCS-SF also provides a more flexi-
diverse sample of male participants. Indeed, ble tool to those scholars interested in under-
of the 18 items identified as not meeting cut- standing the multitude of variables that are
off criteria by the most recent study examin- associated with GRC in men, which, in turn,
ing the factor structure of the GRCS based on allows for the development of more complex
diversity variables (Norwalk et al., 2011), our statistical models designed to understand the
results deleted 15 of them. This confirms that situational, contextual, and environmental im-
the four constructs measured within the GRC pact of GRC in men’s lives (e.g., Addis,
paradigm—success, power, and competition; Mansfield, & Syzdek, 2010). For example, as
restricted emotionality; restricted affectionate with other recent revisions to masculinity
behavior between men; and conflicts between measures (e.g., Parent & Moradi, 2009), the
work and family relations—apply to, and can GRCS-SF can shorten the length of question-
be measured within, diverse populations of naires used in both clinical and empirical
men without fears of specific items tapping settings. Decreasing this “response burden” (Par-
somewhat different constructs based on vari- ent & Moradi, 2009, p. 186) on participants, es-
ables such as race and sexual orientation. pecially for research conducted outside of a col-
The present research also responds to previ- legiate environment, can lower the risk for bore-
ous recommendations (e.g., Rogers, Abbey- dom, loss of motivation, and random responding.
Hines, & Rando, 1997) to revise and improve Given the importance of GRC in predicting out-
the psychometrics of the GRCS. In our version, comes for men, as well as the emerging impor-
weaker loading items have been removed, tance of increasingly complex statistical models
thereby improving the item pool, because many designed to capture GRC within a web of contex-
of those items that did not directly assess con- tual/situational variables (O’Neil, 2008), the
flict or contributed to factor invariance between GRCS-SF can be a useful tool.
samples were eliminated. Indeed, the total num-
ber of items assessing conflict increased from Therapeutic Implications
60% in GRCS to 75% in GRCS-SF. More im-
portantly those items were more evenly distrib- Cochran (2005), for example, called for
uted across all four subscales. With the GRCS, greater research on evidence-based treatment
only 75% of the RABBM items had conflict of men, particularly using masculine gender
terminology, but with the GRCS-SF item reduc- role conflict and stress constructs. Empirical
tion, 100% now measure conflict. The SPC fac- evidence is accumulating indicating that GRC
tor now seems more directly representative of diagnostic schemas could be used when coun-
competition between individuals as a measure seling men. O’Neil (2008) reported on eight
of success, while RABBM is now more specif- studies that have assessed client’s gender role
ically a measure of conflicts regarding the phys- conflict and psychological problems (Burke,
ical expression of affection. RABBM items re- 2000; Coonerty-Femiano, Katzman, Femiano,
garding verbal expression of affection were Gemar, & Toner, 2001; Cusack, Deane, Wil-
208 WESTER, VOGEL, O’NEIL, AND DANFORTH

son, & Ciarrochi, 2006; Good, Robertson, functioning. In the case of a man in an intimate
Fitzgerald, Stevens, & Bartels, 1996; Hayes relationship, expressing affectionate feelings for
& Mahalik, 2000; Mertens, 2000; Noyes, his partner or spouse is an important behavior,
2004; Van Delft, 1998). The overall evidence which contributes to relationship outcomes.
indicates that GRC has therapeutic relevance Since the verbal expression of such feelings
and both the present results and the GRCS-SF runs counter to the socialized male role regard-
promote more active use of the scale in coun- ing stoicism and the restriction of emotional
seling and psychotherapy. The GRCS-SF expression, this situation is ripe for the experi-
seems to have the potential to fill this need, ence of GRC. However, in the absence of such
and while more research is certainly needed, interpersonal demands, a stoic demeanor may
the shorter scales might be useful with clients. not be detrimental to men and might even be
useful (Vacha-Hasse, Wester, & Christianson,
Limitations 2010). Such an outlook might be useful in cer-
tain career and/or vocational settings (e.g.,
Despite the promising implications of this Wester et al., 2010), for example. We hope that
research, there remain some limitations. First, the GRCS-SF provides scholars with a tool that
our number of Hispanic American participants allows them to streamline their assessment pro-
was lower than ideal, our sample contained a cess so as to fully detangle the complexity of
higher percentage of gay (vs. heterosexual) par- contextual and situational variables likely to be
ticipants, and we used data collected through affecting men.
unrelated research questions. This suggests that
future research might consider obtaining References
more balanced samples with specific research
questions aimed at confirming our findings. Addis, M. E., Mansfield, A. K., & Syzdek, M. R.
Additionally, future research might consider (2010). Is “masculinity” a problem? Framing the
using the GRCS-SF in setting already ex- effects of gendered social learning in men. Psy-
plored within the psychology of men so as to chology of Men & Masculinity, 11, 77–90. doi:
compare those results with those previously 10.1037/a0018602
published. For example, the GRCS-SF seems Betz, N. E., & Fitzgerald, L. (1993). Individuality
and diversity: Theory and research in counseling
to be a more explicit measure of conflict, and
psychology. Annual Review of Psychology, 44,
that conflict is constrained to more specific 343–381. doi:10.1146/annurev.ps.44.020193
situations. The new version of the RABBM .002015 PMid:19954328
subscale, for example, is more focused on phys- Brooks, G. R. (1998). A new psychotherapy for tra-
ical behavior between individuals (i.e., hugging, ditional men. San Francisco, CA: Jossey-Bass.
touching) while the new RE subscale contains Burke, K. (2000). Gender role conflict and psycho-
items exclusively asking about the verbal expres- logical well-being: An exploration in men enrolled
sion of emotions. How this shift in scale focus to attend an initiatory weekend (Unpublished mas-
effects outcomes for men needs to be more fully ter’s thesis). University of Maryland, Baltimore.
explored. This would allow for the confirmation Carter, R. T., Williams, B., Juby, H. L., & Buckley,
T. R. (2005). Racial identity as a mediator of the
of the GRCS-SF as a measure of O’Neil and
relationship between gender role conflict and the
colleagues (1986) construct while also more fully severity of psychological symptoms in Black, La-
grounding it within the nomological network (e.g., tino, and Asian men. Sex Roles, 53, 473– 486.
Cronbach & Meehl, 1955). doi:10.1007/s11199-005-7135-7
Cochran, S. V. (2005). Assessing and treating depres-
Conclusions sion in men. In G. E. Good & G. R. Brooks (Eds.),
The new handbook of psychotherapy and counsel-
GRC theory stresses the importance of un- ing with men (pp. 121–133). San Francisco, CA:
Jossey-Bass.
derstanding how behaviors associated with a Coonerty-Femiano, A. M., Katzman, M. A.,
traditionally socialized male gender role inter- Femiano, S., Gemar, M., & Toner, B. (2001, Au-
fere with positive outcomes in situations that gust). Gender role conflict in male survivors of
require more nontraditional actions. In essence, childhood abuse. Paper presented at the meeting of
this requires an understanding of the contexts in the American Psychological Association, San
which any individual man might currently be Francisco, CA.
GENDER ROLE CONFLICT SCALE SHORT FORM 209

Cronbach, L. J., & Meehl, P. E. (1955). Construct Noyes, B. B. (2004). Gender role conflict as a pre-
validity in psychological tests. Psychological Bul- dictor of therapy outcome (Unpublished master’s
letin, 52, 281–302. doi:10.1037/h0040957 thesis). University of Utah, Salt Lake City, UT.
Cusack, J., Deane, F. P., Wilson, C. J., & Ciarrochi, O’Neil, J. M. (1990). Assessing men’s gender role
J. (2006). Emotional expression, perceptions of conflict. In D. Moore & F. Leafgren (Eds.), Men in
therapy, and help-seeking intentions in men at- conflict: Problem solving strategies and interven-
tending therapy services. Psychology of Men & tions (pp. 23–38). Alexandria, VA: American As-
Masculinity, 7, 69 – 82. doi:10.1037/1524- sociation for Counseling and Development
9220.7.2.69 (AACD) Press.
Fiske, S. T. (1998). Stereotyping, prejudice, and dis- O’Neil, J. M. (2006). Helping Jack heal his emotional
crimination. In D. T. Gilbert, S. T. Fiske, & G. wounds using the gender role conflict diagnostic
Lindzey (Eds.), The handbook of social psychol- schema. In M. Englar-Carlson & M. A. Stevens
ogy (4th ed., Vol. 2, pp. 357– 415). New York, (Eds.), In the therapy room with men: A casebook
about psychotherapeutic process and change with
NY: McGraw-Hill.
male clients (pp. 259 –284). Washington, DC:
Good, G. E., Robertson, J. M., Fitzgerald, L. F.,
American Psychological Association.
Stevens, M., & Bartels, K. M. (1996). The relation
O’Neil, J. M. (2008). Summarizing 25 years of re-
between masculine role conflict and psychological search on men’s gender role conflict using the
distress in male university counseling center cli- Gender Role Conflict Scale: New research para-
ents. Journal of Counseling and Development, 75, digms and clinical implications. The Counseling
44 – 49. Psychologist, 36, 358 – 445. doi:10.1177/
Hayes, J. A., & Mahalik, J. R. (2000). Gender role 0011000008317057
conflict and psychopathology in a clinical popula- O’Neil, J. M. (in press). The psychology of men. In
tion. Psychology of Men & Masculinity, 1, 116 – E. Altmaier & J. Hansen (Eds.), Oxford Handbook
125. doi:10.1037/1524-9220.1.2.116 of Counseling Psychology. New York, NY: Oxford
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for University Press.
fit indexes in covariance structure analysis: Con- O’Neil, J. M., & Crapser, B. (2011, April). Using the
ventional criteria versus new alternatives. Struc- psychology of men and gender role conflict theory
tural Equation Modeling, 6, 1–55. doi:10.1080/ to promote comprehensive service delivery for col-
10705519909540118 lege men: A call to action. In J. Laker & T. Davis
Kline, R. B. (2005). Principles and practice of struc- (Eds.), Masculinities in higher education: Theoret-
tural equation modeling (2nd ed.). New York, NY: ical and practical considerations (pp. 16 – 49).
Guilford Press. New York, NY: Routledge.
Levant, R. F. (1996). A new psychology of men. O’Neil, J. M., Good, G. E., & Holmes, S. (1995).
Professional Psychology: Research and Prac- Fifteen years of theory and research on men’s
tice, 27, 259 –265. doi:10.1037/0735-7028.27 gender role conflict. In R. F. Levant & W. S.
.3.259 Pollack (Eds.), The new psychology of men (pp.
McGoldrick, M., & Giordano, J. (1996). Overview: 164 –206). New York, NY: Basic Books.
Ethnicity and family therapy. In M. McGoldrick, J. O’Neil, J. M., Helms, B., Gable, R., David, L., &
Giordano, & J. K. Pearce (Eds.), Ethnicity and Wrightsman, L., (1986). Gender role conflict scale:
family therapy (2nd ed., pp. 1–30). New York, NY: College men’s fear of femininity. Sex Roles, 14,
335–350. doi:10.1007/BF00287583
Guilford Press
O’Neil, J. M., & Lujan, M. L. (2009). An assessment
Mertens, C. E. (2000). Male gender role conflict in
paradigm for fathers in therapy using gender role
depressed versus nondepressed medical popula-
conflict theory. In C. Z. Oren & D. C. Oren (Eds.),
tions (Doctoral dissertation). Retrieved from Dis- Counseling fathers (pp. 49 –71). New York: Taylor
sertation Abstract International, 61, 3068. & Francis Group.
Messick, S. (1995). Validity of psychological assess- O’Neil, J. M., & Owen, S. V. (1994). The manual for
ment: Validation of inferences from persons’ re- the gender role conflict scale. Storrs, CT: Univer-
sponses and performances as scientific inquiry into sity of Connecticut.
score meaning. American Psychologist, 50, 741– Parent, M. C., & Moradi, B. (2009). Confirmatory
749. doi:10.1037/0003-066X.50.9.741 factor analysis of the Conformity to Masculine
Norwalk, K. E., Vandiver, B. J., White, A. M., & Norms Inventory and development of the CMNI-
Englar-Carlson, M. (2011). Factor structure of the 46. Psychology of Men & Masculinity, 10, 175–
Gender Role Conflict Scale in African American 189. doi:10.1037/a0015481
and European American men. Psychology of Men Ponterotto, J. G., & Ruckdeschel, D. E. (2007). An
& Masculinity, 12, 128 –143. doi:10.1037/ overview of coefficient alpha and a reliability
a0022799 matrix for estimating adequacy of internal con-
210 WESTER, VOGEL, O’NEIL, AND DANFORTH

sistency coefficient with psychological research psychology. The Counseling Psychologist, 36,
measures. Perceptual and Motor Skills, 105, 294 –324. doi:10.1177/0011000006286341
997–1014. doi:10.2466/pms.105.3.997–1014. Wester, S. R., Arndt, D., Sedivy, S. K., & Arndt, L.
Quintana, S. M., & Maxwell, S. E. (1999). Implica- (2010). Male police officers and stigma associated
tions of recent developments in structural equa- with counseling: The role of anticipated risk, an-
tions modeling for counseling psychology. The ticipated benefit, and gender role conflict. Psychol-
Counseling Psychologist, 27, 485–527. doi: ogy of Men & Masculinity, 11, 286 –302. doi:
10.1177/0011000099274002 10.1037/a0019108
Quintana, S. M., Troyano, N., & Taylor, G. (2001). Wester, S. R., Christianson, H. F., Vogel, D. L., &
Cultural validity and inherent challenges in quan- Wei, M. (2007). Male gender role conflict and
titative methods for multicultural research. In J. G. psychological distress: The role of social support.
Ponterotto, J. M. Casas, L. A. Suzuki, & C. M. Psychology of Men & Masculinity, 8, 215–224.
Alexander (Eds.), Handbook of multicultural doi:10.1037/1524-9220.8.4.215
counseling (2nd ed., pp. 604 – 630). New York, Wester, S. R., Kuo, B., & Vogel, D. L. (2006).
NY: Sage. Multicultural coping: Chinese-Canadian adoles-
Rogers, J. R., Abbey-Hines, J., & Rando, R. A. cents, male gender role conflict, and psychological
(1997). Confirmatory factor analysis of the gender distress. Psychology of Men & Masculinity, 7, 87–
role conflict scale: A cross-validation of Good et 104. doi:10.1037/1524-9220.7.2.83
al., 1995. Measurement and Evaluation in Coun- Wester, S. R., & Lyubelsky, J. (2005). Supporting the
seling and Development, 30, 137–145. thin blue line: Gender sensitive therapy with male
Satorra, A., & Bentler, P. M. (2010). Ensuring pos- police officers. Professional Psychology: Research
itiveness of the scaled difference chi-square test and Practice, 36, 51–58. doi:10.1037/0735-
statistic. Psychometrics, 75, 243–248. doi: 7028.36.1.51
10.1007/s11336-009 –9135-y Wester, S. R., McDonough, T. A., White, M., Vogel,
Schermelleh-Engel, K., Moosbrugger, H., & Müller, D. L., & Taylor, L. (2010). The use of gender role
H. (2003). Evaluating the fit of structural equation conflict theory in counseling Male-to-Female
models: Tests of significance and descriptive transgendered individuals. Journal of Counseling
goodness-of-fit measures. Methods of Psychologi- and Development, 88, 214 –219.
cal Research Online, 8, 23–74. Wester, S. R., Pionke, D., & Vogel, D. L. (2005). Male
Thompson, E. H., & Pleck, J. H. (1995). Masculinity gender role conflict, gay men, and same-sex romantic
ideologies: A review of research instrumentation relationships. Psychology of Men & Masculinity, 6,
on men and masculinities. In R. Levant & W. 195–208. doi:10.1037/1524-9220.6.3.195
Pollack (Eds.), A new psychology of men (pp. Wester, S. R., & Vogel, D. L. (in press). The psy-
129 –163). New York, NY: Basic Books. chology of men: Historical developments, current
Vacha-Hasse, T., Wester, S. R., & Christianson, H. F. research, and future directions. In N. A. Fouad,
(2010). Psychotherapy with older men. New York, J. Carter, & L. Subich (Eds.), Handbook of Coun-
NY: Routledge. seling Psychology. Washington, DC: American
Van Delft, C. W. (1998). Gender role conflict and Psychological Association.
psychological distress in army men (Unpublished Wester, S. R., Vogel, D. L., Wei, M., & McLain, R.
master’s thesis). Department of Counseling and Per- (2006). African-American men, gender role con-
sonnel Services, University of Maryland, College flict, and psychological distress: The role of racial
Park. identity. Journal of Counseling and Develop-
Violanti, J. M. (2007). Police suicide: Epidemic in ment, 84, 419 – 429.
blue. New York, NY: Charles C. Thomas. Weston, R., & Gore, P. A. (2006). A brief guide to
Wei, M., Russell, D. W., Mallinckrodt, B., & Vogel, D. L. structural equation modeling. The Counseling
(2007). The Experiences in Close Relationship Scale Psychologist, 34, 719 –751. doi:10.1177/
(ECR)-short form: Reliability, validity, and factor struc- 0011000006286345
ture. Journal of Personality Assessment, 88, 187–204.
doi:10.1080/00223890701268041 Received March 3, 2011
Wester, S. R. (2008). Multicultural advances in the Revision received July 27, 2011
psychology of men: Implications for counseling Accepted July 28, 2011 䡲

View publication stats

You might also like