You are on page 1of 10

Professional Psychology: Research and Practice

© 2022 American Psychological Association 2022, Vol. 53, No. 4, 362–371


ISSN: 0735-7028 https://doi.org/10.1037/pro0000469

A Systematic Review of Cultural Competence Trainings for


Mental Health Providers
Wendy Chu, Guillermo Wippold, and Kimberly D. Becker
Department of Psychology, University of South Carolina

We conducted a systematic review to characterize features and evaluate outcomes of cultural competence
trainings delivered to mental health providers. We reviewed 37 training curricula described in 40 articles
published between 1984 and 2019 and extracted information about curricular content (e.g., cultural
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

identities), as well as training features (e.g., duration), methods (e.g., instructional strategies), and outcomes
This document is copyrighted by the American Psychological Association or one of its allied publishers.

(i.e., attitudes, knowledge, skills). Training participants included graduate students and practicing profes-
sionals from a range of disciplines. Few studies (7.1%) employed a randomized-controlled trial design,
instead favoring single-group (61.9%) or quasi-experimental (31.0%) designs. Many curricula focused on
race/ethnicity (64.9%), followed by sexual orientation (45.9%) and general multicultural identity (43.2%).
Few curricula included other cultural categorizations such as religion (16.2%), immigration status (13.5%),
or socioeconomic status (13.5%). Most curricula included topics of sociocultural information (89.2%) and
identity (78.4%), but fewer included topics such as discrimination and prejudice (54.1%). Lectures (89.2%)
and discussions (86.5%) were common instructional strategies, whereas opportunities for application of
material were less common (e.g., clinical experience: 16.2%; modeling: 13.5%). Cultural attitudes were the
most frequently assessed training outcome (89.2%), followed by knowledge (81.1%) and skills (67.6%).
To advance the science and practice of cultural competence trainings, we recommend that future studies
include control groups, pre- and post-training assessment, and multiple methods for measuring multiple
training outcomes. We also recommend consideration of cultural categories that are less frequently
represented, how curricula might develop culturally competent providers beyond any single cultural
category, and how best to leverage active learning strategies to maximize the impact of trainings.

Public Significance Statement


This review demonstrates that cultural competence trainings are an effective method of shifting attitudes,
increasing knowledge, and developing skills of mental health providers to support the mental health
needs of culturally underserved communities. These findings can be used by developers of cultural
competence trainings to develop, implement, and assess the outcomes of such trainings.

Keywords: cultural competence, training, mental health providers, diversity, systematic review

Supplemental materials: https://doi.org/10.1037/pro0000469.supp

This article was published Online First June 2, 2022. participatory research framework to develop, implement, and evaluate health-
Wendy Chu https://orcid.org/0000-0001-6596-5987 promoting interventions among at-risk communities.
Guillermo Wippold https://orcid.org/0000-0002-0095-298X KIMBERLY D. BECKER received her PhD in psychology from the University
Kimberly D. Becker https://orcid.org/0000-0003-2381-8588 of Arizona. She is a licensed psychologist and an Associate Professor in the
WENDY CHU received her BA in psychology from Macalester College. She Department of Psychology at the University of South Carolina. Her research
is currently a doctoral student in clinical-community psychology at the interests include improving the effectiveness of children’s mental health
University of South Carolina. Her research interests explore how mental services, with specific interests in clinical decision-making and treatment
health providers address culture in treatment with the aim of increasing the engagement. She also collaborates with community partners on workforce
access to and quality of mental health services for culturally underserved training and development.
youth and families. She also examines the dissemination and implementation The authors have no conflicts of interest to disclose. Guillermo Wippold is
of evidence-based strategies and practices on treatment engagement in low- funded by the National Institute on Minority Health and Health Disparities of
resourced school and community contexts. the National Institutes of Health (K23MD016123). The content is solely the
GUILLERMO WIPPOLD received his PhD in counseling psychology from responsibility of the authors and does not necessarily represent the views of
the University of Florida. He is a licensed psychologist and an Assistant the National Institutes of Health.
Professor in the Department of Psychology at the University of South CORRESPONDENCE CONCERNING THIS ARTICLE should be addressed to
Carolina. His research interests include the concept of health-related quality Wendy Chu, Department of Psychology, University of South Carolina,
of life—a multidimensional conceptualization of health that includes psycho- 1512 Pendleton Street, Columbia, SC 29208, United States. Email:
logical, physical, and social functioning. His work uses a community-based wchu@email.sc.edu

362
CULTURAL COMPETENCE TRAININGS REVIEW 363

Cultural competence is a core value of professional psychology humility) and concrete professional skills to enhance an individual’s
that is represented in the practice guidelines and mandates of its work with others. Importantly, cultural competence is fluid, mean-
governing organizations. The American Psychological Association ing that there is no point at which a provider’s competence is fully
(APA) published the Multicultural Guidelines (APA, 2017a) to “attained” and does not require further development. Rather, a
provide psychologists with a framework to aid in the provision of provider’s cultural competence can develop or degrade over time,
multiculturally competent practice. This document outlines 10 depending on their skills to meet the ever-changing needs of clients
guidelines to taking a strengths-based approach when working and our diversifying society. Therefore, it is of paramount impor-
with underserved communities (Clauss-Ehlers et al., 2019). The tance to understand how to effectively and efficiently promote
APA further demonstrated its commitment to cultural competence provider cultural competence.
such that the organization went beyond these recommendations to Due to its strong conceptualization and practical utility, the
develop enforceable standards in their Ethical Principles of tripartite model is routinely applied to inform the assessment of
Psychologists and Code of Conduct (APA, 2017b). Of particular student and practitioner cultural competence across diverse profes-
importance to delivering multiculturally competent services are sions, including psychologists (e.g., Johnson & Federman, 2014),
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Ethical Standards 2.01a and 2.01b—Boundaries of Competence, school teachers (e.g., Vincent & Torres 2015), public administrators
This document is copyrighted by the American Psychological Association or one of its allied publishers.

which indicates that psychologists must only provide services with (e.g., Rice, 2007), and physician assistants (e.g., Domenech
populations and in areas within the boundaries of their competence Rodríguez et al., 2019). Across fields, the literature is growing at
based on their education and training and must establish an under- a rate that facilitates systematic reviews regarding cultural compe-
standing of cultural factors to implement effective services. tence trainings (e.g., Beach et al., 2005; Benuto et al., 2018; Chipps
Equipping the mental health workforce with cultural competence et al., 2008; Clifford et al., 2015; Lie et al., 2011; Price et al., 2005;
involves training professionals to engage in the lifelong, develop- Truong et al., 2014). These trainings have shown positive outcomes.
mental commitment to and practice of providing culturally sensitive For example, Beach et al. (2005) found strong evidence that cultural
care. Such training could borrow from and build on the APA competence trainings improve health-care providers’ knowledge,
Multicultural Guidelines, beginning with understanding oneself attitudes, and skills. Findings from studies involving psychologists
as a multicultural being as a precursor to engaging in culturally tend to converge with those involving other health professionals.
sensitive care and implementing culturally adapted treatments. For example, a review by Benuto et al. (2018) found trainings to be
Training providers to develop cultural competence is not at odds effective in increasing psychologists’ knowledge of topics such as
with efforts to train providers in culturally adapted treatments or to racism and discrimination. There has also been some evidence for
initiate systems-level changes to meet the needs of culturally diverse the effects of cultural competence trainings on patient outcomes in
groups. Rather, training providers is and should be among one of health care, though there is a lack of a high-quality research to
many strategies to effectively serve culturally underserved groups further examine this relationship (Lie et al., 2011).
and address mental health disparities. These reviews have significantly advanced our understanding of
To that end, cultural competence in mental health services can be cultural competence trainings; however, there remain opportunities
understood as the provision of appropriate and effective services that to build on their contributions and expand the impact of the
are sensitive or congruent to the cultural identities of the client (Sue literature. First, the scope of trainings in previous reviews has
et al., 1998; Whaley & Davis, 2007). In its broadest definition, an been limited to a single cultural identity, specifically race/ethnicity
identity is one’s subjective sense of self. A cultural identity refers to (e.g., Beach et al., 2005; Price et al., 2005). A systematic review that
one’s sense of affiliation and belongingness with a sociocultural broadens the conceptualization of cultural diversity would offer
group. These groups have their own defining set of values, beha- benefits to the field by extending our understanding of the utility of
viors, and beliefs embedded within dynamic, intergenerational, cultural competence trainings for a range of cultural identities,
social, historical, and political factors (Whaley & Davis, 2007). which include those based on race/ethnicity, gender, sexual orien-
For example, cultural identities may be grouped by race (e.g., tation, religion, socioeconomic class, ability status, immigration
American Indians), religion (e.g., Muslims), ability status (e.g., status, among others. Second, there has been no published review
people with disabilities), or immigration status (e.g., refugee, tem- that examines cultural competence trainings in mental health pro-
porary worker). Inherently, all individuals have cultural identities viders broadly, as the only review focused exclusively on clinical
and intersecting identities that create unique experiences. and counseling psychologists (i.e., Benuto et al., 2018). A review
While there has been ambiguity regarding the precise definition of that expands the scope of mental health providers is of interest to
cultural competence (e.g., Whaley, 2008), there is general agree- psychologists because psychologists are leaders in developing,
ment that cultural competence is multidimensional. One of the most implementing, and assessing evidence-based cultural competence
widely used frameworks of provider-level cultural competence was trainings for mental health providers. Psychologists can continue to
proposed by Sue et al. (1982, 1992). Their tripartite model includes be on the forefront by understanding, and then adapting, strategies
(a) cultural attitudes (e.g., sensitivity to one’s own values and biases, developed and implemented by other fields that train mental health
and its impacts on one’s perceptions of the client, presenting providers.
problems, and therapeutic relationship); (b) cultural knowledge To this end, the first aim of this systematic review was to address
(e.g., knowledge about one’s own cultural background, the client’s these gaps by reviewing published studies of cultural competence
cultural background, and how systems operate on those identities trainings that had been delivered to mental health providers broadly
and treatment); and (c) cultural skills (e.g., ability to use therapeutic (e.g., professional discipline, training level) and for a range of
strategies that are culturally appropriate and sensitive). Sue and cultural identities in terms of their features (e.g., training length),
colleagues’ conceptualization of cultural competence is accepted in content (e.g., cultures covered), methods (e.g., instructional strate-
the field to encapsulate an other-orientated stance (e.g., cultural gies used), and outcome measurement (e.g., method and domain).
364 CHU, WIPPOLD, AND BECKER

The second aim was to identify curricula content and methods that Selection Process
were common in trainings that showed positive outcomes in each
The search strategy produced 5,479 articles. After duplicates were
outcome domain (i.e., attitudes, knowledge, skills). By providing a
removed using Mendeley, a reference management program, there
synthesis of curricula, it is possible to then identify strengths and
were 3,948 remaining articles to be screened using the article title
opportunities with regard to what has already been and what could
and abstract. Of the articles screened, 237 were identified as
be developed and tested. Additionally, aggregating findings across
potentially relevant. Then, the full-text article was retrieved to
studies could reveal patterns about training features associated with
determine whether all inclusion criteria were met, removing an
positive growth in cultural competence.
additional 197 articles. The final sample consisted of 40 articles
(Figure 1). A full list of articles included in this review is provided in
Method the Supplemental Materials.
Inclusion and Exclusion Criteria
Data Extraction and Coding Process
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Studies had to meet several criteria established a priori to be


This document is copyrighted by the American Psychological Association or one of its allied publishers.

included in this review. Inclusion and exclusion criteria are described To develop a codebook, we referenced previous reviews (Beach
in Table 1 and followed a PICOTS (Population, Intervention, et al., 2005; Benuto et al., 2018; Price et al., 2005) and literature on
Comparison, Outcomes, Timing, Setting) framework (Samson & cultural competence (Smith et al., 2006; Sue, 2001; Sue et al., 1982,
Schoelles, 2012). 1992), mental health training (Beidas & Kendall, 2010; Bennett-Levy
et al., 2009; Lyon et al., 2011; Meyers et al., 1998), and learning
strategies (Hattie et al., 1996). The final codebook structure consisted
Search Strategy
of four categories (i.e., features, content, method, outcome measure-
The review was conducted following the PRISMA guidelines. ment). Each category included two subcategories that were further
Five databases (i.e., PsycINFO [EBSCO], PubMed-MEDLINE broken into individual codes. The features category included the
[Ovid], Web of Science [Clarivate], ERIC [EBSCO], Google training subcategory, which included codes regarding the study design
Scholar) were searched using an a priori-defined search string: and training structure (e.g., training duration), and the participants
(cultur* OR multicultur* OR transcultur* OR cross-cultur* OR subcategory, which included codes about the training sample (e.g.,
diversity) AND (competenc* OR sensitivity OR awareness OR genders represented). The content category included the cultures
knowledge) AND (training* OR curriculum* OR teach* OR inter- subcategory, which included codes of the cultural identities discussed
vention* OR workshop* OR course* OR development) AND in the curriculum (e.g., religious identity), and the topics subcategory,
(“mental health”). Previous reviews and meta-analyses (Anderson which included codes of specific topics within each cultural identity
et al., 2003; Beach et al., 2005; Benuto et al., 2018; Bezrukova et al., (e.g., stereotypes). The method category included the format subcate-
2012; Brock et al., 2019; Chae et al., 2020; Chipps et al., 2008; gory, which captured how the training was conducted (e.g., live,
Clifford et al., 2015; Govere & Govere, 2016; Lie et al., 2011; expert-led), and the strategies subcategory, which included codes of
Malott, 2010; Price et al., 2005; Smith et al., 2006; Truong et al., the instructional methods used (e.g., discussions). The outcome mea-
2014), reference lists, and additional searches were also utilized to surement category included the measures subcategory, which included
identify potential articles. codes for how outcomes were measured (e.g., self-assessment),

Table 1
Inclusion and Exclusion Criteria

Parameter Inclusion criteria Exclusion criteria

Publication Studies published in English in peer-reviewed journals Gray literature (e.g., dissertations, theses, book chapters)
Population At least 50% of training sample consist of individuals who are At least 50% of training sample consist of:
receiving graduate training or are currently providing Health-care professionals (e.g., physicians, psychiatry
mental health therapy services residents, nurses)
Nonproviders (e.g., administrators)
Indirect providers (e.g., supervisors)
Undergraduate students
Intervention Any training in standard course or workshop format Study abroad programs
Service-learning courses
Comparison Any comparative or control group if not single-group design None
Outcomes At least one cultural competence training outcome measured Satisfaction outcomes only
for training participant Noncultural competence-related outcomes
Nonparticipant outcomes
Timing Any training duration Published before 1/1/1980
Publication date after 1/1/1980
Study design Single-group pre–post test Case study
Single-group post test only Theoretical study
Quasi-experimental
Randomized controlled trial
Setting Any setting None
CULTURAL COMPETENCE TRAININGS REVIEW 365

Figure 1
PRISMA Flow Diagram
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

and the domain subcategory, which included codes on the three (APA, 2021). Data may be requested by emailing the corresponding
domains of cultural competence (i.e., attitudes, knowledge, skills). author.
Outcomes that were measured quantitatively were also coded whether
they reached statistical significance or p < .05.
Results
Each article was coded by the first author. For articles that The final sample included 40 articles published between 1984 and
included multiple studies, each study was coded independently. 2019, with many published after 2010 (n = 17, 40.5%). These
The second author coded a random sample (10%) of the articles to 40 articles represent 42 trainings and 61 study groups, of which
ensure reliability. Any discrepancies were resolved by the first 17 (27.9%) were control groups and 44 (72.1%) were experimental
author. Data were entered and stored in a Microsoft Access database. groups whose participants received cultural competence training.
Coding reliability was assessed using Cohen’s kappa, a commonly A total of 37 unique curricula were tested in this sample of studies.
used measure of interrater reliability (McHugh, 2012). Reliability Individual study and training characteristics are provided in the
between the two raters ranged from moderate to almost perfect Supplemental Materials.
(κ = .67–.98) agreement (Landis & Koch, 1977).
Study Characteristics
Study characteristics (n = 42) are presented in Table 2. The
Transparency and Openness
majority of studies were conducted in the United States (78.6%).
This study’s planned methods and analyses were not shared in Many studies used single group, pre–post test designs (35.7%) and
a public registry (i.e., preregistered) prior to conducting the study quantitative methods (45.2%) to assess outcomes. Across all studies,
366 CHU, WIPPOLD, AND BECKER

Table 2 Content and Methods


Study Characteristics
Curricula content and methods are summarized in Table 3.
Study characteristic n % Among the 37 curricula, the most commonly covered cultural
identities were of race/ethnicity (64.9%), followed by sexual orien-
Design
Single-group pre–post test 15 35.7 tation (45.9%) and general multicultural identity (43.2%). All other
Quasi-experimental 13 31.0 identities, such as those related to gender, religion, ability status, and
Single group post test only 11 26.2 socioeconomic status, were discussed in less than one-quarter of
Randomized controlled trial 3 7.1 curricula. Common topics included sociocultural/historical infor-
Methodology
mation (e.g., legal protections, 89.2%), identity issues (e.g., identity
Quantitative 19 45.2
Mixed 15 35.7 development, 78.4%), and client interactions (e.g., therapeutic
Qualitative 8 19.0 alliance, 75.7%). Discrimination and prejudice (54.1%) were the
Year least discussed topic. Most curricula used a live, expert-led format
>2010
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

17 40.5 (91.9%). Curricula were delivered in a course (n = 21) or workshop


This document is copyrighted by the American Psychological Association or one of its allied publishers.

2000–2009 12 35.7
1990–1999 8 19.0 (n = 17) format. One curriculum was tested in both a course and
1980–1989 2 4.8 workshop format. The most common instructional strategies were
Countries didactic lectures (89.2%) and group discussions (86.5%). Assign-
United States 33 78.6 ments (e.g., presentations, 59.5%) and exercises (e.g., privilege
Canada 4 9.5
walk, 59.5%) were also commonly used strategies, while receiving
United Kingdom 3 7.1
Israel 1 2.4 feedback (e.g., after a role-play, 24.3%), providing clinical services
Australia 1 2.4 to clients (16.2%), and modeling (13.5%) were used less often.

Outcome Measurement
samples included at least one participant who was a master’s student
Across the 37 curricula, outcomes were primarily measured
(69.0%), doctoral student (47.6%), and mental health professional
using self-assessments (73.0%). Open-response questions (37.8%),
(31.0%). Across 38 studies (90.5%) that reported the discipline or
journal entries (16.2%), exams (10.8%), behavioral observation
professional fields of participants, study samples included at least
(10.8%), and client-reported assessments of provider competence
one participant who represented counseling psychology (60.5%),
(2.7%) were also used. Common standardized measures included
clinical psychology (34.2%), social work (34.2%), marriage and
the Multicultural Counseling Inventory (Sodowsky et al., 1994),
family therapy (10.5%), psychiatry (10.5%), or other fields such as
Multicultural Awareness Knowledge and Skills Survey (D’Andrea
nursing (15.8%). Studies included mixed-discipline (26.3%) and
et al., 1991), Sexual Orientation Counselor Competency Scale
single discipline samples (73.7%).
(Bidell, 2005), Lesbian, Gay, and Bisexual Affirmative Counseling
The total sample size of trained participants included 1,340
Self-Efficacy Inventory (Dillon & Worthington, 2003), and the
individuals, with sample sizes ranging from 4 to 169 (M = 32.7,
White Racial Identity Attitudes Scale (Helms & Carter, 1990).
SD = 34.4). Of the 25 (59.5%) studies that reported participant age,
the average age was 34.3 years (SD = 6.5). Across 33 (78.6%)
studies that reported gender, all included at least one female Content and Methods Common to Effective Trainings
participant and 24 (72.7%) included at least one male participant.
Across 35 studies (83.3%) that reported participants’ race/ethnicity, The second aim of this review was to describe content and
study samples included at least one participant who was self- methods that were common in curricula that showed positive out-
identified as non-Hispanic White (88.6%), Asian/Asian American comes to the provider. To accomplish this, we first identified the
(51.4%), Black/African American (48.6%), Hispanic/Latinx studies that demonstrated positive outcomes on measures of atti-
(37.1%), Multiracial (22.9%), American Indian/Alaskan Native tudes, knowledge, or skills following the training. Then, we exam-
(17.1%), Middle Eastern and North African (2.9%), and Native ined patterns of the content and methods of these curricula by
Hawaiian/Pacific Islander (2.9%). outcome domain.

Training Characteristics Attitudes


The first aim of this review was to characterize cultural compe- Of the three domains of cultural competence outcomes, cultural
tence trainings in terms of their features, content, methods, and attitudes were most frequently assessed (n = 33, 89.2%). Quantita-
outcome measurement. We did this by examining patterns across the tive cultural attitudes outcomes were assessed in 22 (66.7%) of these
entire sample of 37 curricula. 33 curricula. Of this number, 17 (77.5%) curricula saw statistically
significant impacts in the desired direction on providers’ attitudes
Features and thus served as the sample for our examination of curricular
content and methods (Table 3, “Attitudes” column). Among these
When reported, the average length of a distinct training session effective curricula, race/ethnicity was the most frequently discussed
was 4.0 hr (SD = 2.1) and the total training duration ranged from a cultural identity (64.7%) and all other cultural identity categories
single day to 36 weeks. Few curricula (n = 5; 13.5%) included a were discussed in approximately less than a third of curricula. Four
follow-up or booster component. topics (i.e., sociocultural/historical information, identity, client
CULTURAL COMPETENCE TRAININGS REVIEW 367

Table 3
Curricula Content, Methods, and Outcome Domains

Curricula characteristics by outcome domain


Code All curricula (n = 37) Attitudes (n = 17) Knowledge (n = 15) Skills (n = 15)

Content—Cultures
Race/Ethnicity 24 (64.9%) 11 (64.7%) 8 (53.3%) 8 (53.3%)
Sexual orientation 17 (45.9%) 6 (35.3%) 8 (53.3%) 8 (53.3%)
General multiculturalism 16 (43.2%) 6 (35.3%) 7 (46.7%) 7 (46.7%)
Gender 8 (21.6%) 2 (11.8%) 2 (13.3%) 2 (13.3%)
Religion 6 (16.2%) 2 (11.8%) 2 (13.3%) 2 (13.3%)
Ability status 5 (13.5%) 1 (5.9%) 2 (13.3%) 2 (13.3%)
Socioeconomic status 5 (13.5%) 1 (5.9%) 1 (6.7%) 1 (6.7%)
Immigration status 5 (13.5%) 1 (5.9%) 1 (6.7%) 2 (13.3%)
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Linguistic ability 4 (10.8%) 1 (5.9%) 1 (6.7%) 1 (6.7%)


This document is copyrighted by the American Psychological Association or one of its allied publishers.

Content—Topics
Sociocultural/Historical info 33 (89.2%) 16 (94.1%) 14 (93.3%) 13 (86.7%)
Identity 29 (78.4%) 14 (82.4%) 12 (80.0%) 12 (80.0%)
Client interaction 28 (75.7%) 14 (82.4%) 11 (73.3%) 11 (73.3%)
Stereotype 26 (70.3%) 14 (82.4%) 11 (73.3%) 9 (60.0%)
Mental health 23 (62.2%) 10 (58.8%) 10 (66.7%) 10 (66.7%)
Heritage 23 (62.2%) 12 (70.6%) 10 (66.7%) 9 (60.0%)
Theory 22 (59.5%) 11 (64.7%) 11 (73.3%) 10 (66.7%)
Discrimination/Prejudice 20 (54.1%) 11 (64.7%) 8 (53.3%) 7 (46.7%)
Method—Formats
Live, expert-led 34 (91.9%) 16 (94.1%) 14 (93.3%) 14 (93.3%)
Virtual, expert-led 2 (5.4%) 1 (5.9%) 1 (6.7%) 1 (6.7%)
Live, collaborative 1 (2.7%) 0 (0.0%) 0 (0.0%) 0 (0.0%)
Method—Strategies
Lecture 33 (89.2%) 17 (100.0%) 14 (93.3%) 13 (86.7%)
Discussion 32 (86.5%) 13 (76.5%) 12 (80.0%) 12 (80.0%)
Multimedia 27 (73.0%) 12 (70.6%) 8 (53.3%) 8 (53.3%)
Reading 26 (70.3%) 10 (58.8%) 9 (60.0%) 8 (53.3%)
Assignment 22 (59.5%) 9 (52.9%) 10 (66.7%) 9 (60.0%)
Exercise 22 (59.5%) 10 (58.8%) 11 (73.3%) 8 (53.3%)
Reflection 19 (51.4%) 6 (35.3%) 7 (46.7%) 7 (46.7%)
Direct contact 19 (51.4%) 7 (41.2%) 5 (33.3%) 6 (40.0%)
Role-play 16 (43.2%) 6 (35.3%) 5 (33.3%) 7 (46.7%)
Case scenario 15 (40.5%) 9 (52.9%) 9 (60.0%) 7 (46.7%)
Experiential immersion 10 (27.0%) 5 (29.4%) 3 (20.0%) 4 (26.7%)
Feedback 9 (24.3%) 3 (17.6%) 2 (13.3%) 3 (20.0%)
Clinical experience 6 (16.2%) 1 (5.9%) 2 (13.3%) 3 (20.0%)
Model 5 (13.5%) 2 (11.8%) 1 (6.7%) 1 (6.7%)
Note. For each domain, the n reported represents the number of curricula that yielded statistically significant changes in outcomes for that domain.

interaction, stereotypes) were discussed in over 80% of curricula common topic discussed was discrimination and prejudice (53.3%).
that saw changes in cultural attitudes. Mental health diagnosis and Lectures (93.3%) and discussion (80.0%) were the two most
treatment was the least common topic (58.8%). Didactic lectures common instructional strategy used. Exercises (73.3%), assign-
appeared in every curriculum (100.0%) that found significant ments (66.7%), readings, and case scenarios were strategies that
provider outcomes in attitudes. were also frequently used in curricula that saw positive outcomes in
cultural knowledge. More behavioral strategies such as exposure to
others with certain cultural identities (33.3%), role-play (33.3%),
Knowledge and modeling (6.7%) were used less often.
Cultural knowledge outcomes were assessed in 30 (81.1%) of the
curricula. Quantitative knowledge outcomes were assessed in 18 Skills
(60.0%) of the 30 curricula, of which 15 (83.5%) yielded statistically
significant increases in providers’ cultural knowledge (Table 3, Cultural skills outcomes were assessed the least frequently
“Knowledge” column). Among these 15 curricula, race/ethnicity (n = 25, 67.6%) among curricula. Quantitative outcomes were
(53.3%), sexual orientation (53.3%), and general multiculturalism assessed in 19 (76.0%) of the 25 curricula that measured cultural
(46.7%) were the most frequently discussed cultural identities. All skills. Of these, 15 (78.9%) curricula found statistically significant
other identities were discussed in less than 15% of curricula. Most increases in providers’ skills (Table 3, “Skills” column). Race/
topics, including theory, stereotypes, and client interactions, were ethnicity (53.3%), sexual orientation (53.3%), and general multi-
discussed in over two-thirds of trainings, with the most common cultural identities (46.7%) were discussed in approximately half of
topic being sociocultural/historical information (93.3%). The least curricula. All other cultural identities were discussed with lower
368 CHU, WIPPOLD, AND BECKER

frequency. In addition to sociocultural/historical information and in curricula that found significant outcomes in cultural skills, there
identity, client interactions (73.3%), theory (66.7%), and mental were opportunities to leverage more of these strategies to align with
health (66.7%) were discussed in curricula that found significant the adult learning and skill acquisition literature.
knowledge outcomes. Lectures (86.7%) and discussion (80.0%) Overall, these findings are similar to those from previous reviews,
were the two most common instructional strategies. Role-plays in which didactic strategies were the most commonly used methods
(46.7%) and reflections were used in approximately half of curric- and active learning strategies, specifically modeling, immediate
ula, while other strategies related to skill acquisition such as feedback, and direct clinical experiences, were used less often
feedback (20.0%) and modeling (6.7%) were used less often. (e.g., Beach et al., 2005; Benuto et al., 2018). While didactic
strategies are effective for increasing certain outcomes such as
declarative knowledge (Bennett-Levy et al., 2009), they are not
Discussion
recommended by the adult learning literature to be used in isolation
This systematic review aimed to characterize cultural competence or over more active learning strategies. Active strategies such as
trainings delivered to mental health providers in terms of their role-plays, feedback, and coaching have been found to be most
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

features, content, methods, and outcome measurement. In addition, effective in the training of mental health professionals (Beidas &
This document is copyrighted by the American Psychological Association or one of its allied publishers.

this review aimed to identify curricula content and methods that Kendall, 2010). The active process of critical reflection, which was
were common in trainings that showed positive outcomes in each found in about half of curricula, has also been posed as particularly
cultural competence outcome domain (i.e., attitudes, knowledge, relevant for adult learners (Mezirow, 1991). Future research should
skills). We examined 37 unique training curricula from 40 published examine whether cultural competence trainings that capitalize on
articles and have highlighted our findings to make recommendations active learning strategies such as modeling, role-playing, reflections,
for future trainings. and receiving corrective feedback might be even more effective than
As previous reviews on cultural competence trainings have those that rely on didactic instruction, or whether the effects of
focused primarily on race/ethnicity, we assessed a broad range of active learning strategies might be differentially related to outcomes
cultural identities and topics in our review. One of the most at posttraining or more enduring effects over time.
important findings from this study is that the cultural identities Most studies in the present review used a single group pre–post
represented in the curricula in our review were not equally distrib- study design. While randomized controlled trial designs have high
uted. Notably, most curricula focused on race/ethnicity, sexual value to understand the impact of trainings, we recognize that these
orientation, gender, or general multicultural identities. This presents rigorous designs may not be feasible for all training developers and
the question whether mental health providers have the necessary for every context and that it is possible to collect useful training data
training to effectively serve individuals who come from other using other methods (e.g., pre–post design with multiple outcome
cultural backgrounds that are not well represented in the literature, domains, including client perspectives). Relatedly, we found that
a concern that reflects APA Ethical Standards 2.01a and 2.01b. training length varied drastically, ranging from a single-day 45-min
Importantly, this review also found that discrimination and preju- workshop to a 9-month bi-weekly commitment. While some litera-
dice was the least discussed topic in curricula. This is concerning as ture suggests single-day workshops alone are ineffective at building
marginalized individuals frequently experience discrimination in mental health providers’ competencies (Beidas et al., 2012), the
services, with studies finding that up to 81% of clients experience at studies in this review demonstrated that both brief and longer
least one microaggression in therapy (Hook et al., 2016). Given that trainings were successful at improving provider outcomes. This
microaggressions in therapy have been associated with weaker calls the field to consider how trainings can be designed to best
therapeutic alliance and poorer client outcomes (Owen et al., match the contexts where mental health providers work, such as by
2017), addressing not only how discrimination affects clients’ lived adjusting the training duration. Other scholars have also advocated
experiences, but also how providers can reduce discriminatory for trainings supplemented with ongoing contextual support such as
behaviors may create a downstream effect of positive outcomes. consultation and supervision to consolidate learning from training
Importantly, addressing bias and discrimination in standard work- (Frank et al., 2020).
force training aligns with policy and practice recommendations Additionally, we found that self-assessment measures were the
to ameliorate structural racism in mental health service systems most common method of evaluating the impact of training on
(Alvarez et al., in press). providers. While many measures have been validated, self-
Another important set of findings involved content and methods assessment evaluations of cultural competence do not necessarily
of effective curricula. Effective curricula, as defined by significant reflect actual behavior and have been associated with social desir-
changes in the desired direction, across all outcomes included ability (Constantine & Ladany, 2000). Future research could exam-
sociocultural/historical information, cultural identity, and client ine whether other methods, such as knowledge tests or behavioral
interactions with high frequency. Curricula that yielded positive observation of skills, might provide different assessments of training
outcomes on cultural knowledge and cultural skills also included outcomes (Kalinoski et al., 2013). It is also important to examine
theory as a common topic. This aligns with the literature on training whether training improves client engagement and treatment out-
adults, which suggests that discussing how theoretical knowledge comes (Lie et al., 2011). This may be informed by a meta-analysis or
may enhance providers’ understanding or practical application of by examining client perspectives on the cultural competence of
cultural competence is a key component to include in curricula training participants.
(Yannacci et al., 2006). For curricula that found positive outcomes In addition, we found that the population represented in most
on cultural attitudes and knowledge, assignments, exercises, read- trainings were master’s-level graduate students. It is very positive
ings, and case scenarios were often used, in addition to lectures and that cultural competence is getting attention in the field at the
discussions. Moreover, while some behavioral strategies appeared prelicensure level when professional habits are being established.
CULTURAL COMPETENCE TRAININGS REVIEW 369

Examining graduate school curricula and comparing curriculum curriculum elements and training outcomes. To make these claims,
requirements to cultural competence standards may inform our additional statistical testing is needed. Fourth, there is a potential for
understanding of the role of education and training in developing bias in the outcomes reported in this review, as most studies relied on
cultural competence. At the same time, practicing professionals self-assessment measures of cultural competence. However, this is a
were represented in less than one-third of trainings in this review. limitation of the methodology used in the field rather than of this
Given that postgraduate mental health professionals report that specific review. Nevertheless, the patterns from this review provide
training can facilitate engagement with underserved populations training developers another source of information from the evidence
(Park et al., 2020), it is important to develop and support providers’ base to use in designing future trainings.
cultural competence after their training and formal education. Thus,
agencies may consider how to promote and foster ongoing devel- Implications for Research and Curriculum Development
opment of cultural competence for practicing professionals through
We identified several opportunities, which we pose as questions
providing and rewarding attendance of cultural competence training
for future consideration by researchers/training developers:
opportunities. Governing associations or accrediting bodies may
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

also play a role in requiring regular cultural competence training 1. Could the rigor of the study design be increased to
This document is copyrighted by the American Psychological Association or one of its allied publishers.

(e.g., continuing education requirements). advance our knowledge of cultural competence trainings
Finally, the studies in this review included samples of mental in a meaningful way? For example, could the study
health providers that represented different professional disciplines. design include a control group or longitudinal/follow-up
Specifically, while counseling and clinical psychology trainees and data collection methods? Could the study employ an
professionals were often participants, individuals from social work, additive or factorial design to examine the relative
marriage and family therapy, and allied health professions (e.g., contributions of different training methods or content?
psychiatry, nursing) were also represented in the cultural compe-
tence trainings for mental health providers. In addition, more than 2. Could the curricula include theoretical knowledge to set
one-quarter of training samples included individuals from different the foundation for learning by emphasizing the relevance
professional backgrounds. This finding reflects the interdisciplinary of cultural competence to providers and clients alike?
nature of mental health services, which is a context valued by the 3. Could the curricula expand its focus to identities beyond
APA (2017a; 2017b) that both requires psychology’s attention and race/ethnicity, such as cultural identities related to religion
that represents an opportunity for scientific advancement. Although or immigration status? What are the principles or proce-
the number of studies that included individuals from professional dures that generalize across identities?
backgrounds other than counseling and clinical psychology was too
small for analytic comparisons with studies of counseling and 4. Could the curricula and training expand to include topics
clinical psychology trainees, our review found some similar results of discrimination and prejudice to gain knowledge about
to a previous systematic review that examined trainings in clinical clients’ experiences and also opportunities for reflection
and counseling trainees and psychologists (Benuto et al., 2018), about mental health providers’ awareness and ability to
suggesting that the strategies and methods of other fields are not address their own discriminatory behaviors, such as mi-
widely different from those of counseling and clinical psychology. It croaggressions, and prejudiced beliefs?
is possible and perhaps desirable for psychologists to borrow from
and build upon strategies implemented within psychology and 5. Could the training incorporate active learning strategies,
across similar fields. Moreover, as the demands of cultural compe- such as case vignettes, role-playing, modeling, and pro-
tency change with time, the cross-fertilization of training ideas viding feedback, to support practical application, reflec-
across fields can advance the professional practice and research tion, and growth?
of psychology more rapidly than siloed pursuits to address important 6. Could the study include multimethod (e.g., observation,
issues in our field such as improving the quality of mental health care questionnaire) and multiinformant assessment (e.g.,
for culturally underserved communities. trainee, client, supervisor) to examine how methods and
perspectives converge or not?
Limitations In summary, this review demonstrates that cultural competence
There are several limitations of this review to note. First, this trainings are generally effective at shifting attitudes, increasing
review gathered curricula information reported only in published, knowledge, and developing skills of mental health providers. In
peer-reviewed manuscripts. Unpublished work and official protocols considering and applying the mentioned recommendations above,
were not requested from authors, thus presenting the possibility of we hope that the science and practice of cultural competence
publication bias and omission of curricula information described trainings can continue to improve to support the mental health
elsewhere. Second, novel training approaches, such study abroad needs of culturally underserved communities.
programs, and specific service-learning programs, were also excluded
from this systematic review due to their nonstandard formats. The References
studies and trainings in this review only represent information about Alvarez, K., Cervantes, P. E., Nelson, K. L., Seag, D. E. M., Horwitz,
cultural competence workshops and courses and therefore exclude S. M., & Hoagwood, K. E. (in press). Structural racism, children’s
curricula information that is potentially different and unique to these mental health service systems, and recommendations for policy and
nonstandard formats. Third, the descriptive nature of this review practice change. Journal of the American Academy of Child & Adoles-
cannot be used to deduce causal relationships between specific cent Psychiatry.
370 CHU, WIPPOLD, AND BECKER

American Psychological Association. (2017a). Multicultural guidelines: An Australia, New Zealand, Canada and the USA: A systematic review.
ecological approach to context, identity, and intersectionality. https:// International Journal for Quality in Health Care, 27(2), 89–98. https://
www.apa.org/about/policy/multicultural-guidelines doi.org/10.1093/intqhc/mzv010
American Psychological Association. (2017b). Ethical principles of psychol- Constantine, M., & Ladany, N. (2000). Self-report multicultural counseling
ogists and code of conduct. https://www.apa.org/ethics/code/ethics-code- competence scales: Their relation to social desirability attitudes and
2017.pdf multicultural case conceptualization ability. Journal of Counseling Psy-
American Psychological Association. (2021). Preregistration. https://www chology, 47(2), 155–164. https://doi.org/10.1037/0022-0167.47.2.155
.apa.org/pubs/journals/resources/preregistration D’Andrea, M., Daniels, J., & Heck, R. (1991). Evaluating the impact
Anderson, L. M., Scrimshaw, S. C., Fullilove, M. T., Fielding, J. E., of multicultural counseling training. Journal of Counseling and
Normand, J., & Task Force on Community Preventive Services. Development, 70(1), 143–150. https://doi.org/10.1002/j.1556-6676.1991
(2003). Culturally competent healthcare systems: A systematic review. .tb01576.x
American Journal of Preventive Medicine, 24(3), 68–79. https://doi.org/10 Dillon, F., & Worthington, R. L. (2003). The Lesbian, Gay and Bisexual
.1016/s0749-3797(02)00657-8 Affirmative Counseling Self-Efficacy Inventory (LGB-CSI): Develop-
Beach, M. C., Price, E. G., Gary, T. L., Robinson, K. A., Gozu, A., Palacio, ment, validation, and training implications. Journal of Counseling Psy-
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

A., Smarth, C., Jenckes, M. W., Feuerstein, C., Bass, E. B., Powe, N. R., & chology, 50(2), 235–251. https://doi.org/10.1037/0022-0167.50.2.235
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Cooper, L. A. (2005). Cultural competence: A systematic review of health Domenech Rodríguez, M. M., Phelps, P. B., & Tarp, H. C. (2019). Baseline
care provider educational interventions. Medical Care, 43(4), 356–373. cultural competence in physician assistant students. PLOS ONE, 14(4),
https://doi.org/10.1097/01.mlr.0000156861.58905.96 Article e0215910. https://doi.org/10.1371/journal.pone.0215910
Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Frank, H. E., Becker-Haimes, E. M., & Kendall, P. C. (2020). Therapist
Training and consultation to promote implementation of an empirically training in evidence-based interventions for mental health: A systematic
supported treatment: A randomized trial. Psychiatric Services, 63(7), review of training approaches and outcomes. Clinical Psychology: Science
660–665. https://doi.org/10.1176/appi.ps.201100401 and Practice, 27, Article e12330. https://doi.org/10.1111/cpsp.12330
Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based Govere, L., & Govere, E. M. (2016). How effective is cultural competence
practice: A critical review of studies from a systems-contextual perspec- training of healthcare providers on improving patient satisfaction of
tive. Clinical Psychology: Science and Practice, 17(1), 1–30. https:// minority groups? A systematic review of literature. Worldviews on
doi.org/10.1111/j.1468-2850.2009.01187.x Evidence-Based Nursing, 13(6), 402–410. https://doi.org/10.1111/wvn.
Bennett-Levy, J., McManus, F., Westling, B. E., & Fennell, M. (2009). 12176
Acquiring and refining CBT skills and competencies: Which training Hattie, J., Biggs, J., & Purdie, N. (1996). Effects of learning skills inter-
methods are perceived to be most effective? Behavioural and Cognitive ventions on student learning: A meta-analysis. Review of Educational
Psychotherapy, 37(5), 571–583. https://doi.org/10.1017/S135246580999 Research, 66(2), 99–136. https://doi.org/10.3102/00346543066002099
0270 Helms, J. E., & Carter, R. T. (1990). Development of the White Racial
Benuto, L. T., Casas, J., & O’Donohue, W. T. (2018). Training culturally Identity Inventory. In J. E. Helms (Ed.), Black and white racial identity
competent psychologists: A systematic review of the training outcome attitudes: Theory, research and practice (pp. 67–80). Greenwood Press.
literature. Training and Education in Professional Psychology, 12(3), Hook, J. N., Farrell, J. E., Davis, D. E., DeBlaere, C., Van Tongeren, D. R., &
125–134. https://doi.org/10.1037/tep0000190 Utsey, S. O. (2016). Cultural humility and racial microaggressions in
Bezrukova, K., Jehn, K., & Spell, C. (2012). Reviewing diversity training: counseling. Journal of Counseling Psychology, 63(3), 269–277. https://
Where we have been and where we should go. Academy of Management doi.org/10.1037/cou0000114
Learning & Education, 11(2), 207–227. https://doi.org/10.5465/amle Johnson, L., & Federman, E. J. (2014). Training, experience, and attitudes of
.2008.0090 VA psychologists regarding LGBT issues: Relation to practice and
Bidell, M. P. (2005). The sexual orientation counselor competency scale: competence. Psychology of Sexual Orientation and Gender Diversity,
Assessing attitudes, skills, and knowledge of counselors working with 1(1), 10–18. https://doi.org/10.1037/sgd0000019
lesbian, gay, and bisexual clients. Counselor Education and Supervision, Kalinoski, Z. T., Steele-Johnson, D., Peyton, E. J., Leas, K. A., Steinke, J., &
44(4), 267–279. https://doi.org/10.1002/j.1556-6978.2005.tb01755.x Bowling, N. A. (2013). A meta-analytic evaluation of diversity training
Brock, M. J., Fowler, L. B., Freeman, J. G., Richardson, D. C., & Barnes, outcomes. Journal of Organizational Behavior, 34(8), 1076–1104. https://
L. J. (2019). Cultural immersion in the education of healthcare profes- doi.org/10.1002/job.1839
sionals: A systematic review. Journal of Educational Evaluation for Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement
Health Professions, 16, Article 4. https://doi.org/10.3352/jeehp.2019 for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/
.16.4 2529310
Chae, D., Kim, J., Kim, S., Lee, J., & Park, S. (2020). Effectiveness of Lie, D. A., Lee-Rey, E., Gomez, A., Bereknyei, S., & Braddock, C. H., III.
cultural competence educational interventions on health professionals and (2011). Does cultural competency training of health professionals improve
patient outcomes: A systematic review. Japan Journal of Nursing Science, patient outcomes? A systematic review and proposed algorithm for future
17(3), Article e12326. https://doi.org/10.1111/jjns.12326 research. Journal of General Internal Medicine, 26(3), 317–325. https://
Chipps, J. A., Simpson, B., & Brysiewicz, P. (2008). The effectiveness of doi.org/10.1007/s11606-010-1529-0
cultural-competence training for health professionals in community-based Lyon, A. R., Stirman, S. W., Kerns, S. E., & Bruns, E. J. (2011). Developing
rehabilitation: A systematic review of literature. Worldviews on Evidence- the mental health workforce: Review and application of training ap-
Based Nursing, 5(2), 85–94. https://doi.org/10.1111/j.1741-6787.2008 proaches from multiple disciplines. Administration and Policy in Mental
.00117.x Health, 38(4), 238–253. https://doi.org/10.1007/s10488-010-0331-y
Clauss-Ehlers, C. S., Chiriboga, D. A., Hunter, S. J., Roysircar, G., & Malott, K. M. (2010). Multicultural counselor training in a single course:
Tummala-Narra, P. (2019). APA Multicultural Guidelines executive Review of research. Journal of Multicultural Counseling and Develop-
summary: Ecological approach to context, identity, and intersectionality. ment, 38(1), 51–63. https://doi.org/10.1002/j.2161-1912.2010.tb00113.x
American Psychologist, 74(2), 232–244. https://doi.org/10.1037/amp0 McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia
000382 Medica, 22(3), 276–282. https://doi.org/10.11613/BM.2012.031
Clifford, A., McCalman, J., Bainbridge, R., & Tsey, K. (2015). Interventions Meyers, J., Kaufman, M., & Goldman, S. (1998). Promising practices:
to improve cultural competency in health care for Indigenous peoples of Training strategies for serving children with serious emotional
CULTURAL COMPETENCE TRAININGS REVIEW 371

disturbance and their families in a system of care. Center for Effective Sue, D. W. (2001). Multidimensional facets of cultural competence.
Collaboration and Practice. The Counseling Psychologist, 29(6), 790–821. https://doi.org/10.1177/
Mezirow, J. (1991). Transformative dimensions of adult learning. 0011000001296002
Jossey-Bass. Sue, D. W., Arredondo, P., & McDavis, R. J. (1992). Multicultural counsel-
Owen, J., Drinane, J., Tao, K. W., Adelson, J. L., Hook, J. N., Davis, ing competencies and standards: A call to the profession. Journal of
D., & Fookune, N. (2017). Racial/ethnic disparities in client unilateral Counseling and Development, 70, 477–486. https://doi.org/10.1002/j
termination: The role of therapists’ cultural comfort. Psychotherapy .1556-6676.1992.tb01642.x
Research, 27(1), 102–111. https://doi.org/10.1080/10503307.2015.10 Sue, D. W., Bernier, J. E., Durran, A., Feinberg, L., Pedersen, P., Smith, E. J.,
78517 & Vasquez-Nuttall, E. (1982). Position paper: Cross-cultural counseling
Park, A. L., Boustani, M. M., Saifan, D., Gellatly, R., Letamendi, A., competencies. The Counseling Psychologist, 10(2), 45–52. https://doi.org/
Stanick, C., Regan, J., Perez, G., Manners, D., Reding, M. E. J., & 10.1177/0011000082102008
Chorpita, B. F. (2020). Community mental health professionals’ percep- Sue, D. W., Carter, R. T., Casas, J. M., Fouad, N. A., Ivey, A. E., Jensen, M.,
tions about engaging underserved populations. Administration and Policy LaFromboise, T., Manese, J. E., Ponterotto, G., & Vazquez-Nutall, E.
in Mental Health, 47(3), 366–379. https://doi.org/10.1007/s10488-019- (1998). Multicultural counseling competencies: Individual and organiza-
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

00994-3 tional development. Sage Publications


This document is copyrighted by the American Psychological Association or one of its allied publishers.

Price, E. G., Beach, M. C., Gary, T. L., Robinson, K. A., Gozu, A., Palacio, Truong, M., Paradies, Y., & Priest, N. (2014). Interventions to improve
A., Smarth, C., Jenckes, M., Feuerstein, C., Bass, E. B., Powe, N. R., & cultural competency in healthcare: A systematic review of reviews. BMC
Cooper, L. A. (2005). A systematic review of the methodological rigor of Health Services Research, 14(1), Article 99. https://doi.org/10.1186/1472-
studies evaluating cultural competence training of health professionals. 6963-14-99
Academic Medicine, 80(6), 578–586. https://doi.org/10.1097/00001888- Vincent, S. K., & Torres, R. M. (2015). Multicultural competence: A case
200506000-00013 study of teachers and their student perceptions. Journal of Agricultural
Rice, M. F. (2007). Promoting cultural competency in public administration Education, 56(2), 64–75. https://doi.org/10.5032/jae.2015.02064
and public service delivery: Utilizing self-assessment tools and perfor- Whaley, A. L. (2008). Cultural sensitivity and cultural competence: Toward
mance measures. Journal of Public Affairs Education, 13(1), 41–57. clarity of definitions in cross-cultural counselling and psychotherapy.
https://doi.org/10.1080/15236803.2007.12001466 Counselling Psychology Quarterly, 21(3), 215–222. https://doi.org/10
Samson, D., & Schoelles, K. M. (2012). Chapter 2: medical tests guidance (2) .1080/09515070802334781
developing the topic and structuring systematic reviews of medical tests: Whaley, A. L., & Davis, K. E. (2007). Cultural competence and evidence-
utility of PICOTS, analytic frameworks, decision trees, and other frame- based practice in mental health services: A complementary perspective.
works. Journal of General Internal Medicine, 27(Suppl. 1), S11–S19. American Psychologist, 62(6), 563–574. https://doi.org/10.1037/0003-
https://doi.org/10.1007/s11606-012-2007-7 066X.62.6.563
Smith, T. B., Constantine, M. G., Dunn, T., Dinehart, J., & Montoya, J. A. Yannacci, J., Roberts, K., & Ganju, V. (2006). Principles from adult learning
(2006). Multicultural education in the mental health professions: A meta- theory, evidence-based teaching, and visual marketing: What are the
analytic review. Journal of Counseling Psychology, 53(1), 132–145. implications for toolkit development? Center for Mental Health Quality
https://doi.org/10.1037/0022-0167.53.1.132 and Accountability NRI.
Sodowsky, G. R., Taffe, R. C., Gutkin, T. B., & Wise, S. L. (1994).
Development of the Multicultural Counseling Inventory: A self-report Received May 21, 2021
measure of multicultural competencies. Journal of Counseling Psychol- Revision received March 30, 2022
ogy, 41(2), 137–148. https://doi.org/10.1037/0022-0167.41.2.137 Accepted April 7, 2022 ▪

You might also like