Professional Documents
Culture Documents
PROGRAM
ASSESSMENT
REPORT PREPARED BY:
LUCAS BEAL
Table of Contents
Meet your Assessment Team pg. 4
Limitations pg. 19
References pg. 26
Appendices
Appendix A pg. 27 - 28
Appendix B pg. 29 - 31
Appendix C pg. 32
Appendix D pg. 33
Lucas Beal Hannah Durand Brian Fox Antonio Oakley Kayla Patterson
Hello,
Throughout this semester, our team was provided the opportunity to work with Carrie
Rogers and members of the Transformative Rural-Urban Exchange (TRUE) Program at
Western Carolina University (WCU) to assess the effectiveness of this program for our
students. We were tasked with reviewing data from the retreat of this program and
assessing if the TRUE program met its intended outcomes, the overall effectiveness of
the program, and assess/ evaluate the overall program to inform future
recommendations and improvements.
We hope that this report presents our findings of the TRUE program honestly and
highlights recommendations that support a shared interest in the continued growth of
this program and all future participants.
Sincerely,
PG. 4
ABOUT THE PROGRAM
The program is one piece of a comprehensive “diversity plan” of the College of Education and
Allied Professions for designing, implementing, and evaluating curricula and experiences to
ensure that undergraduate candidates for licensure as teachers acquire the knowledge, skills, and
dispositions necessary to close the achievement gap and help all students learn in school.
(Western Carolina University)
NCA&T is a research intensive historically black WCU is a comprehensive regional university located
university in Greensboro, a community that is the site in Cullowhee, an unincorporated community in rural
of several key events in the civil rights movement southern Appalachia, that is near the Eastern Band
and continues to be one of the state’s most diverse, of Cherokee Qualla Boundary.
politically charged communities.
PG. 7
Prior to TRUE Retreat
Overview
Leading up to a TRUE retreat (details provided on the next page) accepted students of the
TRUE program are expected to meet monthly over Zoom to explore topics that were
intended to prepare them for the TRUE retreat (where NCAT and WCU would visit each
other's campuses and complete additional activities and discussions. This page is an
overview of the modules and goals that were reviewed prior to the TRUE retreat. Further
details can be found within Appendix B.
Modules Goals
Participants will:
Introduction Meeting
State the goals of TRUE and participant requirements.
State the knowledge, skills, and dispositions necessary to
support the learning of all students.
Participants will:
Acknowledge identity on the cultural competence
Module 2: Cultural continuum
Acknowledge group memberships, how they serve as
Identity & Proficiency an advantage or disadvantage in the larger society, and
how they impact interactions
PG. 8
TRUE Retreat
What is it?
The retreat component of the TRUE program is when a small group of accepted students
spend a week at their partner university, and then host their counterparts at their home
university. The retreat at WCU is available to students who have been accepted into the
education program but are not yet student teaching during the semester of the exchange.
Purpose
The intended purpose of the retreat component of TRUE is to provide opportunities for
students to "interact with peers from diverse ethnic, racial, socioeconomic, geographic and
language groups to acknowledge similarities and differences" which supports the programs
intended goal of providing students with opportunities to develop an understanding of
diversity in education.
PG. 9
Need for Assessment
What is Assessment?
According to Upcraft and Schuh (1996), assessment is "is any effort to gather, analyze, and
interpret evidence which describes institutional, departmental, division, or agency
effectiveness (p. 18). Generally, student affairs professionals are tasked with supporting the
overall mission of the university or college, but primarily supporting college students
throughout their experience at that perspective college or university. Assessment is a
crucial piece of this goal in that when used effectively, results from assessment helps to
guide recommendations for improvement that are not only an aspect that is necessary to
sustain initiatives, departments, etc but something that we strive for in the pursuit towards
improving departments, initiatives, and programs in the future.
Therefore, the need for this assessment is primarily to evaluate the data and information
provided to our team to inform recommendations for the future. This does not diminish the
potential impact that this program has had in the past, but we hope to highlight
opportunities for growth in the future that promote an intentional and positive impact on
students from both Western Carolina University (WCU) and North Carolina A&T University
(NCAT).
PG. 10
TRUE PROGRAM:
What Students
Expect
The following portion presents two application
responses by two WCU applicants that highlight
their rationale for wanting to participate in the
TRUE program. These responses were in response
to the highlighted prompt question:
PG. 11
Student Expectations
How might participating in the Transformative Rural Urban Exchange help
you grow as a teacher?
"I think participating in the TRUE program "I think that participating in the
would help me grow as a teacher by Transformative Rural-Urban Exchange
exposing me to different areas and how that (TRUE) will help me grow as a teacher
affects teaching. I don’t think we often think because I will be able to learn from other
that the community affects students and the people on how I can become more accepting
way we teach, however it plays a vital role. and aware of my future students. Like I
stated before, I grew up in a middle to
While growing up, I may have experienced upper-class area and that town created
more of an urban school system, it is very some limiting biases in my mind. It was not
different being a part of one and teaching in until college that I realized that I carried a lot
one. My high school experience was very of privileges. I think that this exchange will
different from others, so it is often hard for me allow me to meet people who grew up in
to relate, and in my younger elementary years, different areas than me and I will be able to
it is hard to remember. When looking at learn from their personal stories. This is also
teaching, I plan to go back home to teach going to be a great time for me to learn how
special education in an elementary classroom. I to listen to others' stories without trying to
would like to be exposed to the urban relate because sometimes I will simply not be
environment that I able to relate. I will be able to take this
will more than likely be located in with kids the knowledge and reflect on how important it is
age I’m looking to teach. to throw yourself into situations where you
are the outcast. I can use this to remember
Being a student at Western Carolina University that I will have students that feel like the
exposes me to the counties of Western North outcast, and I can take this knowledge and
Carolina, which are mostly rural, like Jackson, help them feel safe in my classroom. This
Haywood, Macon, etc. I think this is a experience will help me understand some of
wonderful experience to encounter the rural my students on a deeper level. I hope to gain
education style I never really experienced. All a lot of insight from this and I cannot wait to
the teachers here see their students in the come out with new information."
stores, at events and know their moms on a -2022 Applicant
personal level. However, I don’t think we often
get exposed to those urban and suburban
communities here that we may end up
teaching in one day. I think it is important to
practice and have experience in both to be
prepared for whatever may come before us."
-2022 Applicant
TRUE PROGRAM ASSESSMENT REPORT
PG. 12
RESEARCH METHODS
Instruments and Data Collection Processes:
Our group was tasked with assessing the TRUE program with a specific
focus on the effectiveness of the retreat that took place at Western
Carolina University (WCU). We did not collect any new data from previous
participants of the TRUE program as access to this population was limited.
Primarily, our focus was to analyze the collected data from previous years.
The data was initially assessed using a mixed methods approach (surveys,
focus groups, observation, etc).This section provides an overview of the
methods we used to further assess the retreat and TRUE program at WCU.
PG. 13
Benefits of TRUE
Let's hear from the students:
Overall, the student responses from the 2022 True Retreat depicted components of the
retreat as impactful. For example, a few students that participated in the retreat in 2022
reflected in their evaluation:
"I really just learned so much "I love how open minded and
about the different experiences respectful everyone was.
that people have, and also how Everyone participated and
to implement change in school were supportive!"
and in the classroom."
Common Themes:
Theme #1 Identity and Belonging
PG. 14
Drawbacks of TRUE
Let's hear from the students:
In addition to the perceived benefits of the TRUE program, feedback from students
provide potential drawbacks to the program, thereby allowing TRUE members the
opportunity to implement changes to address these concerns. Some example feedback
from Appendix D includes:
"I felt argumentative because of the I felt like it was multiple of the
lack of knowledge of privilege and same people talking. And that
opportunity. I felt like it was my some of the conversation was
role, in a good way, to educate my one sided. (TRUE retreat
peers." journal, 2022)
PG. 15
OUTCOMES REFERENCE
The purpose of the next section is to provide a visual
representation for how the different components of the
TRUE program model align with their nine objectives. The
three sections in this portion are the following:
Part 3 - The RE
PG. 16
** = No data to support
PART 1 : True Program Matrix
Campus & School
Goals Objectives Cultural Modules Cultural Retreat Visit
Acknowledge identity on
the cultural competence
continuum**
Acknowledge group
memberships, how they
serve as an advantage or
disadvantage in the larger
society, and how they
Develop Cultural Awareness
impact interactions
Acknowledge group
memberships, how they
serve as an an advantage
or disadvantage in the
larger society, and how
they impact interactions
Develop pedagogy
Develop Equity Focused
for equity**
Adapt a culturally
Pedagogy
relevant anti-bias
teaching pedagogy**
Develop Equitable
Pedagogy & Teaching
Skills**
PG. 17
What topics emerged during the REAL
Talk Dialogue experience... PART 2:
REAL
TALK
OUTCOMES
Student comfortability during
REAL Talk Dialogue
experience...
Assessment Program
Limitations Limitations
Data type inconsistent over time The REAL activity had no defined
2019 learning objectives.
2020
As a group, we wanted to find data
2021
WCU Student Data that could provide insight into the
School affiliation impact of COVID-19 on the program.
Demographic Information We needed to understand how the
Access to relevant data students' mindsets shifted after the
No access to the survey results of Post-
pandemic.
retreat data
No access to any data from NC A&T State
There were applications that the
University. students filled out, but there was no
Student Names information about their social and
University Classifications economic status or their current
attitudes and beliefs about
education.
PG. 19
Recommendations
How to know if your goals are being met?
tba Comprehensive
tba
knowledge in
equitable pedagogy
The diagram above is a visual representation of different tools that can be used to measure the items
on the right. The items on the right were extracted from the program goals and objectives for the
TRUE program. The third row assessment items were left open in oder to accommodate site specific
educational practices for the unique needs of Western Carolina University and North Carolina A&T.
In addition to the recommended practices above, below is a general list of additional recommendations
that may provide supporting insight for as
Social Media presence (Engaging greater academic and teaching community/ keep a portfolio of
the impact you are making)
1 year post program or alum feedback (Understand long term impact of program once individuals
have entered the classroom)
Collect demographic data
Track institution affiliation
Cross compare retreat impact between partner institutions
Shared OneDrive/ Archive for WCU and NCA&T access
PG. 20
Supporting Literature
While most of the work completed by our group focused on TRUE, and the data
that has been collected over the years, we also found it pertinent to look at supporting
external literature. Our review of this relevant literature yielded two big ideas:
PG. 21
How can “TRUE” transcend the classroom?
TRUE exists outside of the traditional classroom environment, while still being a
collaboration between two accredited institutions. Not all effective centers of learning
take place in the traditional classroom (Brockenbrough, 2016). This affords TRUE
unique freedoms, as well as limitations and challenges. As TRUE continues to
evaluate their assessment outcomes, and the future of “Real Talk”, they will find value
in pondering these questions:
This new and exciting environment can encourage students to discuss ideas and
experiences they might never feel comfortable discussing in a formal classroom
setting (Brockenbrough, 2019; Sauntson, 2018). But, this space must be intentionally
created (Kernahan, 2019). Because TRUE creates an effectively new learning
environment for it’s students, how does TRUE ensure that “Real Talk” is an area of
growth, instead of an area of perfection (Kernahan, 2019)? Resistance to new,
uncomfortable knowledge and points of view can create resistance (Kernahan, 2019).
This can create feelings of shame or blame in students of all identities.
Furthermore, a common barrier to entry when discussing different identities is the
fear of saying things “incorrectly” (Kernahan, 2019). The goal is not to enshrine
protection for intentionally ignorant statements, but to create a space of
understanding and growth instead of perfection.
It is prudent for an instructor to be sensitive to these threats and challenges, and
to lessen their impact. (Kernahan, 2019). This is not to say that TRUE does not do
this, but instead we want to challenge it’s coordinators to intentionally ensure that
this is a space where students can be comfortable processing new information.
We encourage TRUE to acknowledge with their students the strengths and
weaknesses of it’s format. There is power in giving the attendees a stake in creating
this community; in acknowledging it’s unique positionality as a para-classroom
experience; and creating community expectations in navigating the initial discomfort
of creating a growing space with strangers in a new context. By doing so, we believe
that true can successfully and meaningfully transcend the classroom environment.
PG. 22
External Literature & Existing Assessment Outcomes
Overall, we find that the existing “Real Talk” assessment outcomes to be a great
start, with only a few minor critiques from a perspective informed by our external
literature. Outcomes we would like TRUE to revisit are in yellow text. Outcomes we
see no issue with are in green text. Justifications for each classification are below
each goal in white.
We believe that the “Real Talk” segment of TRUE, from a literature informed
standpoint, is a valuable experience for students. It’s assessment outcomes align with
the literature, although there are some facets that deserve consideration. Namely
expanding the positionalities explored, and preparing students for pushback in their
future classrooms. Additionally, we recommend an intentional emphasis on giving
participants a stake in the creation of the TRUE community, it’s expectations, and the
acknowledgment of it’s unique nature. We believe that be doing so, TRUE - and as a
consequence, “Real Talk” will continue to challenge students to grow, innovate, and
face the challenges of the 21st century classroom.
PG. 23