Professional Documents
Culture Documents
Bicycle Safety Final Programevaluation 1
Bicycle Safety Final Programevaluation 1
Prepared by:
Through the use of the Second Annual Run Like a Mother 5K Run/Walk, the
presentation of the Bicycle Safety Public Service Announcement (PSA) and Zine will be
administered to the attendees, California State University San Bernardino (CSUSB) college
students, staff, faculty, and community members. The purpose of this evaluation is to determine
the existing bicycle rider population on the CSUSB campus, determine the current
implementation of bicycle safety techniques, and measure the effectiveness of the Bicycle Safety
PSA and Zine. The findings from this evaluation will be used to examine what changes,
modifications, and areas of improvement can be implemented to enhance the bicycle riding
experience on the CSUSB campus and showcase bicycle safety measures to the college
demographic. As a result, the necessary adjustments to the bicycle safety program can be
identified to ensure relevant bicycle safety information is reaching the target audience to promote
As a primary goal of the CSUSB Student Health Center, good health among students as
they pursue academic and professional success is promoted among most of its programs. This
evaluation is well-suited to that goal as a means of ensuring CSUSB students, faculty, and staff
employ bicycle safety techniques as a means to prevent harm or injury to themselves or their
peers.
Stakeholders
The outcomes of this evaluation would be of particular interest to the Second Annual Run
Like a Mother 5K attendees; CSUSB students, faculty, and staff; and the CSUSB Student Health
Center. Stakeholders are ultimately interested in promoting a bicycle usage and bicycle safety
culture on the CSUSB campus. Currently, not many students ride bicycles to or on campus, and
many use their cars to move from one parking lot to another. Our stakeholders would like to see
an increase in bicycle participation, helmet usage across campus, and implementation of proper
bicycle safety techniques. As stakeholders of the bicycle safety program, this evaluation plan
serves as a means to arm interested individuals with the results of the program. This information
is needed to affect positive change on the CSUSB campus with raising awareness and
Cultural Competence
evaluations findings, it is important to offer alternatives beyond traditional bicycle riding such
as tandem or handicap bicycles. Additionally, the bicycle safety program would explore the
options of bicycle or bicycle safety equipment rentals or loans to provide all individuals with the
opportunity to explore the realm of bicycle riding. The incorporation of participant suggestions
or perspectives of the PSA and Zine as well as other available alternatives to promote bicycle
safety through post-test questionnaires and feedback ensures those with a vested interest bicycle
safety are provided with the opportunity to share their opinion. In order to account for the
influence of context and culture in evaluation design, implementation, and reporting, the
program will focus on employing bicycle safety techniques for the general population. The
proper resources would need to be available and applicable to all such as producing the PSA or
Need
In an effort to promote bicycle safety techniques as a means to avoid bodily injury while
riding a bicycle on or around CSUSB campus, there is a need to launch a bicycle safety literacy
campaign through the use of a PSA and Zine. These products will be administered to Run Like a
Mother 5K attendees; CSUSB students, faculty, and staff; and community members.
Context
The bicycle safety programs objective is to raise awareness of the risk of riding a bicycle
without safety equipment, proper street riding information, and how to access resources found on
campus. The factors that may affect this program would include: limited participation by active
or beginner bicycle users not in attendance at the Run Like a Mother 5k Walk/Run. As such,
those individuals would not have access to PSA or Zine. Additionally, time constraints may be a
factor as to why some bicyclists may choose not to wear proper safety equipment or employing
proper bicycle safety techniques. A lack of access to bicycle safety equipment such as helmets
Population Addressed
The activities of presenting the Bicycle Safety PSA and disseminating the Zine are
intended for the Run Like a Mother 5K Walk/Run attendees; CSUSB students, staff, and faculty;
community members; and first time bicyclists. CSUSB students will be knowledgeable of
bicycle safety techniques, resources, bicycle riding laws and information, and program offered
on campus. By addressing the community members we can embrace the concept of bicycle
Stage of Development
The bicycle safety program started its planning stage during Winter 2017 quarter among
Master of Public Health (MPH) graduate students in coordination with the CSUSB Student
Health Center. Over the past six months, since the beginning of Spring 2017 quarter, the
program has been refined and is ready for implementation. The presentation of the Bicycle
Safety PSA and Zine at the Run Like a Mother 5K Walk/Run marks the start of implementation
Resources/Inputs
In order to support the program, various resources are necessary. The maintenance of the
program and facilitators of the program message is under the responsibility of the staff,
Additionally, a partnership with the CSUSB Student Health Center is a necessary resource to
ensure program cohesion with the health center goals. The dissemination of this programs
products requires a routine venue, such as at the CSUSB Student Health Center or the annual
Run Like a Mother 5K Walk/Run to ensure timely dissemination of information and safety tips.
With products such as the PSA and Zine, computers are needed for editing both products and
Activities
In an effort to achieve the programs outcome, the CSUSB Student Health Center is
expected to establish a bicycle loan program with associated safety equipment available for rent
or loan. As such, student access to proper safety equipment should not be a barrier to practicing
bicycle safety techniques. Additionally, individuals are being provided with a PSA, handouts,
Outputs
Through the establishment of a bicycle loan program, each CSUSB member can have
access to a bicycle. The addition of on-site equipment encourages student participation to not
only utilize the services, but also employ the proper bicycle safety techniques as a member of the
Outcomes
Through the bicycle safety program, the intended outcomes are to: implement an increase
in bicycle usage and culture on campus, increase helmet use among students, establish a bicycle
loan program, and employ free helmet rentals. By allowing free pick-up and access, all students
will benefit from safely riding bicycles on campus. Various dangers and injuries can be averted
with proper bicycle safety techniques understood and utilized while riding bicycles. The CSUSB
CSUSB bicyclists
Bicyclists will utilize
will be employing
Employing bicycle learned bicycle safety
CSUSB Bicyclists proper hand signals
riding workshop riding techniques
and helmet wear by
while riding
2025.
CSUSB Bicyclists
will employ learned
Zine and PSA
Decreased number of
information
bicycle related events
CSUSB Student Disseminating Zine encompassing proper
reported annually
Health Center and advertise PSA helmet use, hand
from bicycle safety
signals, bicycle
infractions.
reflection, routine
maintenance, and
bicycle security
Individuals will
spread the word and Students will be well-
5K Attendees Information recipients implement bicycle informed regarding
safety techniques if the rules of the road
bicycle riders
Evaluation Design
Stakeholder Needs
The CSUSB Health Center, Bicycle Safety Campaign team members, and the target
audience (bicyclists, CSUSB students, staff, faculty, and Run Like a Mother 5K Walk/Run
participants) will use the evaluation findings as a means to recognize, understand, and implement
bicycle safety techniques. From this evaluation, stakeholders need to learn how the bicycle
riding culture can be beneficial and enjoyable to ones health. The objective is to increase
equipment rentals, storage areas, and community resources. The audience will learn how lack of
helmet use can result in severe body and head injuries. There is a need for this bicycle safety
As such, the intended users will rely upon credible information through systematic
observation, statistics and data collected, as well as information stated from credible sources
such as CDC. The findings will be used to engage our stakeholders and promote bicycle safety
awareness from the Student Health Centers and CSUSB Recreation and Wellness Center. In
addition, the findings will be used to encourage bicycle usage among CSUSB students and
community members for both recreation and transportation, while improving the current program
methods and material for the target population. In an effort to engage stakeholders throughout
the evaluation, data on the perceptions of bicycle riding safety protocols such as: helmet use (or
lack of) while riding, bicycle riding around CSUSB campus/community, and road rules for
bicycle riders needs to be collected. Gathering data on how many bicycle related bodily injuries
reported in the community will be useful in justifying the necessity for this program. Advocating
for free resources such as more bicycle racks, free bicycle rentals, and equipment rentals (such as
locks, helmets, or reflective gear) is a method of eliminating access barriers for individuals while
Evaluation Questions
1. Did the program increase bicycle safety awareness (evidence by post survey
questionnaire)?
2. To what extent were all the activities carried out (presentation of PSA and distribution of
Zine)?
3. Did participants intend to utilize resources by checking out program activities and
4. Can the designed program be applied in an outside setting (e.g., different campuses,
Evaluation Design
The design for this evaluation is pre-post test with a comparison group of individuals not
present for the PSA presentation or Zine distribution. The rationale for using this design is that
we are observing our target populations knowledge before and after intervention activities. We
will compare the effectiveness of our campaign by assessing Run Like a Mother 5K Walk/Run
participants thoughts and views on bicycle safety through post questionnaire with individuals
not present to receive our PSA presentation and Zine distribution. We are focusing on the
willingness of the target audience to engage in behavior change with the intent for audience
members to become aware of potential injuries associated with no helmet use while increasing
techniques.
New data will be collected to answer the evaluation questions in order to accurately
determine how effective the bicycle safety program among participants. Methods used to collect
data for the bicycle safety program would include: observational data by observing participant
behaviors before watching the PSA and reading the Zine. We will observe the current behaviors
of the control group (individuals not present during the bicycle safety PSA presentation and Zine
distribution) and the behaviors this population engages in once they receive information on
bicycle safety measures and proper ways to wear a helmet. A focus group is another way we
plan to collect data by having a group of individuals who currently own a bicycle, but not a
helmet, and for those that own a helmet and a bicycle, but do not wear a helmet. We can observe
the effectiveness of our PSA and Zine in the two focus groups as well as determine how
knowledgeable this population is about bicycling and their susceptibility to head injuries or
accidents for engaging in current behaviors. Lastly, data will be collected through a pre-post test
to identify why participants perceive helmet use as negative, reasons for engaging in current
behaviors, health literacy rate on bicycle safety importance, and reasons preventing participants
from riding a bicycle, purchasing safety equipment, or wearing a helmet. Some of these reasons
may include: not knowing how to properly wear a helmet, lack of resources, stigma and peer
influence, environmental reasons, and not knowing how to properly lock a bicycle.
The sample population will encompass participants in attendance at the CSUSB Run Like
a Mother 5K Walk/Run. We will select participants who respond well to the PSA and Zine
distribution and those participants who have completed the pre-test survey via email prior to the
event or via hardcopy within the first hour of the event. We will create our data collection
instruments through the use of a Microsoft Word document to create a survey. The pre-post test
data results will be distributed via email. At the 2nd Annual Run Like a Mother 5K Walk/Run,
we will collect each participant's first and last name, and email. In an effort to ensure reliability
and validity, we will conduct a pre-test of our bicycle safety program before collecting data for
our intended population. A pre-test survey will be given via email to current undergraduate and
graduate health science students as well as via hardcopy during the first hour of the event. Any
pre-test surveys not returned to the bicycle safety campaign team members (via email or directly)
prior to the PSA presentation will not be included in any results. The PSA and Zine will be
presented and distributed to the audience during the event, immediately followed-by a post-test
Additionally, existing data will be included with methods in place to determine its quality
and relevance for this campaign. Researching peer-reviewed articles published with the past
seven years from the various databases within the CSUSB library will ensure timely information
is presented. When determining the quality of the data we will analyze the key components
within a study that include terms: bicycle/bicycle safety, college students, helmet use, stigma,
prevention, promotion, and community-based intervention. We will also consider the limitations
and weakness of the existing data collected. New data collected will be gathered from CSUSB
students, CSUSB Student Health Center, and participants from the 2nd Annual Run Like a
Mother 5K Walk/Run.
To what extent were all the activities CSUSB students and Run
Collection of participant contact
carried out (presentations and Like a Mother 5K Walk/Run
information
distribution of zines)? participants
Based on the collected data from the pre-post test, we are able to measure the bicycle
safety comprehension differences of those participants who received the PSA and Zine as
compared to those who did not. We are also able to conduct an evaluation of what equipment
has already been rented out since the PSA and Zine presentation. As such, success within this
program can be defined as distributing and collecting pre-post test data from at least half of the
participants attending the Run Like a Mother 5K Walk/Run event. The ultimate goal is to see an
increase in implementation of bicycle safety measures and increased bicycle usage with proper
Standards
Evaluation Question Criteria or Indicator (What Constitutes
Success?)
Did the target audience find the More people seen using
50% participant completion
bicycle safety campaign safety equipment and lower
of post-survey test
informative? rate of injuries.
Analysis
analysis to analyze our data. These methods will come directly from the information gathered
with the pre-post tests. Descriptive statistics will summarize the data collected from the sample
population and will allow us to see common patterns and answers. Inferential statistics can then
be used to presume the thoughts, behaviors, and attitudes the CSUSB community currently
holds. Qualitative analysis will be used to examine the associations between the different
behavioral variables that are being examined in terms of bicycle safety and usage. This approach
Interpretation
Those involved in drawing, interpreting, and justifying conclusions include: the bicycle
safety campaign members (Caress Baltimore, Janelle Bayona, Brailyn Bray, and Anthony
Olivar), Dr. Verissimo, as well as faculty from the Health Sciences Department and the Student
Health Center. These parties must all work together to formally implement a bicycle safety
campaign on campus. Including these individuals within the process begins with the bicycle
safety campaign members gathering information from the pre-post tests and presenting the data
to the parties listed above through a series of meetings and focus groups. With the insight of all
parties involved, this will help to make any necessary adjustments to ensure a fluid, transferable,
Use
Evaluation findings will be used to interpret the needs and attitudes of the target
population and will be used by the bicycle safety campaign members (Caress Baltimore, Janelle
Bayona, Brailyn Bray, and Anthony Olivar), Dr. Verissimo, as well as faculty from the Health
Sciences Department and the Student Health Center. These findings will allow for any necessary
adjustments for a fluid program plan and successful bicycle safety campaign across the CSUSB
campus. The Run Like a Mother 5K Walk/Run event will take place on October 21, 2017.
Findings and data will be determined and analyzed throughout the remainder of the Fall 2017
quarter. Meetings and focus groups will likely take place during the Winter 2018 quarter, and
Ultimately, the bicycle safety campaign members (Caress Baltimore, Janelle Bayona,
Brailyn Bray, and Anthony Olivar) will primarily be responsible for creating and monitoring an
action plan to guide the implementation of evaluation recommendations. Any program follow-
up will be conducted with Dr. Verissimo and other CSUSB Health Science faculty, as well as the
Student Health Center. These individuals will ensure the program promotes bicycle safety and
improves the bicycle culture. The lessons learned include information taken from the pre-post
tests, meetings with stakeholders, and focus groups. The information gathered will be
Communication
Communication with Dr. Verissimo and other Department of Health Science faculty will
occur primarily to provide evaluation status updates. Meetings will be held with the Student
Health Center and share our findings to assist with maintaining the program and making any
campus. The methods of communication with stakeholders will include a series of in-person
meetings, and online communication through Slack or Blackboard. These methods are
appropriate for the specific evaluation stakeholder audience because they are all on-campus
faculty. Communication through a variety of approaches provides meeting time and location
flexibility. Having multiple communication platforms also provides convenience for all involved
parties.
Evaluation Management
Evaluation Team
Caress Baltimore, Janelle Bayona, Brailyn Bray, and Anthony Olivar will manage and
implement this evaluation. Our stakeholders will also be involved in this process. In order to
and appropriate follow-up protocols are needed. Throughout the evaluation process, the bicycle
safety campaign members will be able to refine and sculpt an effective bicycle safety
intervention program. External reviewers include Dr. Verissimo and Dr. Becerra who will assist
in refining the planned actions provide insight and recommendations for program adjustments.
Dr. Verissimo and Dr. Becerra External Reviewer Review evaluation plan
Data collected will focus on: increased bicycle safety awareness, percentage of activities
carried out, utilization of resources, and program implementation in an external setting. In order
to ensure data collection is carried out successfully, pre-post test drafts should be finalized no
later than one month prior to the event and printed prior to the event. Also prior to the event,
Zine copies need to be printed and properly folded for distribution to the target audience. During
the Run Like a Mother 5K Walk/Run, tables and tents are needed to ensure there is a primary
location to obtain any resources. A projector screen is needed to show PSA. Designated
individuals are needed to corral participants. Each of these activities should be assigned to
designated group members at least one month prior to the event. Each of the bicycle safety
campaign members will have an assigned task that will be determined at the beginning of the
Fall 2017 quarter. Other MPH students and volunteers are also responsible for conducting each
activity while the CSUSB Student Health Center will oversee the conduct and evaluation to
Data
Activities Person(s)
Evaluation Question Collection Due Date
Needed Responsible
Method
Distribution of
Did the program increase post-test
Post-test survey MPH Students 12/4/2017
bicycle safety awareness?
Data analysis
Solicit participant
To what extent were all Collection of information
the activities carried out participant
MPH Students 12/4/2017
(presentations and contact PSA presentation
distribution of zines)? information and Zine
distribution
MPH Students
Can the designed program Distribution of
be applied in an outside post-test CSUSB Student
setting (e.g., different Recreation
Post-test survey 6/16/2018
campuses, community Data analysis Center
parks, and gated
communities)? Provide resources CSUSB Student
Health Center
The security of the data will be ensured by having emailed pre-test surveys sent to one
bicycle safety campaign members email inbox and later organized into a shared, password-
protected document. Additionally, at least one bicycle safety campaign member will oversee the
collection of pre-post test during the Run Like a Mother 5K Walk/Run event. All data collected
will be maintained in one members possession for the duration of the program. In order to
analyze the data, pre-post test information will be analyzed by the end of Fall 2017 quarter. An
excel spreadsheet will be utilized to catalog response types and perform basic mathematical
functions, as performed by the members of the bicycle safety campaign. Stakeholders will be
engaged in confirming analysis results and interpreting through a series of in-person meetings
and emails throughout the process. Once results have been finalized, the findings will be
Data to Be Person(s)
Analysis to Be Performed Due Date
Analyzed Responsible
MPH Students
Inferential Statistics Post-Test 4/23/2018
CSUSB Student
Health Center
Post-Test
Throughout this program evaluation, progress and findings will be reported to the
Department of Health Sciences faculty, to include Dr. Verissimo, Dr. Becerra, and Dr. Tamalis,
as well as the CSUSB Student Health Center. Each of these individuals have a vested interest in
the progression of the Bicycle Safety Program, and as such, keeping these parties aware of the
progress provides situational awareness. Also, the opportunity to gather insight or receive
feedback about the programs progress allows for any future program adaptations to be
integrated into the existing program. For this purpose, the most appropriate communication
methods will include emails, phone calls, web conferences, and in-person meetings for the
duration of the program evaluation from Spring 2017 quarter to Spring 2018 quarter. Any
additional meetings beyond the program evaluation period will occur on an as-needed basis.
Timeline
All planning and administrative tasks will occur throughout the evaluation process during
the Spring and Fall 2017 quarters. In an effort to provide unbiased data collection, data
collectors will undergo training for appropriate data collection methods one month prior to the
Run Like a Mother 5K Walk/Run event. This timeline ensures any contingency plans can be
activated in the event of unforeseen circumstances. In order pilot test data collection
instruments, pre-post test survey drafts and log spreadsheets will be evaluated two weeks prior to
the event. Formal data collection will begin with the pre-test emailed to individuals one week
prior to the Run Like a Mother Walk/Run event and in-person formal data collection will occur
at the event on October 21, 2017. Analysis and interpretation will be conducted during the
remainder of the Fall 2017 quarter until Spring 2018 quarter. As information is evaluated,
information dissemination tasks will occur at the start of the Winter 2018 quarter. With data
routinely evaluated and frequent progress checks established with stakeholders, there are not any
foreseen bottleneck or sequencing issues. Some deadlines may need to be slightly extended and
Wrapping Up
opportunity to acknowledge the contributions of planning team members and others who
contributed to the successful evaluation of the program plan through recognition in the
newsletter, a campus-wide email, and social media platforms. Certificates will also be handed
out to those involved. Of course, understanding the strengths and weaknesses of this process
goes a long way to identifying areas requiring more attention in the future. Evaluation lessons
learned in the course of implementing the evaluation will be documented on Blackboard and
email. The information will remain accessible as all relevant documents, instruments, and data