Professional Documents
Culture Documents
for
Graduate Certificate
June 3, 2018
Developed for:
Office of Suicide Prevention
Colorado General Assembly
Anderson-3
Table of Contents
Between 2010 and 2015, there were 5,881 suicides in Colorado. 835, or 14%, of suicides
were committed by children and young adults between the ages of 10 to 24 (Colorado
Suicide Data Dashboard, 2017). The number of suicides continues to rise every year, and in
2015 and 2016, suicide was the leading cause of death among the same age group.
According to a 2013 Healthy Kids Colorado survey, 21.1% seriously considered or actually
attempted suicide, in the 2015 survey, that number rose to 25.3% (Office of Suicide
Prevention, 2017).
The third component of HB 18-1177 expands access to mental health treatment. The
current age of consent for outpatient psychotherapy services, without parent or guardian
notification, is 15 years old. Upon passage of HB 18-1177, the age of consent will be
lowered to 12 years old.
Anderson-5
Numerous stakeholder groups have been identified; those who may be directly or indirectly
affected by the implementation of HB 18-1177, as well as those who will be instrumental in the
execution of the implementation and further management of the enacted legislation. Early
identification of these groups has allowed for relationship building, feedback and input to be
obtained, and increased engagement, support, and “buy in” (D’Angelo, Pullman, and Lyon,
2015) for successful implementation.
The following is a non-exhaustive list of stakeholders for HB 18-1177, Youth Suicide Prevention:
Children and Young Adults (10-24 years of age) living in Colorado
Adults living in Colorado, who are non-mental health professionals and regularly
interact with children and young adults (“Gatekeepers”)
Mental health professionals
Non-profit organizations focused on mental health and suicide awareness and
prevention
Elementary, Middle, and High Schools in Colorado
Digital and Traditional Media Outlets
Graphic design and print services
Office of Suicide Prevention staff
Colorado General Assembly legislators and staff
Office of Vital Statistics
Law enforcement and medical examiners/coroners
Rocky Mountain Crisis Partners staff and volunteers
Colorado Youth Advisory Board
Youth Suicide Prevention Workgroup of the Suicide Prevention Commission
In order to complete the three primary elements of HB 18-1177, several smaller objectives have
been identified. These objectives have clearly defined, measurable outcomes that build upon
each other to ensure thorough, successful implementation and results.
Objective #1: Approve a Youth Suicide Prevention Training Program/Course and Organization to
Administer Program
A number of suicide awareness and prevention training programs currently exist, however none
of them are specifically focused on both youth suicide and with a target participant of
“gatekeepers.” The Office of Suicide Prevention, in collaboration with stakeholders, will develop
an evidence-based program; information from courses designed by Mental Health First Aid,
American Foundation for Suicide Prevention, and Sources of Strength can be included and
modified as needed. The final training program must include measures to ensure longevity,
such as a connecting with a support network, additional resources and ongoing learning
opportunities, and routine follow-up communication (Donald, Dower, and Bush, 2012;
Shtivelband, Aloise-Young, and Chen, 2015).
A single non-profit organization, that operates statewide and specializes in youth mental health
and/or suicide awareness and prevention, will be chosen to conduct the “gatekeeper” training
courses. This organization will receive annual funding to cover staff and expenses related to
course administration (Colorado General Assembly, HB18-1177, 2018). A formal evaluation
process will take place to determine which organization is best suited for implementation.
Organizations will be evaluated based upon their length of history within Colorado, local and
regional affiliations, experience with conducting training classes, willingness to participate in
creation of additional resources and attend stakeholder events, size of staff and volunteers, etc.
Objective #3: Develop Youth-Friendly Website with Suicide Awareness and Prevention
Resources
In Colorado, searching online for help in a crisis or for informational resources regarding mental
health and suicide awareness and prevention yields a variety of sites, but none are tailored
specifically towards youth and young adults. Existing sites are often hard to navigate, or contain
extraneous (though important) information, including research articles and statistics.
Anderson-7
The Colorado Department of Public Health and Environment will coordinate with the Colorado
Youth Advisory Board and the Youth Suicide Prevention Workgroup of the Suicide Prevention
Commission, to develop a youth-friendly, bilingual website (Colorado General Assembly, 2018;
Colorado Legislative Council Staff, 2018). The site should include easy to find and plain-language
information resources, available in text, audio, and video formats. Multiple links to crisis hotline
services, including the chat and text functions, should be highlighted on every page, and
directly integrated when possible.
In order to boost clicks, views, and visits, part of the awareness campaign should be allocated
to website redirects, keyword and search term sponsored links.
Measurable Outcomes: Unique and Repeat Clicks and Views (IP Addresses), calculated monthly
and annually – Time Spent on Site – Resource Views and Downloads
Radio, print media, and television should include advertisements targeted towards
“gatekeepers,” while advertisements targeted to children and young adults should be on digital
and new media platforms, such as pre-play ads on Pandora, Spotify, YouTube or in-game ads on
mobile applications. Paid social media advertisements should also be included in the awareness
campaign plan, with microtargeting to ensure maximum exposure to both “gatekeepers” and
youth target audiences. Additional awareness efforts can come from free media, such as social
media posts crafted for maximum organic engagement, or op-ed articles in local and regional
digital and print newsletters, magazines, or newspapers.
Anderson-8
Measurable Outcomes: Email Opens – Video Views & Shares – Article Views & Shares – Post
Views, Likes, & Shares – Link Clicks – Program Registration – Website Referals
Anderson-9
Evaluation Tools
First, when designing the suicide prevention training programs, the Gatekeeper Behavior
Scale should be utilized to critique possible methods and tools and determine which would
have the greatest impact and longevity, conveying information in the best possible way.
Second, the Gatekeeper Behavior Scale should be utilized in follow-up surveys that
participants in the training program take immediately following the conclusion of the
course, as well as six-month and at least one year after. These follow-up surveys, with
questions sampled from the Gatekeeper Behavior Scale, will help evaluate the longevity of
the training program, which is a crucial measure of its effectiveness (Albright, Davidson,
Goldman, Shockley, and Timmons-Mitchell, 2016; Shtivelband, Aloise-Young, and Chen,
2015; Strunk, King, Vidourek, and Sorter, 2014).
Data Collection
Colorado Violent Death Reporting System
Standardized Suicide Death Investigation Form
The Office of Vital Statistics has collected data on the number of suicides, including
demographics and detailed information related to methodology, etc., over several previous
years. This information will continue to be collected and entered into the system and
dashboard, and can be analyzed and compared, as the implementation of the legislation
progresses, to evaluate its effectiveness. If the legislation has its desired impact, there will be a
significant decrease in the number of suicides of people between ages 10 to 24 years old.
Additionally, the standardized Suicide Death Investigation Form has been introduced to coroner
and medical examiner’s offices, as well as law enforcement agencies, as a way to regulate the
information that is collected regarding suicides and ensure that it is more consistent (Office of
Suicide Prevention, 2017). Promoting the use of this form will help increase the accuracy of the
data that is collected.
information that should be collected as well, some general demographic information and some
of which will be in the form of survey questions (but all will only be asked if appropriate, after
help has been administered and the imminent crisis has been addressed).
How many calls to the hotline?
Where/How did you hear about the hotline?
Have you called the hotline before?
Have you sought help outside the hotline?
Have you utilized any of the suggested resources?
Surveys of general population, grouped by state senate districts, to give regional breakdown
of results and analysis
Smaller than Congressional districts, but larger than state house districts
Surveys of children and young adults, ideally conducted in person (paper or digital) at
schools, grouped by school district
Able to be broken down further, by schools or grade level, for further analysis and
comparison
Representative samples, randomly chosen, and called to participate in the survey – will
need to call several times the number of participants needed, in order to get a large enough
response rate
Survey regarding about public attitudes about mental health and suicide awareness and
prevention (Kohls, Coppens, Hung, Wittevrongel,l Van Audenhove, Koburger, Arensman,
Szekely, Gusmao, and Hergel, 2017)
Responses can be used to help evaluate the public’s response to the awareness
campaign, as well as what informational resources should be highlighted
Anderson-11
All the responses and information received from survey responses will be collected, analyzed,
and circulated in reports by the Office of Suicide Prevention.
Anderson-12
For the purposes of ensuring the program is implemented statewide, training regions will be
divided along the 35 State Senate district boundaries. Each region will have approximately
$1,543 to utilize for the training courses each year, or approximately $130 per month.
Mental Health First Aid Colorado currently offers suicide prevention and mental health
awareness courses, similar to what this legislation requires. Most courses are provided free of
cost to participants, but of the course options that require a payment, fees range from $5 to
$20 per person. These fees cover the cost of the workbook, and often go towards lunch, snacks,
or beverages during the training session (Mental Health First Aid Colorado, 2018).
The training program course provided through the non-profit chosen for H.B. 18-1177 will offer
a break for participants to bring their own meals/snacks and/or the opportunity for them to
retrieve their own lunch, allowing those funds to be redirected to cover the cost of materials
and staff.
If each training region offered at least two courses per month, and each course had at least 13
participants, the cost per participant would be approximately $.63 per hour. For larger course
sizes, up to a maximum of 30 participants, the cost per participant would be approximately $.27
per hour.
The funding allocated does not provide much coverage in the way of covering materials, travel,
and wages for training staff. One the schedule has been determined, and quotes are received
from local union printing organizations for course materials, additional funding from private
sector organizations or grants, will need to be obtained, in order to subsidize the operational
costs.
Anderson-13
During the 2015-2016 fiscal year, according to their annual report, Rocky Mountain Crisis
Partners had $3,021,692 in program expenses. According to the most recent fiscal note, RMCP
has an annual budget of $2.2 million for their 54 current staff members and the services they
provide (Colorado Legislative Council Staff, 2018).
The fiscal note states that, in order to expand the text-based services of the crisis hotline, both
text and chat functions, an additional 7 staff members must be hired, and allocates an
additional $400,000 in funding to cover their salaries and expenses (Colorado Legislative
Council Staff, 2018).
Based off the 2016 annual report figures, it cost approximately $25 per crisis line interaction
(including follow-ups), and each staff member handled approximately 2,250 interactions.
90,000 calls, texts, and chats, 35% (31,500) had scheduled follow ups (121,500 total estimated
interactions) (Rocky Mountain Crisis Partners, 2017).
With the allocated funding for text-based service expansion, an additional 16,000 interactions
(approximately) will be covered, at current cost levels. ($25 per interaction). Since text-based
interactions may not be as critical, last as long, be as in-depth, or require as much additional
follow-up, estimates for price per interaction can be lowered by one third to one half. Based on
those estimated cost-levels, the text-based funding allocation can cover between an additional
23,880 interactions (one-third lower, $16.75 per interaction) and an additional 32,000
interactions (one-half less, $12.50 per interaction). The 7 new hires, dedicated staff to the text-
based services (Colorado Legislative Council Staff, 2018), will handle an estimated 2,286-4,571
interactions per person annually.
After speaking with Josh Larson, the Clinical Operations & Quality Assurance Specialist for Rocky
Mountain Crisis Partners, by phone, additional information was obtained. In 2016, a total of
147,404 contacts were handled by the state-funded crisis line, text, and chat services, and in
2017, that number increased to 170,558 contacts. Those numbers represent both incoming and
outgoing interactions. RMCP expects the number of contacts in 2018 to increase as well.
Based on those statistics, the price per interaction significantly decreased, to approximately $17
in 2016 and $15 in 2017. In an immediate crisis, or for short-term assistance, the cost per
interaction is significantly lower than outpatient or inpatient treatment, and substantially lower
than the cost of an emergency room visit (National Institutes of Health, 2017). Utilizing the
crisis hotline services, either voice or text-based, should not be a replacement for long-term
mental health treatment services.
Anderson-14
A similar website, with the goal of decreasing the number of suicides among working age men,
www.mantherapy.org, did provide such information to the Colorado Office of Suicide
Prevention Annual Report. During the 2016-2017 fiscal year, there were 12,052 visitors to the
site from Colorado, and site visits averaged approximately 3.5 minutes (Office of Suicide
Prevention, 2017).
With $25,000 allocated for the creation of the website, and an annual maintenance and upkeep
budget of $3,000 (Colorado Legislative Council Staff, 2018), it is possible to approximate the
cost per visit and cost per minute on site. If the youth-friendly website required by the
legislation receives an average of, 15,000 to 20,000 visits per year, it would cost $1.25 to $1.67
per visit in the first year, and $.15 to $.20 per visit the following year. If visitors spend an
average of 3 to 5 minutes on the site, that would equal approximately 45,000 to 100,000
minutes spent on the site, with an estimated cost of $.25 to $.56 per minute in the first year,
and $.03 to $.07 per minute the following year.
Anderson-15
Looking Forward
Like all public policies and legislation, frequent evaluation and adjustments will be necessary for
long-term success. Continuation of the preventative elements that comprise HB 18-1177
requires proven impact and positive change, which will also improve the odds for sustained
funding.
During the initial phase of the implementation, funds have been allocated through government
resources, primarily the General Fund, but not every objective can be met within the funds
provided (Colorado Legislative Council Staff, 2018). Outside resources will have to be utilized,
such as applying for grants from federal government and private benefactors, to cover the
remaining expenditures.
If the implementation the prescribed programs and objectives are successful, and there is a
measured decrease in the instances of suicide attempts and suicide among children and young
adults in Colorado, this legislation and its execution could serve as an example and/or pilot for
similar legislation in other states or even at a federal level. Successful implementation tactics
could also be applied to other suicide prevention initiatives for other demographic groups.
Anderson-16
References
Albright, Glenn L., Jesse Davidson, Ron Goldman, Kristen M. Shockley, and Jane Timmons-
Mitchell. 2016. "Development and Validation of the Gatekeeper Behavior Scale." Crisis: The
Journal of Crisis Intervention and Suicide Prevention, 37(4), 271-80. doi:10.1027/0227-
5910/a000382.
Calear, Alison L., Philip J. Batterham, and Helen Christensen. 2014. "Predictors of Help-seeking
for Suicidal Ideation in the Community: Risks and Opportunities for Public Suicide Prevention
Campaigns." Psychiatry Research, 219(3), 525-30. doi:10.1016/j.psychres.2014.06.027.
Colorado Department of Public Health & Environment. Office of Suicide Prevention. Office of
Suicide Prevention Annual Report 2016-2017.2017.
https://www.colorado.gov/pacific/sites/default/files/PW_ISVP_OSP-2016-2017-Legislative-
Report.pdf.
D’Angelo, Gabrielle, Michael D. Pullmann, and Aaron R. Lyon. 2015. "Community Engagement
Strategies for Implementation of a Policy Supporting Evidence-Based Practices: A Case Study of
Washington State." Administration and Policy in Mental Health and Mental Health Services
Research, 44(1), 6-15. doi:10.1007/s10488-015-0664-7.
Donald, Maria, Jo Dower, and Robert Bush. 2012. "Evaluation of a Suicide Prevention Training
Program for Mental Health Services Staff." Community Mental Health Journal, 49(1), 86-94.
doi:10.1007/s10597-012-9489-y.
Denchev, Peter, Jane L. Pearson, Michael H. Allen, Cynthia A. Claassen, Glenn W. Currier,
Douglas F. Zatzick, and Michael Schoenbaum. "Modeling the Cost-Effectiveness of Interventions
to Reduce Suicide Risk Among Hospital Emergency Department Patients." Psychiatric Services.
January 2018. doi:10.1176/appi.ps.201600351.
Anderson-17
"Four Years Later: An Update on Colorado Crisis Services." Colorado Health Institute. July 19,
2016. https://www.coloradohealthinstitute.org/blog/four-years-later-update-colorado-crisis-
services.
Howie, Erin K., and E. Doyle Stevick. (2014). "The “Ins” and “Outs” of Physical Activity Policy
Implementation: Inadequate Capacity, Inappropriate Outcome Measures, and Insufficient
Funds." Journal of School Health, 84(9), 581-85. doi:10.1111/josh.12182.
Kohls, Elisabeth, Evelien Coppens, Juliane Hug, Eline Wittevrongel, Chantal Van Audenhove,
Nicole Koburger, Ella Arensman, András Székely, Ricardo Gusmão, and Ulrich Hegerl. "Public
Attitudes toward Depression and Help-seeking: Impact of the OSPI-Europe Depression
Awareness Campaign in Four European Regions." Journal of Affective Disorders, August 2017,
252-59. doi:10.1016/j.jad.2017.04.006.
National Institutes of Health. "Life-saving Post-ER Suicide Prevention Strategies Are Cost
Effective." News release, September 15, 2017. https://www.nih.gov/news-events/news-
releases/life-saving-post-er-suicide-prevention-strategies-are-cost-effective.
Ramchand, Rajeev, Lisa H. Jaycox, and Patricia A. Ebener. "Suicide Prevention Hotlines in
California: Diversity in Services, Structure, and Organization and the Potential Challenges
Ahead." 2016.
https://www.rand.org/content/dam/rand/pubs/research_reports/RR1400/RR1497/RAND_RR1
497.pdf.
Shtivelband, Annette, Patricia A. Aloise-Young, and Peter Y. Chen. 2015. "Sustaining the effects
of gatekeeper suicide prevention training: A qualitative study." Crisis: The Journal Of Crisis
Intervention And Suicide Prevention, 36(2), 102-
109. http://dx.doi.org.du.idm.oclc.org/10.1027/0227-5910/a000304
Strunk, Catherine M., Keith A. King, Rebecca A. Vidourek, and Michael T. Sorter. 2014.
"Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness
Program." Health Education & Behavior, 41(6), 605-13. doi:10.1177/1090198114531774.