LEARNING TOGETHER AND THE

STUDENT EXPERIENCE:
Institutions Embracing Data to Help More
Students Start, Stay & Finish Strong

Mark David Milliron

CIVITAS LEARNING® COPYRIGHT © 2018 mark.milliron@civitaslearning.com
 ISSUES DRIVING CHANGE
• Success Indicators
✓ Completion, on-time completion, transfer,
equity gaps, STEM, career success, thriving

• Enrollment
• Affordability
• Initiative Fatigue
• Resource Optimization
• Personalization
 DATA IMPACT MATRIX
A THEORY OF WORK

INTELLECTUALLY STUDENT
CURIOUS SUCCESS
SCIENTISTS
Late Signal Strong Signal
INSIGHT

STATUS QUO BEST PRACTICISM

No/Wrong Signal Weak Signal

ACTION
 THE OPPORTUNITY FOR GREATER IMPACT
ONBOARDING GET ON PATH STAY ON PATH
Successful Transition from Developing an Educational Ongoing Ed Plan and
Admission to Enrollment Plan for Success Retention Management

STUDENT JOURNEY

Up to 40% 42% 16%

of students fail to enroll of students are leaving of students leave with enough
within their first 3 terms credits, but no credential

Average excess credits

27 earned without clear
path progression

$$$ Tuition revenue lost

due to attrition

$16K Average additional

debt for every year
at a two-year college
CIVITAS LEARNING® COPYRIGHT © 2018 CCA, Time is the Enemy | Harvard University, SDP Summer Melt | CCRC, Early Momentum Metrics
 CIVITAS LEARNING – DATA TO POWER OUTCOMES

40% OF ACTIVE U.S. STUDENTS

7MENROLLED
20M 200M ~2K
STUDENT
COURSE PREDICTIVE
ENROLLMENTS MODELS
STUDENTS RECORDS

CIVITAS LEARNING® COPYRIGHT © 2018

 STRATEGIES TO ACHIEVE OUTCOMES
Student Inquiry Persistence & Graduation Career

MILESTONE
DECISIONS SCHEDULE CAREERS
MAJORS
COURSES
SECTIONS

PRECISION
OUTCOMES
• ENROLLMENT
• EQUITY
• PERSISTENCE
• COMPLETION
OPPORTUNITIES • WORKFORCE
TO ENGAGE & COURSE • PLACEMENT

SUPPORT SUCCESS ENCOURAGEMENT

COACHING
RESOURCES &
PROGRAMS
MINDSET
NUDGING
POLICY
EVALUATION
 BRINGING THE WORK TOGETHER

Personalized Precision
Pathways Engagement

Student Success
Intelligence Platform

CIVITAS LEARNING® COPYRIGHT

Civitas Learning® © 2018©2018
Copyright
 PERSONALIZED INSIGHTS DRIVE ACTION
ACROSS THE STUDENT LIFECYCLE

PERSONALIZED PATHWAYS O U T C O M E S PRECISION ENGAGEMENT

TIMELY, RELEVANT INSIGHTS – EMERGING TRENDS, STUDENT-LEVEL SCORES

SIGNAL
INTELLIGENCE

INSTITUTION-SPECIFIC APPROACH – 2000+ PREDICTIVE MODELS IN PRODUCTION

PREDICTIVE
MODELS

DEPTH OF DATA – 95% OF PREDICTIVE POWER COMES FROM DERIVATIVES

ENGAGEMENT ACADEMIC LIFE & LOGISTICS
● LMS activity streak ● Modality features ● Degree program alignment scores
● LMS relative-to-section average ● GPA consistency ● Credits withdrawal patterns
● Terms attempted/completed ratio ● Financial aid change variables
DERIVATIVES

BREADTH OF DATA – CROSS-SYSTEM & CROSS-INITIATIVE

CIVITAS
DATALEARNING® COPYRIGHT © 2017 | CONFIDENTIAL
SIS LMS FINANCIAL AID CRM ADMISSIONS TUTORING
 BRINGING THE WORK TOGETHER

Personalized Precision
Pathways Engagement

Student Success
Intelligence Platform

CIVITAS LEARNING® COPYRIGHT

Civitas Learning® © 2018©2018
Copyright
CIVITAS LEARNING® COPYRIGHT
Civitas Learning® © 2018©2018
Copyright
 OVERVIEW: ILLUME COURSES

Exemplar Signals across the Civitas:

YELLOW FLAG SIGNAL

Course where even students with a C who persist may be at risk of not graduating.

CHALLENGE SIGNAL (GATEKEEPER/GATEWAY)

A significantly above average percentage of students earn Ds, Fs or withdraw and
have a lower likelihood of graduating compared to students who earn As, Bs or Cs.

QUALIFIER SIGNAL
Only an A improves a student’s likelihood of graduating, where typically an A, B or C all
improve graduation likelihood. In addition, students who earn a B are at least 15% less
likely to graduate than those who earn an A.

LATE HURDLE SIGNAL

Students most commonly take this course three or more years into their career,
and student performance is significantly more predictive than other courses
taken in the same year.
17
CIVITAS LEARNING® COPYRIGHT
Civitas Learning® © 2018©2018
Copyright
 OVERVIEW: GRADE SIGNALS GRADE SIGNALS

YELLOW FLAG SIGNAL

Students who earn “C” in an early term courses tend to persist but not
graduate when compared to other courses taken in the same year.

In this English Composition

and Rhetoric Course,
students that receive a C are
94.4% likely to persist, but
are only 52% likely to
graduate, compared to an
average graduation rate
of 70%.

The graduation rate of

students with a grade better
than a C is 80%.
CIVITAS LEARNING® COPYRIGHT
Civitas Learning® © 2018©2018
Copyright
Civitas Learning® Copyright ©2018
Civitas Learning® Copyright ©2018
Civitas Learning® Copyright ©2018
 IMPACT ON STUDENT OUTCOMES

11.1 percentage
points

PERSISTENCE
on average and up to

19.0 percentage
points
with most challenged

7.62
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
 COLLEGE SCHEDULER IMPACT ON PERSISTENCE

+ 4.1pp + 4.8pp
AVERAGE FOR
SPRING 15-16 TERMS AVERAGE FOR
FALL 15-16 TERMS
1.7pp
+
AVERAGE FOR

+ 2.4pp
AVERAGE FOR
SPRING 15-16 TERMS

FALL 15-16 TERMS

+512 3X
+120
ADDITIONAL +745 GREATER
STUDENTS ADDITIONAL
ADDITIONAL FOR STEM
STUDENTS STUDENTS
STUDENTS

CIVITAS LEARNING® COPYRIGHT

Civitas Learning® © 2018©2018
Copyright
 20% increase
in retention

53% more degrees

& credentials awarded

35% more graduates

CIVITAS LEARNING® COPYRIGHT © 2017

 BRINGING THE WORK TOGETHER

Personalized Precision
Pathways Engagement

Student Success
Intelligence Platform

CIVITAS LEARNING® COPYRIGHT © 2018

CIVITAS LEARNING® COPYRIGHT © 2018
 COMMUNITY INSIGHT 2
GAINING DEEPER UNDERSTANDING OF HIGH GPA DEPARTURES

98% of institutions in
this study are losing
more students above
2.0 GPA than below it.

This benchmark is based on a data set

of 4 million students from 62 institutions.

CIVITAS LEARNING® COPYRIGHT © 2018

CIVITAS LEARNING® COPYRIGHT © 2018
 CAMPAIGN: HIGH GPA, LOW-MODERATE
PERSISTENCE
Outreach Goal
• Come to advising, persistence
Students Targeted
• Undergraduate, GPA 3.0-4.0 w/
low persistence likelihood
Outreach Owner
• Illume Working Group pulls
student list, creates case for
advisors
Strategy
• Sent before spring midterms
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
Sample Email: We’re Proud of You!
Hi <student first name>,
I wanted to send you a note to see how your
semester is going. College can be challenging
this time of year and even the most successful
students can struggle. Common challenges for
students include job commitments, family
responsibilities, financial pressures,
transportation issues, or a combination of these
and other issues. Do any of these sound familiar
to you?
If you are experiencing any of these issues, or
other things, I am here to help!
I am proud of your progress and excited to
support your continued success.
Sincerely,
<Advisor Name>
 CAMPAIGN: NEAR-COMPLETERS & THE FINISH LINE
Outreach Goal
• Catalyze completion among
students more than 75% of way
Students Targeted
• Students who had accumulated 75%
of credits on ANY degree path,
segmented by persistence
likelihood
Outreach Owner
• Student success team
Strategy
• Identify optimal student group,
segment outreach by persistence
quartile – top/email, middle/calls,
lowest/face to face

CIVITAS LEARNING® COPYRIGHT © 2018

CIVITAS LEARNING® COPYRIGHT © 2018
 31% increase in
graduates in one
year

38% increase in
credentials
awarded

CIVITAS LEARNING® COPYRIGHT © 2017 | CONFIDENTIAL

 COMMUNITY
INSIGHTS
REPORT
ISSUE 4

FOCUSING ON THE FINISH LINE

COMING SOON
CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT © 2018
 COMMUNITY INSIGHT 1
ONE-MORE COURSE INSIGHT
Persistence may be increased with
increased course load for some students.
• One more course
Largest increase (14.91 pp) for community
college students taking one course per
term versus two

• Continued, but declining, value

with each increase
Adding even one more course will not
be a reality for all students
Differences in persistence rates between number of sections
(courses) attempted, according to institution type.
This benchmark is based on data across 57 institutions • Education is not one-size-fits-all
(34 community colleges and 23 4-year institutions). Need to make realistic recommendations
to help all students

CIVITAS LEARNING® COPYRIGHT © 2018

CIVITAS LEARNING® COPYRIGHT © 2018
 CHICAGO REGIONAL WORKSHOP

THE PROGRAM

Target Audience:
Students in good standing, enrolled in
fewer than six hours for Spring 2018

Goal:
Students enroll in just one more class,
which may put them over the 5.14 credit
hour tipping point indicated as a “top
perseverance indicator” by Illume
UNIFIED DATA LAYER

Messaging:
Taking one more class will help you achieve
your goal faster

CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION

 CHICAGO REGIONAL WORKSHOP

OUTCOME

2,036 emails
1,053 opens
(52% open rate)

199 students added

courses
UNIFIED DATA LAYER

289

Overall 1 percentage point lift in the percent of students taking 7 or

more credit hours Spring ‘18 compared to Spring ’17.
CIVITAS LEARNING, INC. -- CONFIDENTIAL INFORMATION
 COMMUNITY INSIGHT 1

PARTNER INSIGHT

CIVITAS LEARNING® COPYRIGHT © 2018

CIVITAS LEARNING® COPYRIGHT © 2018
CIVITAS LEARNING® COPYRIGHT
Civitas Learning® © 2018©2018
Copyright
Measure the impact of
programs, policy changes
& interventions
• Identify comparable control groups
• Leverage prediction-based
propensity score matching
• Measure true intervention efficacy
• Meets What Works Clearinghouse
guidelines

CIVITAS LEARNING® COPYRIGHT

Civitas Learning® © 2018©2018
Copyright

Hi Sam…wanted to let you
know that the Writing
Center is a big part of doing
well in your major. The
majority of students using
the writing center are
achieving A’s in their
courses. Come see what’s
available and how we can
support you! The Writing
Center is located in Goodall
Hall Room 223.
There is a meet-up at the
Writing Center for new
students at 7pm on Thursday.
Can you commit to going?
Maybe
Would you like a reminder on
Wednesday?
Yes
Civitas Learning® Copyright ©2018
Sam Jones
Hi Sam, The Writing Center
Welcome to the university. Congratulations again on your
scholarship!HiWe’re
Sam –so happy
Here to have you as a student. It was gre
is your
meeting you at our advising
reminder that theresession
is a last week.
meet-up tomorrow at 7pm
for new students at the students – the real rock stars h
Did you know our most successful
Writing Center. 10 new
– visit the Writing Center an average of 6 times the first semester
students are planning to
their junior attend.
year. Let’s
Are make
you in?sure you’re a rock star too! I can arra
for you to meet up with another student to show you around the
center. Let’s talk.
Matt Champion, Advisor
 BRINGING THE WORK TOGETHER

Personalized Precision
Pathways Engagement

Student Success
Intelligence Platform

CIVITAS LEARNING® COPYRIGHT

Civitas Learning® © 2018©2018
Copyright
 A CLEAR PATH – FROM START TO FINISH
Start Strong
SCHEDULING
● Easily manage critical
onboarding tasks
● Develop a deeper sense PLANNING
of belonging through
personalized engagement

Stay on the Path

to Success
● Follow course a roadmap,
track progress, understand
requirements, and evaluate
potential plan changes ONBOARDING &
● Align degree and career, STUDENT
gain insight to job demand ENGAGEMENT

● Quickly find the best-fit

schedule and enroll for
classes

CIVITAS LEARNING® COPYRIGHT

Civitas Learning® © 2018©2018
Copyright
 THE CIVITAS: A COMMUNITY LEARNING TOGETHER

RESOURCES & RESEARCH COMMUNITY OF PRACTICE

Tools & guidance to start stronger Networking & opportunities to learn from
& learn faster together other Civitas Partners & industry experts

The ● National ● Annual Summit:

● Webinars on ● Civitas Learning 250+ Partner attendees
Civitas Advisory
tactics & Space Representing Board (NAB): ● Regional
learnings 300+ Partners Dr. Vince Tinto,
● Community Dr. Linda Baer, Workshops:
● Nudge hub Insights Reports Dr. Davis Jenkins Throughout US
each year
● Playbooks ● Podcasts on ● Mission-
● Research
trends & tactics aligned
● User guides Partnerships
Investors:
● Additional Lumina Foundation,
support services ReThink, Valhalla

CIVITAS LEARNING® COPYRIGHT © 2018

CIVITAS LEARNING® COPYRIGHT © 2018
 UNITE AT

April 2nd – 4th

civitaslearning.com/summit

CIVITAS LEARNING® COPYRIGHT © 2018