You are on page 1of 67

Selecting an

On-Demand LMS
How to evaluate and select a SaaS
(Software as a Service) LMS provider

Josh Bersin
September, 2007

Copyright © 2007 Bersin & Associates. All rights reserved.


About Us
ƒ Who We Are
• Industry’s primary research firm focused
on What Works® in enterprise learning
and talent management

ƒ Research Areas
• Planning & Strategy
• Content Development
• Enterprise Learning
• Learning Technology
• Performance Management
• Talent Management
• HR and Talent Systems

ƒ Offerings
• In-Depth Studies and Reports
• Research Memberships
• Workshops
• Benchmarking
• Advisory Consulting

Copyright © 2007 Bersin & Associates. All rights reserved. Page 2


Agenda
ƒ The challenge of enterprise learning technology
ƒ Defining an “integrated learning technology solution”
ƒ Emerging role of talent management
ƒ The SaaS Model
• What it is
• Cost of ownership
• How to select the right solution

Copyright © 2007 Bersin & Associates. All rights reserved. Page 3


Adoption of Learning Technology
LMS 60%

Virtual Classroom 57%

Rapid E-Learning Tool 40%

Application Simulation
Tools 39%

EPSS or KM Tool 26%

LCMS 25%

Podcasting 9% © Bersin & Associates


2007 Corporate Learning Factbook
www.bersin.com/factbook

Copyright © 2007 Bersin & Associates. All rights reserved. Page 4


LMS Market Evolution

Talent
TalentManagement
Management
Performance
PerformanceManagement
Management
Skills and Competencies
Skills and Competencies

Where
Whereare
areyou?
you? Enterprise
EnterpriseLearning
LearningApplication
Application
Consolidated Data and Analytics
Consolidated Data and Analytics
Integrated
Integratedwith
withOther
OtherLearning
LearningComponents
Components
ERP, HR, and application integration
ERP, HR, and application integration

EE-Learning
-Learning Platform
Platform
Make
MakeEE-Learning
-Learning Possible
Possible
Make
Make E-LearningEasy
E- Learning Easy

Training
TrainingManagement
ManagementSystems:
Systems:
Automate
Automatethe
theProcess
Processof
ofInstructor-Led Training
Instructor-Led Training

Copyright © 2007 Bersin & Associates. All rights reserved. Page 5


Why people buy LMS systems

47% Strategic
Strategic
41% Efficiency
37% Efficiency
35% 34%

26%
Biggest
BiggestDrivers:
Drivers:
Administration
Administration 20%
E-Learning
E-Learning

Manage Manage and Consolidate Align Training Support Talent Reduce Meet
Training Deploy E- Training Processes Managem ent Training Costs Regulatory
Adm inistration Learning Inform ation Com pliance

Copyright © 2007 Bersin & Associates. All rights reserved. Page 6


Benefits of LMS System

46%
Strategic
Strategic
38% Efficiency
Efficiency

25% 23%
Biggest
BiggestBenefits:
Benefits:
Information
Informationand
and
Content Distribution
Content Distribution
11%
6%

Tracking and Facilitate E- Manage Improve Training Meet Regulatory Reduce Training
Reporting Learning Enterprise-wide Efficiency Compliance Costs
strategy Programs

Copyright © 2007 Bersin & Associates. All rights reserved. Page 7


Challenges of Implementation

31%

24%
21%
19%
Biggest
BiggestChallenge:
Challenge:
14%
Customization
Customization
10%

Customization Content Integration with Ongoing IT Support System


to meet Integration HR IS Administration Performance
Business Needs

Copyright © 2007 Bersin & Associates. All rights reserved. Page 8


LMS “Dis” Satisfaction:
The LMS business is difficult - lots of work still to do
Excellent Rating, 10.00

Scalability, 7.10

Product will continue,


7.00

Content Integration, 6.80

Vendor Service, 6.30

Systems Integration, 6.20

Testing/Assessment, 6.10

Ease of Upgrade, 6.00

Ease of Customization,
5.70
Out of Box Functionality,
5.50

Reporting, 5.10

Very Not Somewhat Very


Disappointed Happy Happy Happy

© Bersin & Associates: LMS Customer Satisfaction 2007, available at www.bersin.com/lmssat n=500+
Copyright © 2007 Bersin & Associates. All rights reserved. Page 9
LMS’s ability to give you the
information you need

Good, 36%

Excellent, 3%

Poor, 22%
Fair, 39%

Copyright © 2007 Bersin & Associates. All rights reserved. Page 10


Data Standards

Standards Average 2.9


Documented 4= fully enforced
and enforced 1=none
49%
Standards are a challenge

Standards
documented
and somewhat
enforced
31%

No real
standards Some standards
9% but not
documented
11%

Copyright © 2007 Bersin & Associates. All rights reserved. Page 11


The Content Integration Problem

61%
61%of
ofLMS
LMSUsers
UsersCite
Cite
Content
ContentIntegration
Integrationas
asaa Some
Problem
Problem Problems,
42%

Many
Problems,
29%

No Problems,
18%
NA, 8%
Study conducted in May 2004, 10,000+ Surveys

Copyright © 2007 Bersin & Associates. All rights reserved. Page 12


The LMS Ecosystem

Call Call
Center Center
Course Course

LMS Internally
“Learning Integration Platform” Developed Content

Assessment HR and Other 3rd Party


and Competencies Corporate Systems Content Leadership Performance
Training Mgt Training
Course Course

Skillsoft, Others

Copyright © 2007 Bersin & Associates. All rights reserved. Page 13


Four Stages of E-Learning

Where are you? Stage 4: On Demand


Stage 4: On Demand
LCMS, Performance Support, Search
LCMS,
LCMS,Performance
PerformanceSupport,
Support,Search
Search

Stage
Stage 3:
3: Integrate
Integrate && Align
Align
LMS, governance, competency-based, performance management
LMS,
LMS,governance,
governance,competency-based, performance
competency-based, performancemanagement
management

Stage
Stage 2:
2: Expand
Expand
Blended
Blendedprograms,
programs,rapid
rapidee-learning,
-learning, outsource
outsourcesophistocated
sophistocatedcontent
content

Stage
Stage 1:
1: Get
Get Started
Started
Get content online: Buy off the shelf – one size fits all
Get
Getcontent
contentonline:
online: Buy
Buyoff
offthe
theshelf
shelf––one
onesize
sizefits
fitsall
all

© Bersin & Associates


The Four Stages of E-Learning
www.bersin.com/stages

Copyright © 2007 Bersin & Associates. All rights reserved. Page 14


E-Learning Metamorphosis
Communities
of Practice
Collaboration
Systems Performance
Support

Blended
Learning Online
Video

Webcasting
LMS Application
Simulations
LCMS
On Demand
Rapid Assessment RSS
E-learning
Podcast

Courseware
Text, Images, and Audio

Copyright © 2007 Bersin & Associates. All rights reserved. Page 15


Innovative Approaches to Learning
Supports the Talent Development Process and Appeals to GenX Learners

Expert Learning on Demand


Coaching Communities Career
Programs of Practice Curriculum
Self
Assessment

Re
EPSS te
nt
Tools Training io
n
is
Event L os
Job t
Aids

Novice Traditional Training


Time

Copyright © 2007 Bersin & Associates. All rights reserved. Page 16


Integration with Performance Support

Online Help
Courses

LCMS Help System


Copyright © 2007 Bersin & Associates. All rights reserved. Page 17
Enterprise Context for the LMS

Enterprise Portal

Documents Goals
Job Aids Perf Plans
Courses Price Lists Organization
Webcasts Videos Assessments
Assessments Audios Benefits
Events Powerpoint Compensation
Podcasts PDFs HRMS
Presentations Word
Excel

LMS Other Data HR Apps

Copyright © 2007 Bersin & Associates. All rights reserved. Page 18


Enterprise Context for the LMS

Enterprise Portal

Documents Goals
Job Aids Perf Plans
Courses Price Lists Organization
Webcasts Videos Assessments
Assessments Audios Benefits
Events Powerpoint Compensation
Podcasts PDFs HRMS
Presentations Word
Excel

LMS Other Data HR Apps

Copyright © 2007 Bersin & Associates. All rights reserved. Page 19


Search is a critical element

Copyright © 2007 Bersin & Associates. All rights reserved. Page 20


Directions of the LMS Market
Increase in Enterprise Learning Capabilities
Tools, LCMS, Content Integration, Analytics, Domain mgt,
Collaboration Systems, Publishing, Performance Support
Search, Web-services, Portals, Self-publishing,
Communities of practice, blogs, wikis, online video…

Increase in Talent Management Capabilities


Employee profiles, job descriptions, performance management,
succession planning, HIPO selection, manager/employee portals,
assessment, recruiting, applicant tracking, internal recruiting,
compensation, workforce analysis, career planning, candidate
selection, competency analysis, skills-gap analysis,
integration or building of HRMS,interface to external data sources

Today’s LMS Systems

Copyright © 2007 Bersin & Associates. All rights reserved. Page 21


Agenda
ƒ The challenge of enterprise learning technology
ƒ Defining an “integrated learning technology solution”
ƒ Emerging role of talent management
ƒ The SaaS Model
• What it is
• Cost of ownership
• How to select the right solution

Copyright © 2007 Bersin & Associates. All rights reserved. Page 22


Enterprise Learning Technology
Portals: Employee | Manager | Customer | Partner

Tools
Collaboration (Webcast, Discussion, Blog, Wiki) Career Development

Content Development Tools Succession Planning

Learning Talent
Learning Content
Learning Content

Content Management (LCMS) Performance Support 360 Assessment

Management Management

Application
Performance
Content Interfaces

LMS

Reporting
Management
Programs, Courses, Objects, Assessments Goals, Objectives, Performance Plans,
Prices, Fees, Student Hours, Credits, Resources, Development Plans, Assessments
Certifications, Scores, Completions, Ratings Reviews, Ratings, Rankings

Competency Requirements, Organizational Competencies, Skills

Data
Job and Role Descriptions, Open Requisitions

Data
Organizational Data (Relationships, Hierarchy, Geography)

Management - ERP
Compensation Data (Current, planned, short/long term)
Employee Profile Data (Demographics, History)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 23


Enterprise Learning Technology
Portals: Employee | Manager | Customer | Partner

Tools
Collaboration (Webcast, Discussion, Blog, Wiki) Career Development

Content Development Tools Succession Planning


Learning Content
Learning Content

Content Management (LCMS) Performance Support 360 Assessment

Application
Performance
Content Interfaces

LMS

Reporting
Management
Programs, Courses, Objects, Assessments Goals, Objectives, Performance Plans,
Prices, Fees, Student Hours, Credits, Resources, Development Plans, Assessments
Certifications, Scores, Completions, Ratings Reviews, Ratings, Rankings

Competency Requirements, Organizational Competencies, Skills


Job and Role Descriptions, Open Requisitions

Data
Organizational Data (Relationships, Hierarchy, Geography)
Compensation Data (Current, planned, short/long term)
Employee Profile Data (Demographics, History)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 24


Enterprise Learning Technology
Portals: Employee | Manager | Customer | Partner

Tools
Collaboration (Webcast, Discussion, Blog, Wiki) Career Development

Content Development Tools Succession Planning


Learning Content
Learning Content

Content Management (LCMS) Performance Support 360 Assessment

Application
Performance
Content Interfaces

LMS

Reporting
Management
Programs, Courses, Objects, Assessments Goals, Objectives, Performance Plans,
Prices, Fees, Student Hours, Credits, Resources, Development Plans, Assessments
Certifications, Scores, Completions, Ratings Reviews, Ratings, Rankings

Competency Requirements, Organizational Competencies, Skills


Job and Role Descriptions, Open Requisitions

Data
Organizational Data (Relationships, Hierarchy, Geography)
Compensation Data (Current, planned, short/long term)
Employee Profile Data (Demographics, History)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 25


Types of Integration to Consider
Portals: Employee | Manager | Customer | Partner

Tools
Collaboration (Webcast, Discussion, Blog, Wiki) Career Development

Content Development Tools Succession Planning


Learning Content
Learning Content

Content Management (LCMS) Performance Support Sourcing & Recruiting

Application
Performance
Content Interfaces

LMS

Reporting
Management
Programs, Courses, Objects, Assessments Goals, Objectives, Performance Plans,
Prices, Fees, Student Hours, Credits, Resources, Development Plans, Assessments
Certifications, Scores, Completions, Ratings Reviews, Ratings, Rankings

Competency Requirements, Organizational Competencies, Skills

Data
Job and Role Descriptions, Open Requisitions

Data
Organizational Data (Relationships, Hierarchy, Geography)

Management - ERP
Compensation Data (Current, planned, short/long term)
Employee Profile Data (Demographics, History)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 26


Agenda
ƒ The challenge of enterprise learning technology
ƒ Defining an “integrated learning technology solution”
ƒ Emerging role of talent management
ƒ The SaaS Model
• What it is
• Cost of ownership
• How to select the right solution

Copyright © 2007 Bersin & Associates. All rights reserved. Page 27


Global Talent Shortage
Top Jobs which are Difficult to Fill, Ranked in Order

World USA UK Germany India Japan China


Sales Sales Sales Production Sales Sales Production
Representatives Representatives Representatives Operators Representatives Representatives Operators
Engineers Engineers Administrative Sales IT Staff Engineers Sales
Assistants Representatives Representatives
Technicians Nurses Skilled Trades Engineers Accountants Administrative Technicians
(production/opns) (fitter, plumber) Assistants (production/opns)
Production Technicians Engineers Management / Marketing and PR IT Staff Management /
Operators (production/opns) Executives Executives Executives
Skilled Trades Accountants Drivers Restaurants and Engineers / Production Engineers
(carpenter/ weld) Hotel Staff Technical Mgrs. Operators
IT Staff Administrative Chefs/Cooks Administrative IT Managers / Accountants Machinists
Assistants Assistants Project Mgrs
40% employers
have difficulty 44% 42% 53% 13% 58% 24%
filling positions

32,975 1275 2122 1004 4382 892 2692


respondents

Manpower Inc. 2006


Talent Shortage Survey
33,000 employers

Copyright © 2007 Bersin & Associates. All rights reserved. Page 28


Global Shortage of Technical Skills and
Development Capabilities
Capability Excellence Overall US Europe Asia Pac

Recruit and develop talent 15% 17% 10% 17%

Provide Career 14% 14% 18% 11%


Development Throughout
Organization
Define, measure and 11% 18% 10% 7%
reward collaboration

Provide appropriate 8% 9% 8% 6%
training for managers and
executives

PWC, October 2006, n=153

Copyright © 2007 Bersin & Associates. All rights reserved. Page 29


Workforce Demographics

Critical Talent Management


Capturing and Sharing
Succession Planning Knowledge
Identification of Key Leaders Mentoring
Management & Leadership
Recruiting
Development
New Hire Training
Onboarding

At-Risk Industries

Government
Energy
Oil & Gas
Telecommunications
Manufacturing

25-34 35-44 45-54 55-64 65+


© Bersin & Associates

Copyright © 2007 Bersin & Associates. All rights reserved. Page 30


Evolution of the HR Function
Talent
Management
Competency Management
Performance Management
Strategic HR Succession Planning
Recruiting
L&D Business Integration
Org Design
Performance Management
Personnel Total Compensation
Succession Planning
Communications
Department Competency Management
Pay for Performance
Payroll Business Partner Leadership Development
Benefits
Recruiting, ATS
HR Portals
Business Function Compensation
Learning Management
Payroll Systems

© Bersin & Associates: Performance Management 2006: Market Analysis, Trends, Best Practices
and Case studies, available at www.bersin.com/perfmgt

Copyright © 2007 Bersin & Associates. All rights reserved. Page 31


Traditional HR Processes and Systems
ƒ Slow response to changing business needs
• Do not clearly understand where current critical talent
Silos in HR •
gaps exist
Lack of disciplined workforce planning to drive future
talent needs and capabilities
• Hiring strategy and development planning not in sync
• No clear picture of future “talent profile”
• Leadership pipeline in jeopardy
Recruiting – Applicant Tracking

Performance Management

ƒ Disconnected and Cumbersome


Leadership Development
Learning & Development

Compensation - Benefits
Succession Planning
• Data and processes not integrated
Workforce Planning

• Talent not shared across businesses/units


• Learning plans not linked to assessments and skills
gaps in current talent pool

ƒ Not responsive to employee demands


• Employees want career development
• Millenia generation expects growth and flexibility
• Defined career paths and competencies not clear and
consistent

ƒ Administratively intensive
• Data entry is repetitive
• High volume of manual work to complete HR review
processes
• Difficult to obtain executive-level talent information

Copyright © 2007 Bersin & Associates. All rights reserved. Page 32


Integrated Talent Management?
2 3
Sourcing Performance
& Recruiting management

HR Systems
1 & Metrics 4
Talent Strategy Learning &
& Planning Development
Competency
Management

7 5

Compensation Succession
planning
6
Leadership
Development
Copyright © 2007 Bersin & Associates. All rights reserved. Page 33
High Impact Talent Management Framework

Planning
Talent Strategy & Planning

Comp Base Comp


Business Critical Talent Target Metrics Process Systems
Strategy Strategy & Measurement Governance Strategy

Plans
Sourcing & Performance Succession Leadership
HR Systems & Metrics

Recruiting Management Planning Development

Compensation
Sourcing Formal Programs
Goal Setting Calibration Meetings
Candidate Pools Stretch Assignments
Cascading Goals Talent Reviews
Assessment Executive Education
Self-Assessment HIPO Identification
Employer Brand Coaching
Manager Assessment Career Planning
Recruiting Mentoring
360 Assessment Talent Migration Plan
Selection Job Rotation
Development Planning
Assessment
Competency Assessment
Evaluation

Performance
Job Corporate Leadership Functional

Pay for
Competency Management Profiles Values Competencies Competencies

Onboarding Management Leadership Coaching/Mentoring


Training Curricula Programs
Role-based Operational E-Learning Developmental

Long Term
Short and
Incentive
Curricula Training Strategy Assignments

Content Development Certification


& Delivery Learning & Development Programs

Copyright © 2007 Bersin & Associates. All rights reserved. Page 34


A New Role for Learning
Performance-Driven Learning Talent-Driven Learning
Drivers: Business performance issues in Talent and leadership gaps, critical skills
operational units and functions shortages, engagement and culture
Goal: Develop individual capabilities and fill Develop organizational capabilities driven
performance gaps by competencies, not performance
Examples: Sales Training, Customer Service Multi-tier leadership development
Training, Field service certification New-hire onboarding programs
Organization: Aligned by job within function Aligned to all job roles in a job function
Timeline Months or even shorter Multiple quarters to years

Complexity Functional Enterprise or Divisional-wide


Integrated with: Product launches, new service offerings, Performance management, recruiting,
geographic expansion succession planning
Challenges: Performance consulting, program design, Resource allocation, program design, job
manager engagement alignment, manager adoption
How to Solving business problems: sales, Filling and solving talent gaps (ie.
measure service, quality, turnaround shortages, recruiting goals)
success

Copyright © 2007 Bersin & Associates. All rights reserved. Page 35


Example: Wal-Mart
ƒ Situation: Store hiring and
personnel processes developed SVP
around goal of reducing costs HR

ƒ Problem: Millions of dollars of legal HR 5 Divisions


problems, turnover, and inconsistent VP
development of store managers
HR
ƒ Solution: Integrated HR talent- Director 29 Regions
driven learning curriculum, with
certification, for all 4,077 HR
professionals HR 382 Markets
Manager
ƒ Developing competency model for
1.8 million people, behavioral HR
3740 Stores
assessment tools, 180 job families Coordinator

Copyright © 2007 Bersin & Associates. All rights reserved. Page 36


Talent-Driven Learning Programs
The Six Key Elements

1. Designed around clearly defined competency gaps


2. Require a complete curricula to develop people through
the leadership pipeline
3. Aligned with performance and development planning
4. Fit into a career development program
5. Use techniques which attract millenia and Generation X
workers
Job Corporate Leadership Functional
Competency Management Profiles Values Competencies Competencies

Onboarding Management Leadership Coaching/Mentoring


Training Curricula Programs
Role-based Operational E-Learning Developmental
Curricula Training Strategy Assignments

Content Development Certification


& Delivery Learning & Development Programs

Copyright © 2007 Bersin & Associates. All rights reserved. Page 37


History of HR Systems

Hiring E-Learning Performance Integrated


Recruiting Compensation Talent Solutions
Market Growth - Adoption

Integrated
Learning LCMS Talent Management??
Management
Performance
Recruiting Management
Sourcing
Succession
Benefits Planning
Applicant
Administration Competency
Tracking
Mgt

HRMS Compensation

2000 2003 2006 2009

Copyright © 2007 Bersin & Associates. All rights reserved. Page 38


HR Software Markets
Category Core Functionality Market Maturity
& Growth
Manage all aspects of training, scheduling, Middle Majority
LMS compliance, e-learning, content management,
learning paths, customer training, e-commerce, Fast Growth
collaboration, reporting
Goals, performance plans, appraisals, Early Majority
Performance assessments, competency assessments, ratings,
Management rankings, development plans, succession planning Very Fast Growth

Applicant tracking, resume database, workflow Majority


Recruiting management, source analysis, career portals,
hiring metrics, recruiter portals, manager portals Slowing & Rebuilding
Employee data and history, job profiles, corporate Late Majority
HRMS hierarchy, compensation history, key training,
language, and employee profiles Stable
Compensation plans, short term plans, long term Early Adopters
Compensation plans, incentives, budgets, interface with sales
and financial systems Slow Growth

Copyright © 2007 Bersin & Associates. All rights reserved. Page 39


The Prevailing Wisdom

LMS

Performance
Management
Recruiting Talent
Management
HRMS Suite

Compensation

Copyright © 2007 Bersin & Associates. All rights reserved. Page 40


Evolution of Learning Technology
Continued Growth Even Faster Growth
and Expansion and Expansion

On-Demand
Tools Content Skills

Performance
LCMS Support Collaboration Succession
Competencies
Planning
Learning Performance
Management Management
Learning Systems
Systems Paths Development Comp
Plans

The Training Organization The HR Organization

Copyright © 2007 Bersin & Associates. All rights reserved. Page 41


Some Facts to Consider
ƒ The market for ITM suites is currently less than 10% than the total market for
LMS systems alone

ƒ Fewer than 20% of ITM suite vendor customers have more than one
application in production

ƒ Oracle and SAP, who have 10X the resources of the suite vendors, have yet
to deliver a total suite solution

ƒ Each of the independent HR application areas is undergoing continuous


expansion in functionality

ƒ Organizations do not implement each of these solutions at one point in time,


and implementations take 2-3 years

ƒ Web-services APIs now enable enterprise applications to share data,


workflow, and portals very easily

Copyright © 2007 Bersin & Associates. All rights reserved. Page 42


A few other facts to consider
ƒ What is the business driver for your learning technology?
• Compliance initiatives?
• Customer or partner training?
• Talent-driven learning programs?
• Adoption of e-learning?
• Consolidated view of learning?
• Efficient management of enterprise training?
• All of the above?

ƒ Would you be willing to sacrifice any of this functionality


for the benefit of an “integrated solution?”

Copyright © 2007 Bersin & Associates. All rights reserved. Page 43


Agenda
ƒ The challenge of enterprise learning technology
ƒ Defining an “integrated learning technology solution”
ƒ Emerging role of talent management
ƒ The SaaS Model
• What it is
• Cost of ownership
• How to select the right solution

Copyright © 2007 Bersin & Associates. All rights reserved. Page 44


Three Models for Enterprise Software
Model Where is Software? Licensing Model Tenancy and Architecture
Licensed Installed and You purchase the Software is installed on your
operated in your software and pay servers, using your database,
organization. 18-22% per year and can be integrated with
for support and your internal systems.
service
Hosted Installed and You may Software is installed on a third
“Single- operated in a third purchase the party company’s servers,
Tenant” party location. software or rent it, using their networking to
and a third party provide access, with a
charges you to dedicated database for you.
operate it.
On-Demand Installed and You “rent” the The software is installed on
SaaS operated by the LMS software and pay the LMS vendors’ servers and
“Multi- vendor. an annual fee for shares database and other
Tenant” software resources with other clients.
availability.

Copyright © 2007 Bersin & Associates. All rights reserved. Page 45


How the Models Differ
Model Upgrades and Fixes Cost Considerations $ Model
Licensed You are responsible for You must purchase the You own the
patches and fixes, and software as a capital software and it
likely will install when investment and budget for is yours to
you have time. implementation, operations, maintain.
fixes, and upgrades.
Hosted The hosting vendor You typically purchase the You own the
“Single- installs these patches software and pay an annual software but
Tenant” and upgrades fee for implementation, someone else
whenever you are operations, fixes, and maintains it and
ready for them. upgrades. operates it.
On-Demand The LMS vendor All your fees are monthly or The LMS vendor
SaaS installs these patches annual and the LMS vendor provides it to
“Multi- and upgrades takes on any cost of you as a
Tenant” transparently to you, hardware, database, fixes, service.
whenever they want to. and other service.

Copyright © 2007 Bersin & Associates. All rights reserved. Page 46


Cost of Ownership - Licensed
Cost model follows cost of any capital purchase (buy)

Annual
Costs Initial
Initial
Implementation
Implementation
System purchase
System purchase
Implementation
Implementation

Integration System
System
Integration
Systems Integration Upgrade
Systems Integration
Content integration
Upgrade
Content integration
Training
Training
Change Management
Change Management
Custom Report Generation
Custom Report Generation
Customizations
Customizations
Enterprise LMS
Licensed

Time
Copyright © 2007 Bersin & Associates. All rights reserved. Page 47
Cost of Ownership - Hosted
Cost follows model of capital acquisition by a leasing agent (lease)

Annual
Costs Initial
Initial
Implementation
Implementation
System purchase
System purchase
Implementation
Implementation

Integration System
System
Integration
Systems Integration Upgrade
Systems Integration
Content integration
Upgrade
Content integration
Training
Training
Change Management
Change Management
Custom Report Generation
Custom Report Generation
Customizations
Customizations
Enterprise LMS
Licensed

Hosted

Time

Copyright © 2007 Bersin & Associates. All rights reserved. Page 48


Cost of Ownership - SaaS
Cost follows model of a rental agreement (rent)

Annual
Costs Initial
Initial
Implementation
Implementation
System purchase
System purchase
Implementation
Implementation

Integration System
System
Integration
Systems Integration Upgrade
Systems Integration
Content integration
Upgrade
Content integration
Training
Training
Change Management
Change Management
Custom Report Generation
Custom Report Generation
Customizations
Customizations
Enterprise LMS
Licensed

SaaS

Time
Copyright © 2007 Bersin & Associates. All rights reserved. Page 49
Cost of Ownership - Licensed
Initial Deployment Ongoing Ongoing
Infrastructure Personnel Infrastructure Personnel
5-20% 5-15% 5-15% 50-85%
ƒ Hardware ƒ Needs analysis ƒ Hardware ƒ Scheduled
ƒ Software ƒ Configuration upgrades maintenance
ƒ Security ƒ Tuning and Testing ƒ Network ƒ Unscheduled
ƒ Networking ƒ Launch ƒ Security maintenance
ƒ Monitoring tools ƒ IT Staff training ƒ Bandwidth ƒ Outage response
ƒ Reporting tools ƒ End-user training ƒ Redundant ƒ End-user support
ƒ Facilities systems ƒ IT staff training
ƒ Backup and support
ƒ Helpdesk ƒ Upgrades and add-
ons
ƒ Security monitoring

Copyright © 2007 Bersin & Associates. All rights reserved. Page 50


Cost of Ownership - SaaS
Setup Deployment Ongoing Ongoing
Fees Personnel Costs Personnel
2-5% 3-5% 80-90% 5-10%
ƒ Vendor setup fees ƒ Application testing ƒ SaaS subscription ƒ System
ƒ Integration with fees administration
other systems ƒ Working with
ƒ Configuration (typically include vendor
implementation, ƒ End-user support
ƒ Launch and end support, upgrades,
user training and marketing
end-user support,
content integration,
and other services)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 51


TCO Calculator: You can Compute

Copyright © 2007 Bersin & Associates. All rights reserved. Page 52


The Illusion of a Breakeven Point

Total
Costs Theoretical SaaS
Incurred

Theoretical Licensed

Issues which Affect This:


Implementation cost
Operations cost
Efficiency of your IT group
Complexity of implementation
You may not EVER see savings in Licensed

Time

Copyright © 2007 Bersin & Associates. All rights reserved. Page 53


Operational Benefits to SaaS
Licensed OnDemand
Content Vendor tests content but Vendor takes full responsibility and
responsibility lies with you must deliver integrated solution
Integration
Systems Highly flexible but complex Relies upon vendor’s programming
interfaces (APIs) and services
Integration
Cost A typical capital cost justification Much lower initial costs and can be
is needed justified as a new expense
Justification
Typical High cost Vendor’s services
Long implementation Vendor’s experience
Risks Possible failed configuration Flexibility of product
Best Fit Global enterprise, heavy IT Enterprise or mid-market, fewer
commitment resources
Customer Fair but rarely high Generally higher if the fit is right
Satisfaction
Key Vendors GeoMetrix, Oracle, Plateau, CornerstoneOnDemand,
Saba, SumTotal, SAP GeoLearning, KnowledgePlanet,
Learn.com, MeridianKSI, TEDS

Copyright © 2007 Bersin & Associates. All rights reserved. Page 54


Selecting an SaaS Vendor
Licensed or OnDemand SaaS
ASP (Multi-Tenant)
How they 1. Revenues from licensed 1. Revenues from subscription fees
software (1/3) 2. Revenues from subscription fees
Make Money
2. Revenues from support 3. Revenues from subscription fees
contracts (1/3) 4. ……
3. Revenues from implementation
services (1/3)
Biggest Selling Software Developing Software
Implementing Software Providing Services
focus for
Supporting Software Ensuring Renewals
organization
Key Vendors GeoMetrix CornerstoneOnDemand
Oracle, GeoLearning
Plateau KnowledgePlanet,
Saba Learn.com
SAP MeridianKSI
SumTotal TEDS

Copyright © 2007 Bersin & Associates. All rights reserved. Page 55


The Simple Difference

Licensed software
vendors sell products

SaaS vendors sell


subscriptions
Copyright © 2007 Bersin & Associates. All rights reserved. Page 56
The Simple Difference

Licensed software vendors


want you to “go-live”

SaaS vendors want you to


“deploy” and “renew”

Copyright © 2007 Bersin & Associates. All rights reserved. Page 57


Signs of a Great Supplier

Licensed software vendors who


have most of their customers
live on current releases

SaaS vendors who have high


renewal rates (> 90%)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 58


Litmus Test for SaaS LMS Vendor
ƒ Multi-tenant architecture
ƒ All clients on same release of software
ƒ Rapid-deployment solution
ƒ Tier-one systems and networking facility
ƒ Documented Service-Level Agreements (SLAs)
ƒ Availability over 99.9%
ƒ Experienced with HRMS integration
ƒ Content integration services
ƒ Content available for resale
ƒ Learning services (design, program support, integration)
ƒ Understanding of learning programs
ƒ Understanding of talent management processes
ƒ High rate of renewals (>90% ideally)

Copyright © 2007 Bersin & Associates. All rights reserved. Page 59


Questions?
ƒ For more information:

www.bersin.com/lms

Copyright © 2007 Bersin & Associates. All rights reserved. Page 60


Cabelas: Best of Breed Solution
ƒ $2 Billion outdoor sporting goods
company, opening 34 new stores

ƒ 500 people per store need extensive


training on sales, products, vendor-
provided content

ƒ GeoLearning developed content and


delivered it in GeoLearning’s
Domino LCMS

ƒ Q2 Learning GeoEngage
collaboration system used for
continuing education

ƒ KnowledgeAdvisors used for


measurement and assessment

Copyright © 2007 Bersin & Associates. All rights reserved. Page 61


Cabelas: Keys to Success
ƒ Laser focus on the problem at hand:
flexible, talent-driven e-learning for
retail sales rollout

ƒ Cabelas did not originally have


development skills, so they relied on
a full-solution to get started

ƒ Wide range of tools (collaboration,


LCMS, development, analytics)
made up the total solution

ƒ Cabellas did not have to “shop” or


“select” the right elements of their
solution

ƒ Cabellas rates their solution very


highly and is now self-sufficient

Copyright © 2007 Bersin & Associates. All rights reserved. Page 62


Utica National
ƒ 1400 employees, small business
insurance, among the 25 largest
insurance companies in the US

ƒ Needed a solution for employee


assessment, learning, and
performance management to
improve career development

ƒ Director of Learning decided that


LMS-based solution was the best fit

ƒ LMS vendor solutions were not


complete: needed help with
competencies, content, and
performance management

Copyright © 2007 Bersin & Associates. All rights reserved. Page 63


Utica National Solution
ƒ Evaluated 7 LMS vendors, chose one
(GeoLearning) in conjunction with
SuccessFactors and ITG insurance
competency library, Webex for
collaboration

ƒ LMS vendor providing single source of


contact, but PM vendor providing
design assistance with PM process

ƒ Content from NETg, Mindleaders,


Kaplan Financial, and internally
developed using LCMS

ƒ Single point of contact from LMS


vendor providing excellent support and
service

Copyright © 2007 Bersin & Associates. All rights reserved. Page 64


How much LMS do you need?
Things you Must Have Things that are Nice to Have
“Learning technology must have…” “It would be nice …”
Functionality must meet the needs of Development planning integrated
your learning requirements. with LMS
LMS must be easy to implement, Integrated competencies across
configurable, and have excellent performance and learning.
support in your environment.
Vendor-provided and supported Vendor-provided collaboration
content and content integration tools and platform
Excellent, flexible, and easy-to-use Succession planning and career
reporting and analytics planning integrated with learning
OEM or partner-provided development Vendor stated direction toward
tools, LCMS, and collaboration integrated performance management
Proven and experienced professional Vendor experience with broader
services and vendor expertise HR applications and processes
Excellent references doing the type Excellent references and ROI from customers
of learning and scale of your organization using the modules you plan to use

Copyright © 2007 Bersin & Associates. All rights reserved. Page 65


Bottom line
1. Remember the business problem that got you here, and select a vendor
with the greatest experience in delivering on that solution.

2. Evaluate vendors based on actual reference customers, not features,


checklists, demonstrations, or websites. Vendors that offer “solutions” drive
much higher satisfaction than those which offer “products.”

3. All LMS implementations are complex and 24% of LMS buyers want to
switch vendors, so expect implementation to be 3-5X purchase cost.

4. The LMS is “the core system” for your learning programs, and it must
flexibly support every talent management program you implement.

5. If you are embarking on a talent management strategy, develop the


strategy, process design, and governance before you start looking at
systems, this may dramatically change your focus on an “integrated” or
“best-of-breed” strategy.

Copyright © 2007 Bersin & Associates. All rights reserved. Page 66


Directions of the LMS Market
Increase in Enterprise Learning Capabilities
Tools, LCMS, Content Integration, Analytics, Domain mgt,
Collaboration Systems, Publishing, Performance Support
Search, Web-services, Portals, Self-publishing,
Communities of practice, blogs, wikis, online video…

Increase in Talent Management Capabilities


Employee profiles, job descriptions, performance management,
succession planning, HIPO selection, manager/employee portals,
assessment, recruiting, applicant tracking, internal recruiting,
compensation, workforce analysis, career planning, candidate
selection, competency analysis, skills-gap analysis,
integration or building of HRMS,interface to external data sources

Today’s LMS Systems

Copyright © 2007 Bersin & Associates. All rights reserved. Page 67

You might also like