You are on page 1of 60

Transformation Experience Management (TXM)

Mitigating your Implementation Risks


SAP Activate

INTERNAL
Instructions | How to Use this Accelerator

1. Read the “Introducing the Experience Economy & XM” Accelerator, located in the Activate
Roadmap Viewer.

2. Review this deck from end-to-end.

3. Set up your relevant XM organization (stakeholders, process, technology) to support the


recommendations provided in this accelerator, if you haven’t already done so.

4. Refer to the relevant Hyperlinked section, when seeking instruction on a particular survey
during the Activate implementation.

5. Open the “Transformation XM_Survey Questions” accelerator, located in the Activate


Roadmap Viewer, to support development of surveys for each phase of the S/4HANA
implementation.
Index for Using “Transformation XM” Accelerator | Hyperlinked

Transformation XM | Overview Transformation XM | S/4HANA Implementation


s
• Readiness Assessment
• Program Goal Alignment
• Project Performance
Transformation XM | Projects wit • Solution Validation
h Activate
• Readiness for UAT
• Training Satisfaction
• Tracking Goals
• Solution Performance

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 3


Transformation XM | Overview
In the context of Projects and Transformations
Projects & Transformations | The challenge
Limited information undermines project management capability

Challenge
Ensure project success on a large, complex, technology
implementations by accessing relevant and reliable data,
to mitigate risks such as:

+ Cost overruns
+ Missed timelines
+ High project team turnover
+ High end-user burnout
+ Sub-optimal solution design
+ Low end-user satisfaction or adoption

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 5


Projects & Transformations | The solution
Integrate Transformation Experience Management (TXM) throughout each project
Solution
Combine continuous stakeholder feedback with
operational data from an IT transformation, enabling
project leads to use real-time behavioural insights
analysis to:

+ Assess and prioritise project risks.


+ Focus resources on areas of weakness.
+ Adapt learning and enablement materials.
+ Maximise end-user satisfaction and adoption.
+ Renegotiate budget or timelines with sponsors
and implementation partners using real data.

This proactive management framework provides


the best chance for new technology and service
rollouts to deliver expected business outcomes
on time and on budget.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 6


Key Outcomes | When TXM is integrated into projects

1 4
Ensure projects stay on track/in scope by Unlock new budgets and resources for
proactively managing project clarity and strategic, transformational projects by
goals, confidence and risk, enabling real- demonstrating their impact on employee
time course corrections and mitigating productivity, engagement, and ultimately the
missed deadlines or errant customizations. top and bottom line.

2
Maximize limited project resources and
Drive confidence and trust across project
teams in order to promote collaboration and 5 extend your investments by activating and
the employee voice throughout
resilience through potential change or
setbacks. implementations.

Confirm functional and technical designs


3 Improve change management, enablement
and end-user adoption by incorporating 6 meet the needs of users, in advance of
build.
employee insights into project rollouts early
and often.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 7


Projects & Transformations | When to apply Transformation XM

When to Listen:
+ Long-term implementation projects with dedicated resources and teams

Listening Cadence:
+ Throughout the lifecycle of the Software Implementation / Transformation project
+ Touchpoints specifically focused:
○ Transitions between major project phases
○ Project Charter
○ Solution Validation
○ User Acceptance Testing
○ End User Trainings
○ Post Go-Live

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 8


Transformation XM | Core Activities Overview

Plan & Prepare Listen & Understand Act

● Identify the team members & ● Deploy pulse listening surveys ● Utilise dashboards along key phases
stakeholders involved in your and during reviews to adjust styles
● Review & interpret results together
transformation / implementation project and priorities, supporting appropriate
● Share feedback via role-based governance and maintenance of the
● Enable Core Teams (Customer &
dashboards with key stakeholders teams.
Service Partners) and sponsors to
understand quick insights from pulse ● Implement corrective actions where
surveys needed.
● Customize survey content
(Note: Start with our pre-built
Transformation template and tailor to
your project needs)
● Establish communications plan for end
users
● Gather distribution lists for core team
and end users
● Set up role-based dashboards

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 9


Transformation XM
Projects with Activate
Projects with Activate | Standard Transformation XM Use Cases

OBJECTIVE XM ACTIVITIES TYPES OF PROJECTS AND


TRANSFORMATIONS
+ Manage project effectively to ensure: + Gather experience feedback across
o Business outcomes are realised. o Multiple teams + SAP S/4HANA transformation
o High adoption of, and satisfaction o Touchpoints + SAP SuccessFactors implementation

with, the project outcomes by end o Phases


+ Any large software implementation

+ Analyze feedback for insights


+ Any multi-country or multi-siloed project
users.
with disparate teams, KPIs and individual
o Delivery is on time and on budget. + Take actions, where weaknesses have objectives.
o Project team’s needs are met been identified, to enhance project
throughout the implementation. outcomes.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 11


Projects with Activate | Transformation XM ‘Listening posts’

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Point-in-time feedback: Monitor phase-related feedback at project quality gates and key stages
Periodic feedback: Create a feedback baseline that is continually monitored throughout the project

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 12


Projects with Activate | TXM Stakeholder Groups
ACTIVATE GROUP AUDIENCE WHO ARE THEY?

Project Sponsors & Executive representatives accountable for the budget and successful
Stakeholders
Steering Committee implementation. 

The Customer project management team (Project Manager, OCM, HR etc)


Core Project Team Customer team (PMO) responsible for budget, change management and successful implementation
activities.

Service Provider team Service Provider PM and any consultants supporting Organisational Change
Core Project Team
(PMO) Management (strategy and framework) or Business Transformation Office activities.

Customer experts familiar with the business requirements or technology


Customer Subject requirements for a particular business process; charged with defining the
Supporting Roles
Matter Experts (SMEs) configuration of a portion of the new solution (or integrations) with the Service
Provider.

Service Provider Business Analysts and Technical Experts working with the Customer SMEs and
Supporting Roles
Experts their PMO to deliver the new system to the end users.

Trainers and
Supporting Roles Experts developing content and programs to support UAT and End-User Go-Live.
Enablement

Stakeholders UAT Testers Employees from across the business asked to carry out user acceptance testing. 

Stakeholders End Users Entire population of End Users that are required to adopt the solution from Go-Live.
© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 13
Projects with Activate | Important TXM Data to Visualize

+ Clarity of Desired End-State + Feature Expectation Gaps


+ Process & Meeting Effectiveness + Project Risk Indicators
+ Trust & Confidence in team members + Ease of Technology Use
+ Burnout risk (End-User Metric)
+ Product Satisfaction (End-User Metric)

Typically available via HRIS, ticketing systems or telemetry data from applications. Can also be captured in assessment:

+ Project Phase, Role/Job Title, Internal/External, Division, Date


+ Project Milestone & Risk Status
+ Project Costs vs Budgets

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 14


Transformation XM
S/4HANA Implementations
S/4HANA Implementations | TXM listening posts
Start of Prepare During Explore Realize Deploy
Readiness Assessment Solution Validation Readiness for UAT Tracking Goals
Core Team, Relevant SMEs Relevant SMEs UAT Testers Core Team, Relevant SMEs

Explore, Realize & Deploy


Project Performance
Run
Core Team, Relevant SMEs
Solution Performance
Core Team, End Users,
Relevant SMEs

Deploy
Training Satisfaction
UAT Testers & End Users
Start of Explore
Program Goal Alignment
Core Team + Sponsors

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 16


S/4 HANA Implementations | TXM Surveys across Phases

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 17


S/4HANA Implementations | TXM Survey Distributions per Stakeholder Group

Customer SMEs Service Provider


Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 18


Transformation XM
Survey Details
Readiness Assessment | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To assess readiness as the team starts to EXPLORE requirements

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 20


Readiness Assessment | Description
SAP Activate
Phase
During PREPARE Description

Aim Readiness Assessment The purpose of this task is to capture the project team’s feedback
following the DISCOVER phase and initial project preparation
Audience + Customer PMO and Customer SMEs activities of the PREPARE phase.

This is a crucial step in establishing readiness and


Cadence + Point-in-time
preparedness for the fit-to-standard analyses and planning
activities.
Items + 8 questions
Its purpose is to safeguard success, check the right stakeholders
Survey + Transformation XM_Survey Questions Accelerator are involved, understand current user sentiment, as well as their
Location concerns and expectations.
+ Filter by “Readiness Assessment” on the Questions
tab
The Readiness Assessment is also the first round of feedback
Experience + Confidence to Meet Objectives collection, which will serve as a baseline throughout the S/4
Measures HANA Private Cloud transformation.
+ Team Trust (Credible, Responsive, Cohesive)
(Expected
Outcomes) + Team Process, Governance, & Empowerment
+ Clarity for definition of success
+ Transformation expectations
+ Open Text Sentiment Feedback: Areas of Opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 21


Readiness Assessment | Key Actions

SAP Activate Phase During PREPARE

Survey Name Readiness Assessment

Report Recipients + Customer PMO, Service Provider PMO, Project Sponsors & SteerCo

Following response collection and based on the dashboard results,


take the following corrective actions where needed:

+ Clarify lack of confidence to meet objectives.


+ If needed, communicate more clearly what the objectives are.

+ Evaluate reasons behind low trust in the team

Key Actions + Reconsider current setup for the team and governance as well as their sense of empowerment

+ Communicate and redefine the definition of success

+ Work through deviating expectations

+ Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of
opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 22


Readiness Assessment | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users
Customer/ Respondent
Readiness Assessment Partner Group R Y R Y      

Customer/ Respondent
Program Goal Alignment Partner Group R Y Y Y Y      

Customer/ Respondent
Project Performance Partner Group R Y Y Y Y Y    

Customer/ Respondent
Solution Validation Partner Group R R R Y R      

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Customer/ Respondent
Tracking Goals Partner Group R R R Y R      

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 23


Readiness Assessment | Example of Questions in a Survey
Program Goal Alignment | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To capture whether the team has clarity on the transformation and definition of success
following the PREPARE phase

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 25


Program Goal Alignment | Description
SAP Activate
Start of EXPLORE Description
Phase

Aim Program Goal Alignment The purpose of this Program Goal Alignment survey is to get
feedback on the Core Team’s cloud mindset adoption, and to
capture whether they have clarity on the transformation and
+ Customer PMO / Service Provider CMO / Customer SMEs / definition of success.  
Audience
Service Provider Experts
This survey also supports Organizational Change Management
Cadence + Point-in-time (OCM) efforts by providing insight into stakeholders’ views on
team process, governance and empowerment.
Items + 7 questions
The feedback gained will shed light on the core team’s current
engagement and sentiment before moving to the EXPLORE
Survey + Transformation XM_Survey Questions Accelerator phase. 
Location + Filter by “Program Goal Alignment” on the Questions tab

Experience + Confidence in scope and vision


Measures
+ Team Trust (Credible, Responsive, Cohesive)
(Expected
Outcomes) + Team process, governance, and empowerment
+ Clarity for definition of success
+ Open text sentiment feedback: areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 26


Program Goal Alignment | Key Actions

SAP Activate Phase Start of EXPLORE

Aim Program Goal Alignment


Following response collection and based on the dashboard results, take the following corrective actions where
needed:

+ Clarify lack of clarity on the transformation and the definition of success.


+ If needed, communicate more clearly what the objectives are.

+ Evaluate reasons behind low scores


Key Measures
+ Reconsider current communication approach

+ Communicate and redefine the definition of success

+ Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 27


Program Goal Alignment | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 28


Program Goal Alignment | Example of Questions in a Survey
Project Performance | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To assess what is working well and what needs improving to ensure the project team remains high-functioning.  

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 30


Project Performance | Description
SAP
Activate EXPLORE; REALIZE; DEPLOY Description
Phase
The purpose of the Project Performance survey is to collect the
Aim Project Performance
performance of each major project workstream throughout the
+ Customer PMO / Service Provider PMO / Customer Transformation Program. This includes the core project
Audience SMEs / Service Provider Experts / Trainers and management team and each team working to transform the
Enablement business processes of a ‘Line of Business’ (LoB).
+ Periodic (monthly for dispersed teams, quarterly
NOTE: for LoB teams (only), ‘Tracking Goals’ takes over this
Cadence otherwise) assessment, at that phase.

Survey + Transformation XM_Survey Questions Accelerator Each team will provide project team-related feedback in terms of
Location governance, processes and empowerment during the EXPLORE,
+ Filter by “Project Performance” on the Questions tab
REALIZE and DEPLOY phases.
Items + 4 questions
Throughout the transformation, it is important to continually gather
this type of feedback from the individual to ensure everyone is
Experience Continue: satisfied with how the project is going.
Measures + Team Trust (Credible, Responsive, Cohesive)
(Expected + Team Process, Governance, & Empowerment Furthermore, this survey assesses how they feel about topics
Outcomes) such as inclusivity, workload, the technology and equipment they
+ Open Text Sentiment Feedback: Areas of Opportunity
are using as well as the training they receive. The results of this
Begin:
survey will give an indication of what is working well and what
+ Team Resilience & Burnout Risk Checks needs improving to ensure the teams continually perform well.  
+ Technology fit

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 31


Project Performance | Key Actions

SAP Activate Phase EXPLORE; REALIZE; DEPLOY

Aim Project Performance


Following response collection and based on the dashboard results, take the following corrective actions where
needed:

• Clarify lack of team trust, governance, communication and process

Key Measures • Evaluate reasons behind low scores relating to resilience and burnout questions

• Invest in improving team health and spirit

• Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 32


Project Performance | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 33


Project Performance | Example of Questions in a Survey
Solution Validation | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To assess how well the EXPLORE phase scoping activities meet the customer’s requirements. 

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 35


Solution Validation | Description

SAP Activate
During EXPLORE Description
Phase

Aim Solution Validation The purpose of the Solution Validation survey is to keep
monitoring feedback provided by the Core Team about the
Audience + Customer SMEs team’s performance, clarity of goals, cloud mindset and other
factors influencing their experience during the transformation.
Cadence + Point-in-time
Moreover, this survey captures the Core Team and Subject
Survey + Transformation XM_Survey Questions Accelerator
Matter Expert feedback about the fit-to-standard analyses
and design as well as how well the EXPLORE phase scoping
Location + Filter by “Solution Validation” on the Questions tab meet the customer’s requirements. 
Items + 8 questions  
Experience Continue:
Measures + Confidence to Meet Objectives
(Expected
+ Team Trust (Credible, Responsive, Cohesive)
Outcomes)
+ Team Process, Governance, & Empowerment
+ Open Text Sentiment Feedback: Areas of Opportunity
+ Team Resilience & Burnout Risk Checks
Additionally:
+ Solution Build Fit (Customization vs. Fit-to-Standard)

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 36


Solution Validation | Key Actions

SAP Activate Phase During EXPLORE

Aim Solution Validation

Key Measures Following response collection and based on the dashboard results, take the following corrective actions where
needed:

• Clarify lack of team trust, governance, communication and process

• Evaluate reasons behind low scores relating to resilience and burnout questions

• Address discrepancies between expectations and solution build fit

• Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 37


Solution Validation | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 38


Solution Validation | Example of Questions in a Survey
Readiness for UAT | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To assess the team’s readiness for UAT.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 40


Readiness for UAT | Description

SAP Activate
During REALIZE Description
Phase

Now that the REALIZE phase of the transformation is


Aim Readiness for UAT
nearing go-live, this task will establish whether the team is
ready for the testing activities, based on their feedback.
Audience + UAT Testers
Apart from the continual monitoring of the team’s
Cadence + Point-in-time performance and clarity of goals, this survey asks about
testing confidence, preparedness, and planning.
Survey + Transformation XM_Survey Questions Accelerator
Location + Filter by “Readiness for UAT” on the Questions tab Corrective measures derived from the findings report will
allow stakeholders to ensure UAT runs smoothly and
Items + 9 questions within the designated timeframe.  
 
Experience + Readiness for UAT
Measures
(Expected + System Capability Depth of Understanding
Outcomes) + Readiness for System Ease Post Go-Live
+ Satisfaction with the training
+ Satisfaction with the solution

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 41


Readiness for UAT | Key Actions

SAP Activate Phase During REALIZE

Aim Readiness for UAT

Key Measures Following response collection and based on the dashboard results, take the following corrective actions where
needed:

+ Clarify lack of readiness for the UAT activities

+ Identify and address additional training needs

+ Evaluate reasons behind low satisifaction with the solution

+ Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 42


Readiness for UAT | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 43


Readiness for UAT | Example of Questions in a Survey
Training Satisfaction | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To safeguard adoption by end users and assess their satisfaction with training.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 45


Training Satisfaction | Description

SAP Activate
Phase
REALIZE Description

Aim Training Satisfaction In preparation for the DEPLOY phase, this task is to safeguard
the adoption of the solution by end users and assess their
+ UAT Testers
satisfaction with training content, activities, and time given to
Audience absorb the knowledge transfer.
+ End Users
Furthermore, the Training Satisfaction survey also asks
Cadence + Point in time (pre-UAT and post-trainings) participants about their opinion on the solution in terms of ease of
use, usefulness and whether they would recommend the solution
Survey (NPS).
+ Transformation XM_Survey Questions Accelerator
Location
+ Filter by “Training Satisfaction” on the Questions tab

Items + 5 questions

Experience + Satisfaction with the training


Measures
+ Enabled for UAT, cutover and go-live tasks
(Expected
Outcomes) + Satisfaction with the solution
+ System capability depth of understanding
+ Readiness for system ease post Go-Live

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 46


Training Satisfaction | Key Actions

SAP Activate Phase REALIZE

Aim Training Satisfaction

Key Measures Following response collection and based on the dashboard results, take the following corrective actions where
needed:

+ Identify and address additional training needs

+ Evaluate reasons behind low satisfaction with the solution

+ Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 47


Training Satisfaction | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 48


Training Satisfaction | Example of Questions in a Survey
Tracking Goals | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Solution


Tracking Goals
Alignment Performance Performance

Primary objective:
To assess whether the team is operationally ready for the cutover and go-live tasks.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 50


Tracking Goals | Description

SAP Activate
DEPLOY Description
Phase

The purpose of this survey is to assess whether the required


Aim Tracking Goals features and functions have been delivered and the team is
operationally ready for the cutover and go-live tasks at the
Audience + Customer SMEs beginning and again at the end of the DEPLOY phase.

The Tracking Goals survey further supports OCM activities and


Cadence + Periodic invites the respondent to give recommendations for
improvement. 
Survey + Transformation XM_Survey Questions Accelerator
The survey continues to assess project team health, process,
Location + Filter by “Tracking Goals” on the Questions tab governance and confidence in the solution.

Items + 6 and 5 questions, respectively It also assessed SME satisfaction with the implemented solution
and the quality of hyper-care.
Experience + Readiness for go-live and cutover tasks NOTE: This survey may need to be asked of SMEs more than
Measures once, if the first survey results show that UAT has been
(Expected + Project team health
unsuccessful and more work is required before Go-Live.
Outcomes) + Post Go-Live and hypercare
+ Satisfaction with the transformation as a whole
+ Satisfaction with the solution

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 51


Tracking Goals | Key Actions

SAP Activate Phase DEPLOY

Aim Tracking Goals

Key Measures Following response collection and based on the dashboard results, take the following corrective actions where
needed:

+ Address project team-related feedback

+ Evaluate reasons behind low satisfaction with the solution

+ Improve hypercare and post-go-live activities with low ratings

+ Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 52


Tracking Goals | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 53


Tracking Goals | Example of Questions in a Survey
Solution Performance | Overview

Readiness Solution Readiness Training


Assessment Validation for UAT Satisfaction

Discover Prepare Explore Realize Deploy Run

Program Goal Project Tracking Solution


Alignment Performance Goals Performance

Primary objective:
To collect feedback from end users regarding the solution, performance and support

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 55


Solution Performance | Description
SAP Activate
DEPLOY; RUN Description
Phase

This survey collects feedback about the End User’s


Aim Solution Performance impression of the solution, its performance and the
support activities following the Deploy phase.
Audience + End Users
In detail, the feedback identifies areas of improvement for
support delivered via different channels and the
+ Periodic, 4 and 8 weeks post Go-Live, then at least performance of support activities regarding speed and
Cadence every 6 months. stability. The results will offer important insight into how
the RUN phase can be improved.
Survey + Transformation XM_Survey Questions Accelerator
Location + Filter by “Solution Performance” on the Questions tab

Items + 5 questions

Experience + Success of implementation


Measures
(Expected + Satisfaction with solution (hypercare)
Outcomes + Performance ratings
+ Improvement sentiment and open text

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 56


Solution Performance | Key Actions

SAP Activate Phase DEPLOY; RUN

Aim Solution Performance

Key Measures Following response collection and based on the dashboard results, take the following corrective actions
where needed:

+ Evaluate reasons behind low satisfaction with the solution


+ Analyse hyper-care shortcomings
+ Analyse open text feedback and sentiment (ideally using text analytics) to identify areas of
opportunity

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 57


Solution Performance | Survey Distribution Groups
Customer SMEs Service Provider
Sponsors & Service (Bus. Process & Experts
O-Data: O-Data: Steering Customer PMO Provider Tech Experts, (Bus. Analysts Trainers &
Survey Level 1 Level 2 Committee (PMO, OCM) PMO Bus. Analysts) & Tech. Experts) Enablement UAT Testers End Users

Readiness Assessment Customer/ Respondent R Y R Y      


Partner Group

Program Goal Alignment Customer/ Respondent R Y Y Y Y      


Partner Group

Project Performance Customer/ Respondent R Y Y Y Y Y    


Partner Group

Solution Validation Customer/ Respondent R R R Y R      


Partner Group

Readiness for UAT Location Department R R R R R   Y  

Training Satisfaction Location Department R R R  Y   R Y Y

Tracking Goals Customer/ Respondent R R R Y R      


Partner Group

Solution Performance Location Department R R R R R   Y

This Respondent Group will take the survey. This Respondent Group does not take the survey.
Y They may receive reports, per PMO decision. R They may receive reports, per PMO decision, to assist with actions and improvements.

© 2022 SAP SE or an SAP affiliate company. All rights reserved. ǀ EXTERNAL 58


Solution Performance | Example of Questions in a Survey
Copyright

Follow us

www.sap.com/contactsap

© 2022 SAP SE or an SAP affiliate company. All rights reserved.


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/copyright for additional trademark information and notices.

You might also like