Sap Tao Customer Facing Deck

Getting Started with SAP Test Acceleration and Optimization
Discussion Current Approach and Challenges SAP TAO NextGen E2E Biz Process Testing Stack Demo Case Study and ROI Getting Started with SAP TAO Packaging Summary and Core Value Proposition Discussion and Next Steps
Discussion On Landscape and Quality Process

Discussion Areas Topics (not exhaustive)
Production Version of SAP
Application Landscape
Number of production instances User base On going change process Undergoing / Planned major change events : Upgrades, migration etc. Testing Process / Strategy Types of testing followed
Test Strategy
Automation capabilities Traceability to requirements and test case management Test data generation and management
People & Integration
Integration with Solutions Manager Various testing and QA roles and skill sets
Mercury QC, LoadRunner etc
Tools Used
eCATT, CATT, TWB, TDMS Other tools: GoldClient, Gamma InfoShuttle etc.
SAP AG 2007, Title / First Name Last Name / 3
Historically Strong Partnership
Platform R&D
Application Platform development using LR & QTP for testing of service enablement platform components
Products & Technology

ES Ready Titan ES Community Founder BPT Accelerator joint R&D Internal Use:
App Server team KM team EP team Tech Ed sites SDN
SAP Hosting & IT

SAP Hosting using LR and BAC to ensure end user performance of customer environments SAP IT monitors SAP Corporate Portal with BAC
Field Operations
ASAP Performance Methodology SAP LR Reseller
US Canada EMEA
Active Global Support

Go Live Check for Enterprise rollout using LR SAP AGS distributes LR with NetWeaver Joint task force
In Process:
EMEA, APAC, Latin
America
Peter Zencke
Shai Agassi
Claus Heinrich
Leo Apotheker
Gerhard Oswald
Over 1450 Customers have successfully deployed SAP with HP Software solutions.
IT Agility Drives Business Agility Application Performance Impacts Business Outcomes
Accelerate Release Cycle Times
Mitigate Risk To Mission Critical Applications
Ensures Positive Customer/ End-Users Experience
Testing Recommendations
Assess the state of your test model early in the project to understand gaps
Deliverables out of Blueprinting should include inventory of test scripts and approach/effort of scripts that need to be built
Prioritize scenarios and scripts in your test model

Distinguish among critical, medium, and low priority business functionality
Involve business users early and often

Secure business user participation early in Integration testing to increase later User acceptance; cross train participants to deliver Upgrade training
Leverage a testing tool, particularly if youre doing much regression testing or performance testing
Select a core set of scripts to maintain that test your important functionality
Pressure on End to End Quality Is Increasing..
N HA
GE
CH
Line of Business
AN
GE
Simplify my P2P process Guarantee SLA Add new functionality at least cost and business risk
CIO
Ensure critical coverage of key processes at least cost Run IT like Business
Quality Assurance
Be adaptable to the changes and delays caused by development
Development
We can only participate Ensure that changes dont brake your processes Major Changes: Upgrades, Migration limited amount of time for Minor Changes: Patches, Hot Packs testing
Business Users Partners / Outsourcers
Software Vendors
CHANGE
.Leading to 3 Key Quality Imperatives

Key Imperatives Of Application Quality
Quality Assurance
1
Efficiency
Simplify my P2P process Guarantee SLA Add new functionality at least cost and business risk Be adaptable to the changes and delays caused by development Ensure that changes dont brake your processes (Upgrades, Migration, Support packs, enhancements etc) We can only participate limited amount of time for testing Ensure critical coverage of key processes at least cost Run IT like Business
2 Risk/
Coverage
3
Effectiveness
Testing Effort Over The Life Cycle Of Enterprise Apps is Large and Mostly Manual Life cycle of enterprise apps
e l y ay rg Tod La al nu Ma
Testing effort
Effort
Enhancements
New Implem. Minor Release

Large, Discrete projects
Bug fixes
Hot Packs
Maintenance projects
Small, Contained projects
Consolid. Upgrades Time Large, Discrete

projects
Lots of net new testing and test case generation, Regression in case of 100% technical upgrade
Mostly testing with scenario variation and regressions. Limited net new test cases
Largely regression testing effort, very minimal to no new test cases.
Lots of net new testing and test case generation, Regression in case of 100% technical upgrade
Mini Case Study: O2C Testing Using Traditional Approach The Scenario
Create Sales Order
Create Delivery
Create Transfer Order Create Billing Document
Change Delivery
Confirm Transfer Order
Post Goods for Delivery
Display Sales Order
Mini Case Study: O2C Testing Using Traditional Approach The process
Tester picks test cases in Test Support System (ST1) Solution Manager
Testplan Testcases
Tester tests according test case description ICT IWT IST
Tester maintains the test status in ST1 on test case level Solution Manager
Testcases Status
In case of test error: Tester notices error and creates IT/BC message
Add feedback to IT/IBC ticket & dispatch back to dev. 1st level support dispatches message to developer
No
Tester retests
Developer notifies in IT/BC message result of bug fixing
Error repaired? Tester closes IT/IBC message and changes test status in ST1
ICT IWT IST
Developer fixes bug
Yes Repetitive, No Reuse, Time Consuming
Business Impact Of Sub-Optimal Testing
Customer Testing Reality

Effectiveness
Problems Today
Customer Quotes
Business Consequence
I do not want to spent a lot What do I have to test of time to maintain test Backlog accumulation: No systematic of after the import cases after I installed a the bottleneck for change Testing understanding of what to support packages? Demand for change is 2-3x what can be support package!
test & how much to test
accommodated2
Risk/Coverage
Risk exposure: Test-Process usually Changes often go into production starts late and gets It is too time consuming to validation increasing complete squeezed resulting in cover all w/omission my business disruption risk Test analysis must guide insufficient coverage critical business
me on what to do when a test failed! processes with Capacity constraint: automated tests!
I have to ensure that my mission critical business processes work after the R/3 ERP upgrade
Efficiency
Majority of customers use - Ability to execute on business costly/ labor-intensive How can I create demand I do not have enough Testfor change is severely automated test manual testing challenged Tool Experts to create all Minimalpossible? of tools usage
cases as fast as the tests that I need!
Testing accounts for 30-60% of change effort & Impacts CIOs budget
How can I report the test status about my critical business processes?
SAP Test Acceleration and Optimization Next Generation End to End Business Process Testing Solution Stack
Definition of Business Blue Print, End to End LCM
Accelerated Testing Services Solution Manager

SAP certified services to jumpstart the solution
Accelerated Testing Solution

SAP Specific Test Components
Quality Center Suite

Next Generation Testing Infrastructure
SAP Test Acceleration And Optimization
End To End Business Process Testing Solution Stack 3
Documentation for Intelligent backend UI Scanner Services Accelerated Testing based setting up agent that generates
test components
test component generator
Test Data Management Systems
Best Practice Guidance Test Acceleration and Optimization On Semi-Automated Test Component Creation Test Data Management
Automated Test Component Creation

Quick Test Professional Functional Testing Runtime
(Scripts, Record & Play back)
Quality Center / Test Director Business Process Testing Extension Maintain, Manage Test Components
Overall Quality Framework and Dashboard
SAP Test Acceleration And Optimization

Application Overview SAP TAO Application
Upload test components to HP QC 2 Compose Test Cases
Automatically create test components
Customer SAP System

SAP TAO Agent Transaction 1 Transaction 2 Transaction Transaction 1xx
Background inspection of SAP Transactions for test component creation

Dynpro 100 Dynpro 120 Dynpro plus 80 more Dynpros
Run automated test against SAP System
Automated Test Component Creation- Inspector Approach TAO Inspection Creation of Test Components
TAO Inspection
Test Case = Test Components + Process Flow Test Script Analysis of all User Interfaces of SAP Transactions (SAPGUI): Input fields, output fields, action buttons Automatic creation of TAO Test Components = building blocks for TAO Test Cases
SAP TAO
TAO Inspector
TAO Test Component Repository ME21Test Components Test Component 1 = Meta data of Dynpro 100 Test Component 2 = Meta data of Dynpro 120 Test Component 3 =
SAP System
TAO Agent
Transaction ME21 Create Purchase Order

Dynpro 100 Dynpro 120 Dynpro
SAP Data Dictionary SAP Data Dictionary
plus 80 more Dynpros
Automated Test Component Creation- UI Scanner Approach UI Scanner Creation of Test Components
UI Scanner
Test Case = Test Components + Process Flow Test Script On-the-fly analysis of running screen (SAPGUI): Input fields, action buttons Creation of TAO Test Components = buidling blocks for TAO Test Cases
SAP TAO
1 activate TAO UI Scanner
TAO Test Component Repository
TAO UI Scanner captures User System interaction
SAP System
2
plus any more Dynpros
User executes Transaction ME21
Test Data Management (TDM) Best Practice Guidance SAP TAO provides best practice guidance on how to use existing TDM solutions
Test Data Management Applications

Available TDM solutions: SAP TDMS, etc. Data in scope: configuration, customizing, master data, transactional data Data reduction approach: - Select already executed transaction and derive dependent SAP objects - Restrict transactional data to sepcified time intervall or org.units
Production System Production System

TDM app: select data TDM app: select data
Test System Test System

TDM app: import data TDM app: import data
Customer SAP System Landscape
SAP TAO Next Gen : Change Impact Analysis* and Test Component Adaptation
SAP TAO
Analysis of SAP System Changes

Analyze changes applied to SAP system and derive list of affected SAP objects (Transactions, UIs, Programs)
Source for Analysis

Check transport order via test import or after import
Results
Detailed list of changed SAP objects (Transactions, UIs, Programs).
Update Test Components

Test Cases TC 001 TC 002 TC 500
Analyze Change Impact 3
Rerun affected Test Cases
Customers SAP Solutions

System Change
(Transport Order)
Development Development System System
Test Test System System
Productive Productive System System
* Limited Expert Only Feature
Typical Customer purchasing SAP TAO Test Automation

Customer want to create automated test cases for their top 80 business processes resulting in 300 test cases Effort for manual test case creation is not acceptable Customer requires a tool to speed up this process
Changes to SAP Solution

Customer want to apply SAP Support Packages as well as their inhouse developed SAP processes to the SAP system landscape on a regular basis. Not knowing what kind of impact these changes have on their most critical business processes is too risky Customer requires a tool to understand what t-codes have changed for a given change
Test Data Management: Customer wants to be effective with creation and management of T-systems
Solution Demo
Client
SAP Test Accelerator Mercury Server (QC, QTP) SAP Solution Manager
ERP ERP
R/3 R/3
CRM CRM
Systems with SAPGUI Development System Test System Production System
Customers SAP Solutions
SAP Test Acceleration and Optimization Accelerate End to End Business Process Testing P2P
Testing Process
Purchase Requisition Purchase Order Goods Receipt Invoice Processing Payment Process
Generate
Compose Test Cases
Execute Test Cases
Test Components
SAP Test Acceleration and Optimization Solution
Accelerated Testing Services Test Acceleration and Optimization
Path Towards Test Acceleration Step 1: Generate Test Components

1
Generate
Compose Test Cases
Execute Test Cases
Test Components
Scope the t-codes that you want to test Automatically inspect, learn and generate components for t-codes Consolidate components Upload components to HP Quality Center
Path Towards Test Acceleration Step 2: Compose Test Cases

1
Generate Test Components
Compose Test Cases
Execute Test Cases
Create test suite to test target test scenario / requirement Compose test cases Add test data to the components
Path Towards Test Acceleration Step 3: Create and Run Test Set
1
Generate
Compose Test Cases
Execute Test Cases
Test Components
Select and collect all the relevant test cases Build a test run set Assign data sets for multiple regressions Run the test set
Overall Process Flow With Solution Manager And Quality Center
Application Lifecycle
Project Prep Blueprint Realization Final Preparation Go Live and Support Continuous Improvement
Tools
SAP Solution Manager
Quality Management
Biz Req Test Requirements Test Plan Business Test & Components Test Cases Test Set Defects
Tools
Quality Center
Test Acceleration
Inspect UI Scanner Test Data Best Practice Business Test & Components
Tools
SAP TAO
Honeywell Automation and Control Solutions (ACS) Implemented TAO Services to Improve Efficiency and TCO
Company / Business unit Location Industry Products/Services Revenue Employees Web Site SAP Solutions and Services Honeywell Automation and Control Solutions Minneapolis, MN, USA Aerospace and Defense Sensing and Control Products $11B 40,000+ www.honeywell.com/sites/acs/ ECC 5.0, SCM/APO, SRM, BI, Solution Manager 20,000 users, 155 business scenarios, 1450+ business processes, 1100+ unique transactions Partner Focus Frame Inc
Build andcomes to application delivery, theres When it Run Time Comparison (minutes): Before and After Accelerated Testing no alternative to an automated, managed 138 testing process.
Terry L. Kolz 98%
25.71
ACS CP/S Transition Manager, 3 Honeywell International Build Time per business
component
97%
0.71
Run Time Per T-Code
Challenges and Opportunities

High post production support costs due to defects not caught during testing Resource drain on testing due to constant changes to large and complex application landscape with global footprint
Why TAO Implementation?

Current automation techniques were inadequate Deep process knowledge Supports ACS long-term testing strategy
Objectives
Build once and test using many reusable components Faster and automated test execution & efficient use of test resources Simpler, self-identifying maintenance Reduced post production support cost - discover defects earlier
Benefits
Honeywell ACS met their KPIs in their first rollout Achieved Cost Savings, Improved Efficiency and Quality ~45% reduction in business process test build and run times Continual reuse, Discover defects earlier, Efficient user of test resources
Implementation Highlights
Honeywell formulated a comprehensive automation strategy and established clear ROI expectations. Piloted the TAO implementation services for 20+ T-Codes Used TAO to over 100 transactions in their first roll out Currently planning to scale up TAO to all major transactions
ROI with TAO Solution (1/3) Acceleration Factors

Application Lifecycle Methodology
Project Prep Blueprint Realization Final Preparation Go Live and Support Continuous Improvement
Test Phase
Methodology
Plan
Analyze Landscape Setup Baseline scenarios Analyze scenario variations Apply criticality Define scope test scenarios Yes N.A. Yes Pre-defined base lines for mega processes Template driven criticality score cards Test requirements in QC
Construct
Identify Tcodes Generate components (PFA or UI scanner) Assign data Compose Test cases Consolidate Test Cases Yes Yes Yes Test by composition Parameterization Integration points tested by custom QTP scripts 10 Weeks
Execute
Create Test Run Set Set regression data sets Run Tests
SAP TAO Services SAP TAO SAP QC by HP Acceleration Drivers
Yes Yes Yes Automated runs Automated data set selection for multiple regression 6 Weeks
Traditional Testing = 20 Weeks Acceleration Factor Accelerated Testing = 11 Weeks (45% shorter)
4 Weeks
30% 2.8 Weeks
30% 7 Weeks
80% 1.2 Weeks
ROI With TAO Solution (2/3) ROI In 2 Cycles Of Testing
TOTAL EFFORT (Hours) PER APPROACH

900 800
Aggregated Effort (hours)
(Assumption: 35 Business Processes)

Manual
700 600 500 400 300 200 1 2 3 4 5 6 7 8 9 10

# of Test Cycles
QTP
SAP Test Accelerator
SAP Test Accelerator ROI with 2 test cycles QTP ROI within 6 test cycles
ROI With TAO Solution (3/3) Example Economic Model

ROI Compared to Manual Testing
(Cash Flow in $K) NPV = $807K IRR = 145% (4 yr period) Payback ~ 9 months
$1,134 Cumulative Cash Flow
$480
$480
$480
$-307
Customer Example: Large Defense Co - Accelerated vs Manual Testing
$1,400,000
$1,200,000
$1,000,000
Manual
$800,000
$600,000
$400,000
Accelerated
$200,000
$0 1 2 3 4 5 6 7 8 Time in Months 9 10 11 12 13 14 15
ERP Rollout CRM Rollout

Upgrade to mySAP
HP & SAP: Reducing Time and Cost of Testing
Cost Time Quality

Manual Testing With Scripting With TAO
Effort
Less Risk
Package to Accelerate End to End Business Process Testing
Incremental Accelerated Testing ServicesServices Quick Start Services Implementation Services
Test Acceleration and Optimization
Path towards Test Acceleration Phase 1 Quick Start Services 1 Quick Start 2 Implementation 3 Incremental
Services (Required) Services Services
(Required)
Project Kickoff, Installation & configuration

QC/QTP Install QC/QTP Configuration QC/QTP Dashboard Customization (if applicable) Network/Application Access QC/QTP Validation & Operability
Training & User Enablement

Train Users on QC Usage Train the Trainer (if needed) Train Users on BPT-TAO Train System Administrator Develop FAQ and Run Books
Discovery
Review & Validate Business Processes Develop Best Practices for Test Case & Test Data Design Organize Tests Cases into Prioritized Scripts for Development & Execution During Implementation Phase
Tasks
Customer Ask
Building Access/Security Required SAP TOI (policies, rules) Workspace Systems & tools access
Key QA User Designated System Administrator Designated Desired Documentation Format
Access to Customer Business Analyst Access to Customer Project Manager Access to Business Processes & Existing Test Scenarios
Deliverables
Software & Product Environment Stabilized and Confirmed
Users Trained System Administrator Trained FAQs & Run Book Delivered
Validated High-Level Business Processes Best Practices Templates for Test and Data Creation Next Step Proposal for Design, Construction, Execution and Incremental Services for Realization
Quick Start Services 2/3 weeks elapsed time, 1-2 Resources, $30K
Path towards Test Acceleration Phase 2 Implementation Services

1
Quick Start Services
Implementation Services
Incremental Services
Test Case Design

Create Detailed Test Component Groupings Formalize Test Organization, Schedules & Flows Define Test Sequence Design Defect Mgmt Process
Test Case Construction

Create & Refine All Scripts & Scenarios Create & Document All Test Cases in Quality Center Script Validation to Insure Business Process Coverage Install Component Libraries Using Design, Use TAO to Develop end-toend Business Process Automated Scripts
Test Case Execution

Execute All Test Created During Construction Phase After One Test Cycle, Validate Completeness Insure Operability with the QC Environment Maintain Results & Reports in QC
Analysis & Close out

Document & Share Results of Executed Tests with Customer Validate that the BPT Components are Aligned with Desired Functional Outcome Complete Any Outstanding Tasks Complete Final Project TOI Discuss/Propose Incremental Services Customer Sign-off Responsible POC to Transfer Knowledge
Tasks
Responsibility
Provide SAP Test Design & Test Data Environment Customer Team Members to Shadow Design for on-going Continuity
Access to Test Environment Sign-Off on Test Script Execution Customer Team Members
Access to Test Environment Sign-Off on Test Cycle Execution Customer Team Members
Detailed Test Design
Completed Test Scenarios BP test Scripts Script Library Test Environment Readiness
Executed Tests & Reports Final & Stable Test Library
Documented defects Completed TOI Enablement of Customer Ownership Proposal for Any Incremental or Sustaining Services
Deliverables
Defined test Requirements Test Script Design Documentation Test Script Scenarios
Implementation Services 3-15 weeks elapsed time, 3 Resources, $150K - $400K Cased on Complexity (Small, Medium, Large)
Path towards Test Acceleration Phase 3 Incremental Services 1 Quick Start 2 Implementation 3 Incremental
Services Services
Performance Tuning Custom Services Further Functional Testing
Services
Tasks
Fewer Tests because of manual approach No assurance on coverage
Responsibility
Deliverables
Pricing
Implementation Services Pricing
SAP TAO Pricing
HP Tools Pricing
SAP Test Acceleration and Optimization At a Glance
Why?
To fundamentally change the testing paradigm from manual testing to Testing by Composition thereby significantly reducing the costs and risks for all system change events like upgrades etc
Key Benefits
Lower risk due to better testing coverage and assurance
What?
Comprehensive End to End Business Process Testing Solution that (1) accelerates testing of your business processes and (2) is fully aligned with ASAP and Solution Mgr. Runs on top of SAP QC by HP suite
Improved testing ROI from cycles
How?
Install the solution and build test cases using (1) Bulk Generated components or (2) Components generated on demand. Once created, these highly reusable components are easily composed to form test cases. These components are maintained and managed in the QC framework
Increased capacity to absorb and manage change
Tighter Integration with QC and Solutions Manager
When?
Ramping up on June 15 2007 Jump start today through TAO implementation services
APPENDIX
ROAD MAP
SAP TAO Road Map
SAP TAO Rel.1 Ramp-up Q2 2007
SAP TAO Rel. 2 Ramp-up Q4 2007
SAP TAO Rel. 3 Ramp-up Q4 2008
SAP TAO Release 1 Test Composition: Automated test component creation Supported SAP Releases: 4.6c, ERP 04 / 05 Automatic Upload of Test Components Mercury QC Test Data Management Guidance on how to use Test Data Management applications
SAP TAO Release 2 Test Composition: Automated test case composition Compliance Testing Module (*) SOX Controls Testing Suite I Test Validation Validation RFCs for top P2P and O2C processes Change Detection & Adaptation Trigger automatic adaptation based on change detection
SAP TAO Release 3 Test Composition: All major SAP UIs supported Best Practice Content (*) Validations for SAP App.Data Change Detection & Adaptation (*) SAP SolMan Integration Test Data Management (*) Test Execution Data compilation Advanced Analysis (*) Root Cause Analysis Compliance Testing Module SOX Controls Testing Suite II FDA (*)
(*) tbd

Sap Tao Customer Facing Deck

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Sap Tao Customer Facing Deck

Uploaded by

Copyright:

Available Formats

Getting Started with SAP Test Acceleration and Optimization

Discussion On Landscape and Quality Process

People & Integration

Mercury QC, LoadRunner etc

SAP AG 2007, Title / First Name Last Name / 3

Historically Strong Partnership

Products & Technology

SAP Hosting & IT

Active Global Support

SAP AG 2007, Title / First Name Last Name / 4

IT Agility Drives Business Agility Application Performance Impacts Business Outcomes

Accelerate Release Cycle Times

Mitigate Risk To Mission Critical Applications

Ensures Positive Customer/ End-Users Experience

SAP AG 2007, Title / First Name Last Name / 5

Prioritize scenarios and scripts in your test model

Involve business users early and often

SAP AG 2007, Title / First Name Last Name / 6

Pressure on End to End Quality Is Increasing..

Be adaptable to the changes and delays caused by development

Business Users Partners / Outsourcers

SAP AG 2007, Title / First Name Last Name / 8

.Leading to 3 Key Quality Imperatives

New Implem. Minor Release

Small, Contained projects

Consolid. Upgrades Time Large, Discrete

Largely regression testing effort, very minimal to no new test cases.

SAP AG 2007, Title / First Name Last Name / 10

Create Sales Order

Create Transfer Order Create Billing Document

Confirm Transfer Order

Post Goods for Delivery

Display Sales Order

SAP AG 2007, Title / First Name Last Name / 11

Tester tests according test case description ICT IWT IST

Developer notifies in IT/BC message result of bug fixing

ICT IWT IST

Developer fixes bug

Yes Repetitive, No Reuse, Time Consuming

SAP AG 2007, Title / First Name Last Name / 12

Business Impact Of Sub-Optimal Testing

Customer Testing Reality

test & how much to test

SAP AG 2007, Title / First Name Last Name / 13

Accelerated Testing Services Solution Manager

Accelerated Testing Solution

Quality Center Suite

SAP AG 2007, Title / First Name Last Name / 15

SAP Test Acceleration And Optimization

End To End Business Process Testing Solution Stack 3

test component generator

Test Data Management Systems

Automated Test Component Creation

Quality Center Suite

Overall Quality Framework and Dashboard

SAP Test Acceleration And Optimization

Upload test components to HP QC 2 Compose Test Cases

Automatically create test components

Customer SAP System

Background inspection of SAP Transactions for test component creation

Run automated test against SAP System

SAP AG 2007, Title / First Name Last Name / 17

Transaction ME21 Create Purchase Order