Professional Documents
Culture Documents
Workshop
Presented by:
1
BREAK FAST
2
Agenda EST 09:00 AM - 05:00 PM
8
IST 06:30 PM - 02:30 AM
hrs.
4
Test Management
Strategy
5
Testing Approach
• Identify Scenarios
• The Integrated (Boundary) Systems should be connected to SAP Quality System before
starting the SIT1 and SIT2
• Some external systems will be conducting SIT & UAT at the same time during SIT (ex. CTSI, Demand Solutions)
• End to End Scenario Test Data Selection Meeting - prior to SIT testing (tentative week of May
22)
• After post-upgrade remediations, we will run Automated Test Scripts - will need workstream
assistance in data preparedness
• The Test Data in TDC and Test Plan will be ready in Solution Manager before starting the
SIT1 and SIT2
• Execute Manual Test Scripts
• Capture Defects in the Solution Manager
• Publish Test Status
6
T e s t i n g S c h e d ul e w it h Ti m e l in e
Allocated
Testing Phases Cycle SAP System From Date To Date
Weeks
UT Cycle 1 SAP Development 05/01 05/12 2
Integrated Test Data Session for SIT & UAT 05/22 05/26 1
7
Ro l e s a n d R e s p o n s i b il it ie s
Project Activities Responsible Accountable Consulted Informed
Prepare Test Scenarios / Training
S2 & Avanos Functional Team S2 & Avanos Functional Team S2 & Avanos Testing Team S2 & Avanos Stakeholders
Materials
Review and Selection of Test Scenarios S2 & Avanos Functional Team S2 & Avanos Functional Team S2 & Avanos Testing Team S2 & Avanos Stakeholders
Updating of Test Scripts (new/changes) S2 Functional Team S2 & Avanos Functional Team S2 & Avanos Testing Team S2 & Avanos Stakeholders
Finalize Testing Strategy S2 Testing Team S2 Testing Team Avanos Testing Team S2 & Avanos Stakeholders
Unit Testing S2 & Avanos Functional Team S2 & Avanos Functional Team S2 & Avanos Testing Team S2 & Avanos Stakeholders
UAT - Coordination S2 & Avanos Testing Team S2 & Avanos Testing Team S2 & Avanos Functional Team S2 & Avanos Stakeholders
Confirmation of User Acceptance Testing S2 Functional Team S2 & Avanos Functional Team Avanos Business users S2 & Avanos Stakeholders
8
Test Data Strategy
9
T e s t M a n a g e m e n t P ro c e s s
• Test Management Process help for the testing the Test Scripts in 4 processes i.e., Test
Preparation, Test Planning, Text Execution and Test Reporting with the help of Business
Process Experts, Test Manager and Testers
10
Test Reporting
14
S I T 1 / S I T 2 - S i g n O ff
Test Script Types Test Scripts are considered as Automated and Manual Test Scripts for testing
• Identified Test Scripts aligned with Avanos
• Test Data Repository
Entry Criteria • SAP Quality System Access with required Roles
• Finalized Test Plan.( with Resource mapping )
• Results and Defects Tracking in Solution Manager
Test Data will be created in SAP System while performing testing and if the SAP Workstream requires to maintain the Test Data
Test Data
which will be created in Excel
15
UA T - S i g n Of f
Test Script Types Identified and finalized Automated and Manual Test Scripts by Avanos Business Users
• Identified Test Scripts aligned with Avanos Business Users.
• Test Data Repository
Entry Criteria • SAP Quality System Access with required Roles
• Finalized Test Plan.( with Resource mapping )
• Results and Defects Tracking in Solution Manager
Sign off Dean Bergman - (Director Operations Management and Finance Enablement Global IT Services)
16
Solution Manager -
Tools &
Documentation
17
T e s t M a n a g e m e n t O v e rv ie w
Solution Manager Test Suite
• It is complete Test Management application for manual and automated testing.
• Integrated with other Solman applications: Solution Documentation, Incident and Defects Management, Requirements
Management and Change Request Management.
Solution
Documentation
Change Request
Requirements
Management Test Management
Management
(ChaRm)
Defect
Management
(ITSM)
18
T e s t M a n a g e m e n t O v e rv ie w
Solution Manager Test Suite Capabilities
• Test Suite in SolMan supports test phases starting from Preparation, Planning, Execution till Reporting
• CBTA (Component Base Test Automation) tool will be used for Test Automation
19
T e s t P r e p a r a t io n
Solution Documentation - Test Case Assignment Options
• Test Cases will be assigned directly to process structures in Solution Documentation.
• Assign generic test cases to Process Steps in the Process Step Library (Process Step Original).
• Process specific test cases should be assigned to Process Steps Reference.
• End-to-End test cases should be assigned directly to the Business Processes.
20
T e s t P r e p a r a t io n
Solution Documentation - Test Case Types
• Manual Testing
• File Based - Word, Excel etc.
• Focus Build - Provides built-in tool to define test case - Test Step Designer.
• Automated
• CBTA (Component Based Test Automation)
21
T e rm i n o l o g y
Traceability Matrix Solution Manager - Test Suite
Cycle Test Plan
22
Test Planning
Overview
• Define scope of Test, define sequence, segregate scope in small packages and assign to Testers for execution
23
Test Planning
Test Data Container
• TDC is a central repository for all test data.
• It contains the information of parameters, attributes and variants used in test scripts.
• Test data stored in TDC can be used in multiple test scripts, it can be assigned to Manual and Automated Test cases
24
Test Execution
Test Execution - Basics
• Test Packages and Test Cases which are assigned to user can be viewed using Tester Worklist application.
• Test execution can be started if assigned test case status is ‘Ready to Test’.
25
Test Execution
Tester Worklist Application
• Tester Worklist is the application used by users to check the Test cases assigned to them for execution
• It shows Test Packages and Test Cases assigned to current user id, status, log and any defects created for Test case
• Test execution can be triggered from this screen
26
Test Execution
Documenting Execution Status and Results for Manual Test Case
• Test results can be documented on the Test Results tab.
• The starting point for Test Result creation is using the template in the system or a local file.
• Multiple Test Results can exist per Test Case execution.
• Create or attach a test results document from Test Results tab.
27
Test Execution
Documenting Execution Status and Results for Automated Test Case
• Once the automated test case execution is completed, it will automatically generate Test Result and its log
• It will show execution status report, click on Log in 'Link Log' column to access html report for execution details
28
Test Execution
Managing Test Defects
• Defect Management part of SolMan Incident Management tool supports reporting and processing of errors
encountered during test execution
• Test Defects can be created from ‘Tester Worklist’ or ‘Manual Test Case Execution’ screen
• Test Defects will then be processed through Incident Management tool
Testers Worklist
29
Test Reporting
Test Reports
• Various reports available for tracking progress of Test Preparation, Test Execution and Execution Progress
30
OVERALL
31
O v e r a l l Fu n c t i o na l Le a d s
Paul Karthikeyan
Martin Chellamuthu
32
P r o j e c t K a n s a s - T e s t i ng S c h e d ul e
05 Go-Live
04 UAT
Today
03 SIT 2 • Scenarios to be
selected by Business
02 SIT1 • SOLMAN for Script
execution
• Role based Testing
01 UNIT TESTING • Automated & Manual Testing • All Boundary
• SOLMAN in Scope systems in Scope
• Manual • Role based Testing for FIORI
Testing • All Boundary systems in
• SOLMAN not Scope
in Scope
• Automation
Testing
(possible)
• Open Access
• Boundary
system
(Minimum)
05 06 07 08 09 10 11 12
2023
33
F u nc t i o n a l A p p r o a c h
• Ensure it is prioritized for Testing • Validate roles with the GRC team
• Create New Test Scripts, as identified • Plan resources & support execution
34
Critical Processes
• Identified priority process to be covered in Testing / Functional processes
FIORI
Workstream Scenarios
(Priority A)
200
RTR 149 23
164
149
150
OTC 109 28
109
PTD 164 29 97
100
67
PTP 34 34
50
34
BPC 67 14
0
Vistex 97 3 RTR OTC PTD PTP BPC Vistex
35
F I O R I A p p s - S um m a r y
RTR
OTC
PTD
PTP
BPC
Vistex
0 10 20 30 40 50 60
36
RTR
37
RT R T e a m
38
RT R - T e s t S c e n a r i o s • Execution of Critical process based on
Priority
• Logging of defects for any issues identified
• Based on the lessons learned in sandbox
testing, ensure those issues are fixed and
tested thoroughly
39
RT R - I n t e g r a t e d T e s t S c e na ri o s
Workstream SIT UAT
SAP Concur 1 1
Citibank 1 1
JPM Chase BANK 1 1
MITSUBISHI BANK 1 1
HSBC BANK 1 1
BBVA BANK 1 1
BMG BANK 1 1
RBC BANK 1 1
US BANK 1 1
MUFG BANK 1 1
Vertex 1 1
High Radius 1 1
Axosnet (MX A/P) 1 1
Blackline 1 1
Thomson Reuters Fx 1 1
Total 15 15
40
RT R - I n t e g ra t e d ( B o und a r y ) S y s t e m s
Connected System Interface Type DEV QUAL Strategy with DS4
Validate employee output and inbound financial posting file - manually
SAP Concur RFC - -
(1 in and 1 out)
Citibank FILE FTP X Ingest inbound bank statement
Thomson Reuters Fx FILE FTP X Take a file manually and attempt to process inbound
41
RT R - F i o ri A p p s
25
20
Fiori Apps SIT UAT
New 9 9
Existing No - Change 13 13 15
Existing Changed 0 0
Existing Name Changed 1 1 10
Prioritization
Priority A 23 23
5
0
New Existing No - Existing Existing Priority A
Change Changed Name
Changed
SIT UAT
42
RT R - C ri t i c a l P r o c e s s e s
Supporting Process
Leading
Critical Processes
Module PTP OTC HR
RTR Payments
RTR Payroll
43
RT R - T e s t i n g Le a d s a n d T e s t e r
Testing
Testing Leads Testers
Phase
Todd
Akanksha
SIT Todd / Akanksha Harini
Yasmin
Bharath
44
Vistex
45
Vistex Team
46
V i s t e x - T e s t S c e na r i o s
• Approach to prioritize the critical processes
24.74% • Run the Chargebacks using the manual
claims approach
• Run the customer Incentives process
using the existing source data but new
agreements
• Run the price agreements maintenance
via master maintenance using Vistex UI
47
V i s t e x - Fi o r i A p p s
3.5
3
Fiori Apps SIT UAT
New 0 0 2.5
Existing - No Change 3 3
2
Existing - Changed 0 0
Existing - Name Change 0 0 1.5
Priority A 3 3
1
0.5
0
New Existing No - Existing Existing Priority A
Change Changed Name
Changed
SIT UAT
48
Vistex - Integrated Test Scenarios
• Below are the Test Scenarios identified for SIT and UAT for boundary testing
Integrated
SIT UAT
Scenarios by
Test Scenarios Test Scenarios
Workstream
Automated Manual Automated Manual
Vistex
00 07 00 07
49
V i s t e x - I n t e g r a t e d ( B o u nd a r y) S y s t e m s
50
V i s t e x - C r i t i c a l P ro c e s s e s
Supporting Process
Leading
Critical Processes
Module RTR OTC
51
V i s t e x - T e s t i ng L e a d s a nd T e s t e r
Ross Yerden
SIT Prasad Kanchu
IT - Vistex team (Avanos and S2)
Vicki Catt
Ben Waldhauer
UAT Veronica De Garde
Business users
Vittorio Pellizzari
52
LUNCH BREAK
53
BPC
54
BPC Team
55
BPC - Test Scenarios
56
B P C - I n t e g ra t e d T e s t S c e na r io s
Workstream SIT UAT
Power BI Report 1 1
57
B P C - I n t e g ra t e d ( B o un da r y ) S y s t e m s
58
B P C - F i o ri A p ps
59
BPC - Critical Processes
Leading
Critical Processes
Module
BPC Consolidation
60
BPC - Testing Leads and Tester
61
PTD
62
PTD Team
Lars Kalyan Karthikeyan Ali Surti Julie Browning Cheo Walker Dhaval Patel Ananthakrishnan
Rasmussen Kolaketi Pandiyan Udayasankar
Kalyan Ravi Maruthayya Srinivasulu Puli Aditi Bora Mohammed Shahinsha Prakash Nandakumar
Polamreddy Kumaran Maleswaran Padmaja
63
P T D - T e s t S c e n a ri o s
• Approach to prioritize the critical processes
• MRP Run in S4
• MRP through Demand Solutions
• Production Confirmation
• Picking and Packing for Shipment
SIT UAT
Critical 148 Critical 148
Non-Critical 62 Non-Critical 62
Automated Manual
Prioritization
SIT UAT Priority A 164 Priority A 164
Automated Manual Automated Manual Priority B 31 Priority B 31
29 181 29 181 Priority C 15 Priority C 15
64
P T D - I n t e g r a t e d T e s t S c e na r io s
Spec & Revision from EtQ to Ma & Quality hold inter 2 2
Total 25 25
• PTD APAC/EMEA 10900 N ZDSI- Demand Solutions Interface from S4 to DSX (Forecast)
• PTD APAC/EMEA 10901 N ZDSI- Demand Solutions Interface from S4 to DSX (Replenishment)
65
P T D - I n t e g r a t e d ( B o und a r y ) S ys t e m s
Boundary Systems Interface Type Dev QAS
66
35
P T D - F i o ri Ap ps
30
New 19 19 20
Existing 4 4
No - Change 15
Existing Changed 14 14 10
Prioritization
5
Priority A 29 29
Priority B* 8 8 0
New Existing No - Existing Priority A Priority B
Change Changed
67
P T D - C r i t i c a l P ro c e s s e s
Supporting Process
Leading
Critical Processes
Module PTP OTC RTR
PTD MRP
PTD TMS
68
P T D - T e s t i n g Le a d s a nd T e s t e r
69
PTP
70
PTP Team
71
P T P - T e s t S c e na ri o s
• Approach to prioritize the critical processes
SIT UAT
Critical 15 Critical 15
Automated Manual Non-Critical 55 Non-Critical 55
Prioritization
SIT UAT Priority A 34 Priority A 34
Automated Manual Automated Manual
Priority B 24 Priority B 24
29 81 29 81
72
P T P - I n t e g r a t e d T e s t S c e na r io s
ETQ to S4 Interface 7 7
Total 15 15
• Supplier Invoice are generated against the Purchase Order using Vendor Invoice Management (VIM)
73
P T P - I n t e g r a t e d ( B o un d a r y ) S ys t e m s
74
40
PTP - Fiori Apps
35
New 32 32 25
Existing No - Change 19 19
20
Existing Name changed 1 1
Existing Replaced 2 2 15
Existing Changed 4 4 10
Prioritization
5
Priority A 34 34
Priority B* 24 24 0
New Existing Existing Existing Existing Priority A Priority B*
No - Name Replaced Changed
Change Changed
SIT UAT
• 25 Standard Fiori Apps and 9 Custom Fiori Apps (including VIM apps)
• 12 Apps with create and changed functionality
• 9 Apps with Display functionality which is applicable and extended to other workstreams.
• *Priority B Apps to be included to Priority A based on Unit Testing (DS4)
75
P T P - C r i t i c a l P ro c e s s e s
Supporting Process
Leading
Critical Processes
Module ETQ VIM
76
P T P - T e s t i n g Le a d s a nd T e s t e r
Sharnesh Janani
SIT
Thomason Jr., Wili Suresh
77
BREAK TIME
78
Fiori
79
F io r i T e a m
80
Fi o r i / M a s t e r D a t a W o rk f lo w s
81
GRC/Security
82
S e c ur i t y T e a m
83
G R C / S S O - T e s t S c e na r i o s
• Below are the Test Scenarios identified for UT2, SIT2 and UAT
Scenarios by UT 2 SIT 2 UAT
Workstream Test Scenarios Test Scenarios Test Scenarios
To be picked
GRC
based on
00 75 00 75 00
availability of
testers
SSO 00 05 00 05 00 05
• There are no Fiori Apps or Integrated Test Scenarios with other process streams
• Systems included in the testing are GRC and S4
84
TEA BREAK
85
OTC
86
OTC Team
87
• Execution of Critical process based on
O T C - T e s t S c e na r io s
Priority
• Product Availability Check
• Credit Management
• Material Determination
• Pricing Determination
• Billing & Output Management
• Route & Shipping Point Determination
• Warranty Process
• EDI order creation with different order reasons
SIT UAT
Critical 188 Critical 188
Non-Critical 25 Non-Critical 25
Prioritization
SIT UAT Priority A 124 Priority A 124
Automated Manual Automated Manual Priority B 35 Priority B 35
59 127 59 127 Priority C 5 Priority C 5
88
OTC - Integrated Test Scenarios
89
60
OTC - Fiori Apps
50
40
SIT UAT
• 86 Standard Fiori Apps and 0 Custom Fiori Apps
• 26 Apps with “Display Only” functionality which is applicable and extended to other workstreams is not
part of testing
• 57 Apps with Update Functionality
90
O T C - I n t e g r a t e d ( B o u nd a ry ) S y s t e m s
DS4 In Scope ?
Connected System Interface Type Responsible DEV QUAL Strategy with DS4
(Yes/No)
Namespace W/
OMP PLS Yes Cheo X X connect to OMP DEV
rfc
Namespace W/
OMP FCT Yes Cheo X X connect to OMP DEV for FCT and PLS
rfc
No non-prod for DS. For QS5 Manually create files for
Demand Solutions No FILE FTP Paul
comparison / test ingestion and coordinate with Allen
Livingston Denied Party
Yes FILE FTP Ali - X compare file format
Screen
Gentran EDI Sub System Yes EDI Julie X X Compare idoc file formats
91
OTC - Critical Processes
Supporting Process
Leading
Critical Process
Module OTC PTP PTD RTR VISTEX SFDC
OTC Billing
92
O T C - T e s t i n g Le a d s a nd T e s t e r
• Below are the Testing Leads and Testers
Testing
Testing Leads Testers
Phase
Madhu
Tim
Prakash
Michelle
SIT Koteswara
Sujeet
Dhaval
Rajani
Deepak
93
Boundary Systems
94
B o u nd a r y S ys t e m s
• As per the Current Landscape of S/4 Hana 1709, the Integrated ( Boundary ) Systems are given in the next
slide.
95
SAP LANDSCAPE SAP SAP Vistex Bi-Directional
SAP PO BW/4HANA Concur
Vertex
One-Directional
SAP
Solution
Manager RFC Open Text
SAP GRC
SAP BI
SAP FIORI
(HUB)
MIDDLEWARE SAP
S/4HANA Success
Factors
Current System
Version 1709
Multiple PWC
Livingston Thompson High Deloitt Enterprise Salesforce
Winshuttle Bank DEM+
Denied Reuters Fx Radiu e Insights SAP Cloud
Interfaces
Party s Cortex Connector
Screen
Axosnet
(MX
A/P) SAP BTP
(SCP/CPI)
OTHERS
Demand
Solutions
97
C S V Te a m
Susan Hsu
98
W H O i s r e q u i r e d t o c o nd uc t C o m p ut e r S y s t e m V a l id a t i o n?
99
W H AT i s C S V ?
• To objectively confirm that the software is validated for its intended use, all prospective CSV
efforts must include at minimum the following deliverables/activities:
• Defined User Requirements
• Creation and approval of a Validation Protocol
• Execution of the validation activities and tests
(qualification stages)
• Creation and approval of a Validation Report
100
W H AT S o f t w a r e n e e d s V a l i da t i o n ?
Production Software
Software that • Software used in the production of the FDA regulated product
requires
Validation
101
WHY Validate?
102
O t h e r R e q u i re m e nt s
103
Questions?
104
TH∆NK YOU
105