PUBLIC

Automation Testing Methodology Overview for

SAP Digital Manufacturing
1. Introduction

This document outlines SAP's methodology for the adoption and execution of test
automation.

2. Disclaimer

 The methodology states the process adopted by SAP to implement test

automation.
 Customers are not in any way bound to use the same methodology.
 The document must be considered simply as a frame of reference while
designing the test automation methodology.
 The process for adoption of test automation is in progress and hence this
document is subject to updates whenever applicable.

3. Inputs for adoption of automation testing

 SAP Digital Manufacturing progresses on a quarterly release mode.

 Automation of the testing is leveraged to accelerate testing timelines and

effectuate a high reusability quotient.

 This document provides an overview of the transition and thereby, interplay

between manual / digital testing strategies along with automation before
transitioning to a complete automation testing mode at SAP.

 All SAP customers with an SAP Enterprise Support agreement are entitled to
use Tricentis Test Automation for SAP as a term license (link). However, this
tool must be considered as a mere recommendation and customers are not
obliged to adopt the same tool or process.

4. Tools adopted by SAP for manual and automation testing

 X Ray plugin for JIRA

 Tricentis TOSCA for automation testing

2/4
© 2023 SAP SE or an SAP affiliate company. All rights reserved. See Legal Notice on www.sap.com/legal-notice for use terms, disclaimers, disclosures, or restrictions related to SAP Materials
for general audiences.
 5. High Level Approach for Test Automation Using
TOSCA & Xray JIRA Plugin

Stages Description

Author test case • Enlist the scenarios based on customer reporting and internal risk assessment
and add it to a • Draft the test case in Xray, link it to test plan, and obtain approval prior to execution (if
test plan in Xray required)
JIRA • Assign the test case to tester

Execute the test • Execute the assigned test. Verify if the execution is a pass.

Convert manual • TOSCA specialists author test cases by referencing manual runbooks (automated in
runbook to the future)
automated • The scenarios are authored as modules
version (TOSCA)

Execute the
automation test • Execute the test case in TOSCA
case, • Generate the test results in the TOSCA using reporting functionality
view/download test • Verify the traceability matrix linking requirements to tests
report & traceability

3/4
© 2023 SAP SE or an SAP affiliate company. All rights reserved. See Legal Notice on www.sap.com/legal-notice for use terms, disclaimers, disclosures, or restrictions related to SAP Materials
for general audiences.
 6. How Can Customers Leverage Accelerated Testing
Timelines?

Automated
runbooks

Monitor updates
Map customer to Service
Subscribe to Update impacted Update test case
requirements to z IDs in
Catalog
changes in documents & / or retest
Service Catalog What’s New
Service Catalog
ID (link) Viewer (link)

Impact
Analysis

4/4
© 2023 SAP SE or an SAP affiliate company. All rights reserved. See Legal Notice on www.sap.com/legal-notice for use terms, disclaimers, disclosures, or restrictions related to SAP Materials for general audiences.