Professional Documents
Culture Documents
r o
G
e o
Standards and standards for
testing E / E systems
p l
Ex
Comparison - ASPICE and ISO
of
y
26262
r t
p e
r o
1
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
Introduction
u p
r o
G
2 Standards and standards for testing E / E systems
2.1 Automotive SPICE (ASPICE)
e o
l
2.2 ISO 26262 - Functional Safety
2.3 AUTOSAR
x p
E
2.4 Comparison - ASPICE und ISO 26262
o f
2.4.1 ASPICE and ISO 26262 objectives
2.4.2 Comparison of test levels
y
2.5
r t
Exercises / comprehension questions / Case Studies
p e
r o
2
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 Comparison - ASPICE and ISO 26262
u p
Learning Objectives:
r o
G
Know
e o
AUTFL-2.4.1 Recall the different objectives of ASPICE and ISO 26262 (K1).
p l
Ex
of
ty
er
o p
3
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 Objectives of AUTOSAR
u p Know
r o
G
o
Automotive SPICE ISO 26262
le
Process evaluation
x p
System security
o
comply with needs specific to the
assessments of software process
application sector of electrical
y
capability of automotive suppliers in
t
and/or electronic (E/E) systems
r
accordance with the requirements
within road vehicles.” (2)
e
of ISO/IEC 15504-2.” (1)
Source:
o p
r
(1) Automotive SPICE Process Assessment Model – “1.1 Introduction“ (2) ISO 26262-2 – “Introduction“ ASPICE: AUTOMOTIVE SPICE
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 Objectives of AUTOSAR
u p Know
r o
Automotive SPICE ISO 26262 G
e o
ISO 26262 is a combination of a
p l
process model (Volumes 2, 8, and 9)
and a life cycle model.
x
Evaluation of the performance of
E
the development processes of
If the product to be developed is
f
suppliers of E / E systems in the
one with safety relevance then the
o
automotive industry. The model
safety lifecycle as described in ISO
specifies what needs to be done.
y
26262 must be used.
p e is fulfilled.
r o
5
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 History / Origin
u p Know
r o
Automotive SPICE ISO 26262 G
e o
l
~ 2001 (1. version) 2011 (1st version)
p
2017 (current Version: V.3.1) 2018 (current version)
Based on
Ex
Automotive-specific adaptation of
ISO/IEC 15504 (SPICE)
of IEC 61508
y
Developed from ISO's Technical
Created on the initiative of the
t
Committee 22 "Road Vehicles"
r
Automotive Special Interest Group
(Subcommittee 3 "Electrical &
e
(SIG)
electronic equipment").
o p
6
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 Content
u p Know
r o
G
Automotive SPICE ISO 26262
x p
E
Process performance indicators -
y
working documents document contents
r t
e
Consideration of risks and system Risk and safety-centric development
p
safety not separately highlighted approach
r o
7
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 "Meaning" of software testing
u p Know
r o
G
Automotive SPICE ISO 26262
Defines WHAT to do
tested e
o
Determines HOW to be
during testing
(processes & activities)
p l (depending on ASIL)
E x
the specifications at the test. f
When using the standards in the company, participants must know
o
y
The testing strategies in the company must meet these requirements
r t
(in terms of testing process, documents, methods, risk-oriented
testing, ...).
p e
Corresponding consequences for testing must be documented in the
test concepts.
r o
8
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 Contents with SW test reference
u p Know
r o
Automotive SPICE ISO 26262
G
Process descriptions for:
o
Description of the development
e
l
phases:
p
Software Component Verification
x
(SWE.4) Software unit testing
E
Software integration and Software (26262-6 #9)
f
integration test (SWE.5) Software integration and testing
o
Software test (SWE.6) (26262-6 #10)
System integration and System Verification of software safety
integration test (SYS.4)
r
System test (SYS.5)
e
Quality Assurance (SUP.1)
p
Verification (SUP.2)
r o
9
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 The differences
u p Know
e
including the (hardware) systems relevant systems
General change management
approach for obtaining a special
p l
Highly suitable for the development of
x
safety-relevant systems
process maturity
o
context-specific.
harmonized to allow for cross-appraisal
y
Assessments are therefore not easily
of assessments
t
comparable
e
The aim is to obtain a certificate for ther The aim is to reduce the risks of a
p
system and to avoid damage claims
acquired process maturity
o
against the manufacturer.
10
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.1 The differences
u p Know
e
development errors and random
l
of a product or service
hardware errors.
f Eliability risks.
y
depends on the business goals. the risk analysis (ASIL).
r t
e
Does not need a specific method Needs a specific method
p
(the "what" is defined) (the "how" is determined)
r o
11
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
u p
r o
G
e o
2.4.2 Comparison of the test
levels
p l
Ex
of
ty
er
o p
12
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Comparison of test levels
u p
Learning Objectives:
r o
G
Understand
e o
AUTFL-2.4.2 Explain the differences between ASPICE and ISO 26262 and
l
CTFL® regarding the test levels (K2).
x p
f E
o
ty
er
o p
13
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Comparison of test levels
u p Understand
r o
G
From the syllabus:
Both ISO 26262 and ASPICE describe test levels. However, these are not
e o
completely consistent with the test levels from CTFL®. Therefore, for an
l
efficient and effective collaboration, testers should have a common
p
x
understanding of all test levels.
f
The term “system” used in ASPICE and E the terms “system” and “item”
o
used in the ISO 26262 refer to a product consisting of hardware and
e r
o p
14
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Classification of test levels to ISTQB
u p Understand
r o
G
ISTQB ISO 26262
e o ASPICE
l
Acceptance test Safety validation (4-9) No equivalent
System of systems test
x p
Item integration and test (4- 8)
System qualification test (SYS.5)
E
System integration test System integration test (SYS.4)
f
System test Verifying Software Security Software qualification test (SWE.6)
o
Requirements (6-11)
Component integration
Software Integration and Testing (6- Software integration test (SWE.5)
y
test
t
10)
r
Component test Software Unit Test (6-9) Software unit verification (SWE.4)
p e
r o
15
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Definition of Terms
u p Understand
r o
Security Validation: G
The safety validation covers only parts of an acceptance test according
e o
to ISTQB.
p l
Multi System Test :
Ex
of
The testing of several heterogeneously distributed systems, so-called
y
"systems of systems"
r t
p e
r o
16
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Definition of Terms
u p Understand
r o
Item integration and test: G
Item integration and testing consists of three phases: the integration
e o
and testing of hardware and software of an item, the integration and
p l
x
testing of all item-related items, and the integration and testing of
E
items in conjunction with other items in the vehicle.
of
ty
er
o p
17
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Application of test methods
u p Understand
r o
According to ISTQB CTFL, test procedures are largely independent of G
the test levels.
e o
The tester decides which method to use.
p l
As a rule, ASPICE does not name any procedures per test level.
Ex
The tester decides which method to use.
of
ty
r
In ISO 26262, however, there are individual method tables for each
test level.
p e
These tell the tester which procedures he should apply, depending on
the ASIL recommendations.
r o
18
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Differences in work products
u p Informative
r o
G
ISO 26262 requires the creation of additional work products:
Safety Plan
Functional Safety Concept
e o
Technical Safety Concept
p l
Confirmation Measures Report
E x
f
Documentation of the software tool qualification
o Report
Software Component Qualification Report
y
Hardware Component Qualification
t
Safety Audit Report
e r
Proof of service experience
Safety Assessmentp
o
Report
Safety Case
19
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Differences in work products
u p Informative
r o
G between
The Automotive SPICE PAM contains no work products that comply
with these documents. However, there are overlaps
e o
p l
the functional security concept and, stakeholder requirements.
x
(according to SYS.1),
f
"System Requirements Specification" E
the technical safety concept and technical requirements in the
(according to SYS.2)
o
the qualification reports and the verification results (according to
SUP.2).
ty
e r
o p
20
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Process assignment
u p Understand
r o
MAN.3, MAN.5, PIM.3, ACQ 15, SUP.1
G
o
SPL.2
SYS.1
le
p
SYS.4-5
SYS.2-3
x
SYS.1
E
SWE.1
f
SWE.2
o
SWE.3
SWE.4
y
SWE.5-6
r t
e
ACQ.1 SUP.7
SYS.1
p
REU.2
SUP.8
SUP.10
o
SUP.2
r
Source: ISO 26262-2 – “Introduction“
(ISO.org)
21
P
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
2.4.2 Differences in the processes
u p Understand
r o
G
e o
p l
Ex
of
ty
er
o p
22
P r
© Expleo Group | CTFL®-AuT V2018 (2.0.2) | Version 1.0
u p
r o
G
e o
p l
Ex
o f
Thank r
y
t for your attention.
you
p e
r o
P