Session25-Effective Quality Management of Automotive ECU

IBM Rational
Automotive Engineering Symposium 2013
Effective Quality Management of

Automotive ECU’s
Kyle Perkuhn
Platform Marketing Engineer:
National Instruments
kyle.perkuhn@ni.com
Paul Urban
Business Development Manager
IBM
purban@us.ibm.com
IBM Rational Automotive Engineering Symposium 2013
Embedded Software Quality Challenge
The complexity is growing at an increasing pace
2
Smarter Products Require New Technology
Traditional Next Generation

Product & Systems Development Product & Systems Development
Systems
Engineering
Electrical
Mechanical Software
Engineering Engineering Engineering
Physical Design and

Bill of Materials (BoM) Centric Approach
Integrated Electronic, Mechanical,
and Software Engineering
 Focused on CAD/CAM and BoM  More focus on software and electronics

 Slower to react to change  Responsive to change
 Silos of engineering disciplines  Systems engineering methods optimize
product designs and engineering collaboration
3
3
Managing the Cost of Software Errors

Smart Washing Commercial Luxury
Machine Aircraft Automobile
Lines of Code 100k 6.5 Mil 10 Mil
10-20 defects produced per 1,000 lines of code*

Defects 1k – 2k 65k - 130k 100k – 200k
…a bug which costs $1 to fix on the

programmer's desktop costs $100 to fix once it
is incorporated into a complete program, and
many thousands of dollars if it is identified only
after the software has been deployed in the
field.
* The Economists.May 16th, 2010. Tech.View:
4
Cars and software bugs. www.economist.com
Diverging Challenges
The quality challenge Engineers must

is growing, but continue to innovate
timelines and budgets and harness the
are not increasing latest technologies to
proportionally remain competitive
5
Build in quality from concept to launch

using Rational Quality Manager
Requirements-
driven testing
• Make high quality decisions
based on quantitative information
• Integrate defect tracking and
change management
• Smooth the information flow
between testers and developers
• Improve quality by managing
complexity across multiple
product configurations Quality metrics
dashboard
“We have greater control to improve processes, greater

test coverage and traceability, plus, vastly improved
Reduce errors through automated reuse of
navigation and user friendliness.”
information
– Beta test participant
10
10
Rational Quality Manager: A Closer Look
Test Planning Test Construction Test Execution

 Comprehensive test plan  Requirement driven testing  Manual test execution
 Shared objectives  Test environments coverage  Use test automation tools
 Scope, Timeline, Resources  Manual test authoring  Record test results
 Risk assessment  Test lab management  Submit & track defects
Team Collaboration Reporting & Dashboard

 Process enactment and enforcement  Status and progress tracking
 Review and approval  Customizable live dashboard
 Task management  Real-time metrics and reports
 Rapid team member on-boarding  Compliance and quality audit
11
IBM Rational
Introduction to National
Instruments
Tools for Next Generation Development
Graphical
Modeling Real-Time Testing
Programming
Analysis and Enterprise

Test Automation
Reporting Connectivity
15
Multi-Chassis Systems PXI PC NI CompactRIO NI CompactDAQ
Diversity of Applications
No Industry >15% of Revenue in 2012
Academic Advanced Research Automotive Big Physics Consumer Electronics
Defense/Aerospace Energy Life Sciences Mobile Devices Semiconductors
16
The NI TestStand Ecosystem
1000+ companies worldwide

100+ consultants and integrators
10000+ existing developers
2 levels of development certification
20+ partner products
500+ new developers trained annually since 2007

40+ worldwide branches providing support
10+ programming languages supported
18
NI TestStand—Test Management Software
• Graphical sequence editor

environment
• Automate tests written in any
language
• Multithreaded sequence execution
• ASCII, HTML/Web, XML, and ATML
report generation
• Access, Oracle, SQL Server database
connectivity
19
Embedded Software Quality

Challenge
26
Traditional Development Process
Project Manager Systems Engineer Software Engineer Quality Engineer Test Engineer
Modify
Create change requirements
request and evaluate
impact
Plan tests and
link to
requirements
Derive software Software

Schedule tests
requirements Development
Assess progress Submit defect
Team Quality
DOORS Rhapsody
Concert Manager
ni.com 27
Requirements Documents
Quality Engineer IBM Rational Automotive Engineering Symposium 2013
National Instruments Test Components
(DOORS, .docx, .xlsx, …) Test Engineer
(.seq, .vi, .nivs, …)
Plan tests and link to

requirements
IBM Rational Quality NI TestStand

Test PlansManager
Execution Records Sequences Execution Records
Test Cases Requirement Links Parameter Files Requirement Links
Schedule tests
Test Schedules Quality Dashboards Code Modules Quality Dashboards
Test Results
(.html, .pdf, .tdms, .jpg, …)
Submit defect
Execution Records, Defect
Management, Test Plan
Documentation
28
Requirements Documents IBM Rational Automotive Engineering Symposium 2013
National Instruments Test Components
(DOORS, .docx, .xlsx, …) Test Engineer

Test PlansManager
Test Results

Documentation
29
(DOORS, .docx, .xlsx, …) National Instruments Test Components

Test PlansManager
Test Results

Documentation
30
(DOORS, .docx, .xlsx, …) National Instruments Test Components
National Instruments
Test Integration
Adapter
IBM Rational Quality for NI TestStand
Test PlansManager
IBM Rational
Test Schedules Quality Dashboards Quality Manager Code Modules Quality Dashboards
Test Results

Documentation
31
Next Generation Development Process
Project Manager Systems Engineer Development Quality Engineer Test Engineer
Modify
Create change requirements
request and evaluate
impact
Plan tests and Implement test,
link to analysis, and
requirements reporting
Derive system System Design Execute tests

Schedule tests
requirements & Development
Generate
Assess progress Submit defect
results
Team Quality
DOORS Rhapsody NI TestStand | LabVIEW | NI VeriStand | DIAdem
Concert Manager
ni.com 32
IBM Rational
Demo
Demonstration Overview
• Validation of Adaptive Speed Control Unit (ASCU)
• Intended operation in multiple Vehicle Powertrains (Truck, SUV, Luxury, …)
• Validate performance in all systems against multiple driving scenarios
(Cruise Set Points / Road Loads)
Cruise Set Point Road Load
ASCU Vehicle Powertrain
ni.com 39
Test Asset Management and Automation
IBM Rational Quality Manager
Test Plans Execution Records
Test Cases Requirement Links
Test Schedules Quality Dashboards
MIL Test HIL Test Integration Test Cell Field Test

System #1 System #1 System #1 System #1 System #1


Busy Available Offline
ni.com 41
Defect Management
Defect Resolution Defect Results and

Collaboration Verification Items
ni.com 42
Project Documentation and Tracking
Project Test
Dashboards Results
ni.com 43
IBM Rational and National Instruments are teaming

together to provide an end-to-end quality
management solution
• Traceability all the way to test and back
• Collaboration between ALL teams, including test
•All test results available to all teams and linked to test cases and
requirements
•Quality and test considered from the outset, not an afterthought,

reducing cost and risk of identifying and correcting defects
•Test component re-use throughout project phases and between projects

providing operational efficiency and accuracy
44
IBM Rational
ibmrqm@ni.com
45
Learn More:
• Web pages:
• IBM.com: IBM Rational and National Instruments
• NI.com: Integrating Test Into Development Cycle
• NI Test Integration Adapter Product page
• References:
• Solution Brief: Break down engineering silos to improve quality
• Article: To Build a Smarter Product, Stop Separating Design & Test Ian
Cannings, Danfoss Power Electronics
• Blog: Design News blog
• Media:
• Webinar: Integrating National Instruments testing with RQM (demo starts at
min 24)
• Webcast:: Embedded System Quality: Top Competitive Techniques Revealed
• Video: Interview Innovate 2013- Chris Washington, National Instruments...
• Video: Innovate 2013 Interview and Demo at NI Booth
• Video: NI Week 2012 Keynote: Embedded Software Quality Management
• Webcast: Taming the Complexities of Software Driven Innovation to Reduce
Project Cost and Risk
• Podcast: Integrate testing into the development lifecycle
46

Session25-Effective Quality Management of Automotive ECU

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Session25-Effective Quality Management of Automotive ECU

Uploaded by

Copyright:

Available Formats

IBM Rational

Automotive Engineering Symposium 2013

Effective Quality Management of

Embedded Software Quality Challenge

The complexity is growing at an increasing pace

Smarter Products Require New Technology

Traditional Next Generation

Physical Design and

 Focused on CAD/CAM and BoM  More focus on software and electronics

Managing the Cost of Software Errors

Lines of Code 100k 6.5 Mil 10 Mil

10-20 defects produced per 1,000 lines of code*

…a bug which costs $1 to fix on the

The quality challenge Engineers must

Build in quality from concept to launch

“We have greater control to improve processes, greater

Rational Quality Manager: A Closer Look

Test Planning Test Construction Test Execution

Team Collaboration Reporting & Dashboard

Tools for Next Generation Development

Analysis and Enterprise

No Industry >15% of Revenue in 2012

Academic Advanced Research Automotive Big Physics Consumer Electronics

Defense/Aerospace Energy Life Sciences Mobile Devices Semiconductors

The NI TestStand Ecosystem

1000+ companies worldwide

500+ new developers trained annually since 2007

NI TestStand—Test Management Software

• Graphical sequence editor

Embedded Software Quality

Derive software Software

Assess progress Submit defect

Plan tests and link to

IBM Rational Quality NI TestStand

IBM Rational Quality NI TestStand

Execution Records, Defect

IBM Rational Quality NI TestStand

Execution Records, Defect

Execution Records, Defect

Derive system System Design Execute tests

Cruise Set Point Road Load

ASCU Vehicle Powertrain

MIL Test HIL Test Integration Test Cell Field Test

MIL Test HIL Test Integration Test Cell Field Test

MIL Test HIL Test Integration Test Cell Field Test

Busy Available Offline

Defect Resolution Defect Results and

IBM Rational and National Instruments are teaming

• Traceability all the way to test and back

• Collaboration between ALL teams, including test

•Quality and test considered from the outset, not an afterthought,

•Test component re-use throughout project phases and between projects

You might also like