Professional Documents
Culture Documents
5/8/2018 NOT FOR DISTRIBUTION OUTSIDE UTC AEROSPACE SYSTEMS WITHOUT PRIOR
EXECUTIVE APPROVAL
Revision 2.01
THIS DOCUMENT IS THE PROPERTY OF UTC AEROSPACE SYSTEMS. YOU MAY NOT POSSESS, USE, COPY OR DISCLOSE
THIS DOCUMENT OR ANY INFORMATION IN IT, FOR ANY PURPOSE, INCLUDING WITHOUT LIMITATION, TO DESIGN,
MANUFACTURE OR REPAIR PARTS, OR OBTAIN ANY GOVERNMENT APPROVAL TO DO SO, WITHOUT UTC AEROSPACE
SYSTEMS’S EXPRESS WRITTEN PERMISSION. NEITHER RECEIPT NOR POSSESSION OF THIS DOCUMENT ALONE, FROM
ANY SOURCE, CONSTITUTES SUCH PERMISSION. POSSESSION, USE, COPYING OR DISCLOSURE BY ANYONE WITHOUT
UTC AEROSPACE SYSTEMS’S EXPRESS WRITTEN PERMISSION IS NOT AUTHORIZED AND MAY RESULT IN CRIMINAL
AND/OR CIVIL LIABILITY.
This document does not contain any export controlled technical data (xClass CLS08231348)
Initial evaluation of our performance might suggest that our quality improvement
strategy is adequate until we consider a few factors. First, our customer escape event
rate of 200 per month consistently drives greater than 40% of our customer scorecards
to red or yellow (figure 2).
Overall BU 1 BU 2 BU 3 BU 4
Automotive ProCert/PPAP 6σ
100% parts <10 ppm
ZDP
Quality control &
Path to Gold/ 4σ 5σ
Aerospace ProCert/PPAP of
ProCert/PPAP
(UTAS) ~5000 ppm 100% of incapable <250 ppm
~5% parts
processes
100% parts
Role Responsibility
Site Leader / General Understand the process of ZDP methodology and the impact
Manager on staffing levels, EBIT, and customer satisfaction
Provide oversight at regular intervals to all ongoing ZDP
projects
Provide interdisciplinary resources for process improvements
Product Line Manager Provide leadership at regular intervals to all ongoing ZDP
projects
Identify key programs/projects for investigation
Provide key data that will allow the project with the most po-
tential to be chosen
Test Engineer Understand the process of ZDP methodology and its effect
on the test environment
Incorporate test coverage lessons learned into standard work
for test plans on future development work
3 Methodology Overview
3.1 What it is
ZDP is a data-driven methodology to first achieve zero escapes and then drive to zero
defects. The six steps of ZDP (figure 4) are
1. Analyze escape data. Review past escapes (typically three years) to identify the
escape events to be investigated (based on trends, Pareto charts, customer im-
pact). Review each escape event individually to capture how it was contained,
root cause(s), corrective action(s), and detection breakdown. These data form the
foundation of the ZDP methodology. Statistical First Article Inspections (FAI)
and Manufacturing Process Reviews (MPR) are conducted to uncover gaps in
these processes and Process Failure Mode and Effects Analyses (PFMEA) are re-
viewed and updated.
2. Define quality control actions. Based on the escape data step, identify
a. How the customer found the escape when we did not. If the escape was
self-identified, how did we eventually find the escape when we missed it
originally?
b. Why, systemically, our detection systems did not find the escape;
c. What systemic actions will be taken to detect this type of failure effect in
the future;
d. How many parts this action apply to (read-across);
e. What effectiveness measure(s) will be used to monitor the detection sys-
tem and provide information on long-term process improvement; and
f. Which of the 10 common action categories (Appendix A; identified by re-
viewing all previous zero defect reviews at other sites, businesses, and
product lines) are applicable, as appropriate, across all parts.
Supplier Over- 5
4 4 44 5 17 74 10/28/2016 3415 41
Inspection
Change control 1 1 11 1 1 15 Complete 3718 0
CCpk == 2.11
2.11
0
pk
Site Specific 41 240 26 26 21 354 10/31/2016 7460 155
Total Actions 150 651 107 91 122 1121 30123 1045 2.4 3.6 4.8 6.0 7.2 8.4 9.6
Ensure defect detection Measure turnbacks and near-misses for all Drive process capability with UPPAP
quality control categories Replace quality control actions with verified
Audit action implementation process improvements
3.2 Terminology
As part of the zero defect plan, three terms describe the types of escapes:
Known-knowns: future escapes with known root causes affecting known parts.
For example, an electronic board fails because of cracked solder joints (the root
cause) at known solder joints.
Known-unknowns: future escapes with known root causes but with unknowns
about which parts may be affected. For example, an electronic board fails be-
cause of cracked solder joints but what specific joints are affected is unknown as
there can be thousands of solder joints on the electronic board.
Unknown-unknowns: future escapes with unknown root causes and with un-
knowns about which parts may be affected when. For example, an electronic
board fails for unknown root causes and with unknowns regarding what parts
are affected.
Specific containment actions are taken to address each type of escape and are deter-
mined by the nature of the root causes:
Known-knowns’ containment actions are based on the direct cause of the defect
or of the detection failure. These actions prevent recurrence of the specific escape
but not of similar escapes with differing root causes or part numbers. These ac-
ZDP common
quality control
actions
Expand to Enterprise Level
51
41 40 SBU 6
36
SBU 5
SBU 4
SBU 3
SBU 2
SBU 1
An example Pareto by LRU part number is shown in figure 7. This type of plot provides
more details in terms of which products have the most escapes.
29
2015
2014
2013
13
12
11
10 10
9
7
6 6 6
5 5
4 4 4 4
3 3 3 3 3
2 2
Finally, escapes can be sorted by defects or process failures to help identify common de-
fects across products (figure 8).
2 2 2 2
1 1 1
Escape Pareto and trend analyses are useful in defining the initial scope and priority for
ZDP implementation (customer, part number, product line, etc.), but do not replace the
discrete, escape-by-escape review described.
The 100% inspection of features identified through the statistical FAI provides addi-
tional protection against an escape. The added inspection should incentivize the pro-
ducer to improve the manufacturing processes to reduce variation and remove the need
for 100% inspection. To uncover potential critical characteristics, best practice also
means reviewing design specifications while considering the statistical FAI results.
Specification limits may be relaxed if performance and safety of the part are not com-
promised.
5.2.1 Pre-work
Data are collected and summarized to support data review during the NAR. The pre-
work has three main parts to help create control plans:
1. Collect summary data for each escape event to be reviewed (Section 4.2) and put
summary data into a spreadsheet (figure 9).
2. Answer the six questions outlined in Section 5.1.1 as a site and in advance of the
NAR. While answering these questions, the site team should focus on how a “de-
fective” part was allowed to escape and what containment actions we will take to
eliminate similar “defective” parts from reaching our customer.
3. Review each of the common actions outlined in Appendix A for applicability and
implementation date and by part number (or part family) for the site. These data
are used to define and implement quality control actions and serve as the basis
for execution of the NAR.
This information can be summarized in a spreadsheet (figure 9) using the ZDP template
available from UTC Aerospace Systems Quality organization.
20
Direct Cause of Escape Immediate
Business Site Customer Doc Date Rej. Per Event Date Unique Detection Containment
Item Clinic # Year Program Part Event Name (All customer detail of C/A Containment
Unit (Ship Number (Event Date Event (last) Event Breakdown ECD
rejection) (Known Known)
Site) first) (MM/DD/YY)
Escape Review Template Based upon data review of past escapes events (typically 3 years) identify the escape events to be investigated (based on
trends, paretos, customer impact). The Escape Reivew Template is populated with supporting (individual, detailed) CLOSED clinics/RCCA Investigations
associated with the specific part numbers or part families contributing to customer escapes. A cross functional team working together should review
each clinic. The working team should, as a minimum, include: Design engineering, supplier management, Manufacturing engineering, operations, and
quality.
Working together, the Cross Fucntional should define Systemic containment actions by asking the following questions:
Attempt at least (5) and then review results with Quality Fellow to ensure appliciation of Read Across Actions is understood. Perform this
step prior to completion of all (20-30) clinic reivews.
This document does not contain any export controlled technical data
BU/Site will be required to have completed sheet for NAR.
2a Implement pre-coat AOI 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
AOI application to PTH (Plated through hole)
2b 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
boards
Apply AXI to detect solder bridge under fine-
2c 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
pitch components
Automated Change from SMT to BOM-based AOI
2d Inspection 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
programming
Implement 3 dimensional AOI (e.g. laser-
2e 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
based)
Automated optical inspection (OCR/UID) for
2f part marking 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
5f 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Risk based over inspection (e.g. double DQR, Sh. Huang Sh. Huang Sh. Huang Sh. Huang Sh. Huang Sh. Huang
6a 0 24 0 24 0 0 N/A N/A N/A N/A N/A N/A N/A O 9/31/2016 9/31/2016 N/A N/A O 9/31/2016 9/31/2016 N/A N/A O 9/31/2016 9/31/2016 N/A N/A O 9/31/2016 9/31/2016 N/A N/A O 9/31/2016 9/31/2016 N/A N/A O 9/31/2016 9/31/2016 N/A N/A
3rd party, UTAS source) R. Jury R. Jury R. Jury R. Jury R. Jury R. Jury
UTAS review of all supplier FAIs (going
6b 27 0 0 27 0 0 4/11/2016 N/A N/A N/A N/A N/A N/A SQA C 4/11/2016 4/11/2016 N/A N/A SQA C 4/11/2016 4/11/2016 N/A N/A SQA C 4/11/2016 4/11/2016 N/A N/A SQA C 4/11/2016 4/11/2016 N/A N/A SQA C 4/11/2016 4/11/2016 N/A N/A SQA C 4/11/2016 4/11/2016 N/A N/A
forward)
6c Supplier Over- Verify all suppliers for compliance to Buy 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Inspection American Act
6d Extend all to drop ship suppliers 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Risk-based component screening:
Upscreening based upon component failure
6e 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
history (collaborate with REI COTS initiative)
S5 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S6 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S7 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Site Specific
Containment
S8 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S9 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S10 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S11 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S12 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S13 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S14 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S15 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S16 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S17 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S18 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S19 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
S20 0 0 0 0 0 0 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
TOTAL 29 176 0 205 0 0 10/31/2016 N/A 0 1/0/1900 1/0/1900 0 0 N/A 8 10/31/2016 10/31/2016 0 0 N/A 8 10/31/2016 10/31/2016 0 0 N/A 8 10/31/2016 10/31/2016 0 0 N/A 8 10/31/2016 10/31/2016 0 0 N/A 8 10/31/2016 10/31/2016 0 0 N/A 8 10/31/2016 10/31/2016 0 0
5.4 Examples
Several examples of customer escapes and potential answers to the systemic contain-
ment questions are presented in table 3.
Why,
Systemic
Direct Why did the systemically,
Containment Effectiveness Read-across Read-across
Cause of customer find it did we not have
(Known- measurement ECD Scope
Escape and we didn't? detection in
Unknown)
place?
Customer scans
Automate part-
and verifies We are depend- Number of part- Over-inspect--
marking and -
electronically ing on manual marking es- 30 days with
verification;
OR one person marking and capes found at customer’s
Wrong check ID on
reads one tag verification over- technique
P/N on the seats versus 20
and another processes. In- in- Automate part-
ATR "tape”; update
reads docu- spector error-- spect/automate marking and
WI; change ID
ment, versus no inspection of d part verifica- verification--120
installation
using our man- inspection tion days
location
ual system
Potential dam- Improve parts’
Number of
age after inspec- handling post-
packag-
tion but before It is after our inspection
ing/Handling
packaging; final inspection (stowage, ship-
improvements
possible dam- point. ping containers;
identified
Damaged age by staples at handling; pack-
during receipt before No method in aging stand-
Customer re-
shipment; inspection; place for deter- ards). 30 days 20
duction initia-
various possibly not mining if our
tive
concerns using standard parts handling Gemba walk
(RI)/shipping
work for pack- and packaging post-inspection;
damage; con-
aging; possible can cause dam- adopt best prac-
centration dia-
damage during age tices across
gram of find-
packaging op- affected prod-
ings
eration ucts
No agreed-
upon cosmetic
Inspection fo- criteria between Create visual
cused on dam- customer and standard; get
age/scratch; not UTAS; lack of concurrence
Pimple on looking for visual stand- with customer; Number of
grip from inclu- ards at appro- update WI for turn- ~20 (focus on
flap sion/pimple; no priate points utilization; backs/rejections 60 days areas, not part #
inspection crite- internally. Lack quicker feed- internal and at specific)
ria for inclu- regular/quick back to site of customer
sions/pimples at feedback on issues
paint, assembly, issues that site (QIM/Worklist
or final is seeing for with photos)
update of
standards
We don't check
hardness on
specific parts;
did not validate
specific
NADCAP ap-
Update FAI
proval versus
Aluminum checks to ensure
overall; did not
was not Customer per- we obtain test
review test data
heat- formed a dy- results support- FAI failures,
from AMS 2770 60 days All programs
treated to namic test and ing final mate- material escapes
as part of FAI
T6 condi- the seat failed rial condition
(buried re-
tion OR test inter-
quirements);
nally
quality test
items did not
represent pro-
duction.; no
formal work
transfer
8. Monitor lagging quality escape performance. Typically, the customer will have a
significant amount of Work in Progress (WIP) shipped prior to ZDP implementa-
tion. Escapes from this population will likely delay customer scorecard im-
provement as the non-ZDP hardware flushes from the system (this is typically on
the order of six months to one year). A best practice to get a quicker indication of
ZDP results is to track all customer escapes by ship date and correlate to ZDP
implementation. An example escape/ship date chart is shown in figure 13.
9. For each pre-implementation escape, ask “Would the current quality control ac-
tions have caught the escape?” If the answer is no, add additional quality control
actions. For each post-implementation escape, identify if it is a new learning or
ineffective implementation problem and add additional quality control actions or
ring-fence layers as necessary.
10. Independently audit implementation for effectiveness.
9.1.1 Mistake-proofing
Mistake-proofing uses wisdom and ingenuity to create devices and processes that en-
sure a task is always done correctly. Normally, it is a simple and often inexpensive way
to prevent defects or highlight a defect so that it is not passed to the next operation.
The key steps in mistake-proofing are
1. Obtain or create a flowchart of the process. Review each step, considering where
and when human errors are likely.
9.1.3 UPPAP
UPPAP is a set of requirements for production part approval. One of its purposes is to
determine if the organization properly understands all customer engineering design
record and specification requirements; another is to determine if the manufacturing
process can produce product consistently and meet those requirements during an actual
production run at the quoted production rate. UPPAP applies to both internal and ex-
ternal organizations supplying production parts.
UPPAP is broken out into 19 elements as shown in figure 14.
Product Definition UPPAP Special Elements
1 Released Production Drawings 11 EFP / ESA
2 Released SPD/QAD/RCC 13 Functional Testing
3 Prod. PO & Demand Fulfillment
Required Approvals
14 Special Processes & NDT
UPPAP Core Elements 15 Material Certification Documents
4 Design Risk Assessment (DRA) 16 Dimensional Raw Material Approval
5 Process Flow 17 Part Marking Approval
6 PFMEA 18 Packaging Approval
7 Process Control Plan
UPPAP Formal Approval
8 Process Readiness Study (PRS)
19 UPPAP Review and Sign-off
9 Initial Process Studies (IPS)
10 Measurement System Analysis (MSA) Process Change Management
12 Dimensional Reports (FAI + 4) Continuous UPPAP Approval State
The UPPAP process is executed as shown in figure 15. Major steps of UPPAP are
Producer Producer
UPPAP
receives
Required executes
requirement
UPPAP
MFP reviews
package MFP reviews
package Interim
Full approval Approval
granted granted
9.3 Example
Pins for a connector on an electronic motherboard were found to be below the mini-
mum specification and too short. The immediate containment plan was to perform a
100% inspection of the pins’ length until the connector build process and motherboard
assembly were in control and process capability acceptable. A process capability study
at the supplier revealed that more than half of the pins were out of specification (figure
16, a) (Cpk<0.5). Data-driven process improvement actions were then implemented to
significantly improve the process capability (figure 16, b), achieving a Cpk greater than
1.67. Quality control over-inspections were removed only after the process capability
had been validated and demonstrated to be sustainable.
a) Incapable b) Capable
Figure 16: Pin length process capability
Target
1Q17 2Q17 July 2017 Aug. 2017
(ECD)
754
LRU/Parts 712 712 712 743
(12/2017)
MPRs 70%
36% 42% 51% 52%
(% parts) (12/2017)
100%
Interface inspection (% of points) 88% 92% 96% 98%
(12/2017)
# Turnbacks
8,768 12,194 14,2134 16,502 -
(cumulative)
100%
% Suppliers on ZDP 70% 78% 78% 78%
(12/2017)
% Processes Ppk >1.67 for sFAI parts 72% 62% 65% 68%
-
(#above / #overall) (721/1024) (1269/2048) (1525/2504) (2102/3089)
Figure 18: ZDP PRO Quality Control requirement implementation form (excerpt)
11.1 APQP
To design quality into products, the aerospace industry has recognized Advanced
Product Quality Planning (APQP) as an important component of new product devel-
opment that is reflected in Aerospace Standard AS9145, “Requirements for Advanced
Product Quality.” UTAS customers require that their design-responsible suppliers sup-
port early identification of design risk, both inherent and incidental. If not understood
and mitigated, these risks will translate to defects and ultimately customer dissatisfac-
tion. The focus of APQP is the use of tools and methods to mitigate both design and
manufacturing risks associated with a new product or process.
APQP specifies requirements in a structured framework to plan and complete actions of
the product realization cycle necessary to ensure quality products are delivered on time,
while satisfying cost performance targets. APQP drives a quality-focused approach to
product development; with this approach, a phased planning process is used within
which specific deliverables are established, monitored, and tracked to closure and risks
are highlighted and mitigated as they are identified. PPAP is an output of APQP that
confirms that the production process has demonstrated the potential to produce prod-
Table 5 illustrates the commonalities between ZDP and APQP: both have a customer
focus, leverage lessons learned, and are risk-based continuous improvement strategies.
They also share PPAP as a requirement to ensure that all required actions are accounted
for and validated.
ZDP APQP
UPPAP PPAP
PPAP (and therefore UPPAP) is a requirement embedded in phase 4 of APQP. Its pur-
pose is to provide evidence that the organization understands all customer engineering
design records and specification requirements and that the manufacturing process can
produce product consistently while meeting those requirements during an actual pro-
duction run at the quoted production rate. This purpose is accomplished by requiring
objective evidence in 19 separate elements (figure 14).
13 Summary
The rigors and challenges in the aerospace industry demand nothing less than perfect
quality every time. Although our process-focused quality strategy has proven effective
in steady, incremental improvement, additional action is needed to drive a true step-
change in our performance.
The Zero Defect strategy encompasses all ACE-driven process control actions and sup-
plements them with an aggressive, data-driven quality control strategy. This focused
quality control strategy enables more rapid results to our customers in the form of few-
er escapes and provides a more rigorous dataset to focus our process control actions.
ZDP follows a six-step methodology:
1. Analyze escape data.
2. Define quality control actions.
3. Expand actions to enterprise level.
4. Confirm actions through NAR.
5. Implement and track effectiveness.
6. Implement process control.
The disciplined execution of all steps of the ZDP will prevent defects from reaching our
customers and improve our processes to prevent the creation of defects.
13.1 Recommendations
Implement the ZDP today to prevent escapes.
Include all steps in the ZDP, including process control.
Monitor progress.
Share any new widely applicable quality control actions to expand across UTC
Aerospace Systems sites.
Expand ZDP to UTC Aerospace Systems suppliers.
Automated op-
tical inspection
for part marking
Use the checklist to make sure all steps of the ZDP™ are executed and documented.
United Technologies Aerospace Systems developed a tracking template to document the ZDP and its execution. The
template is available as an Excel file from UTAS Central Quality or the Quality Authorities.
To be completed by the Project Manager or Quality Authority WHILE the work is being performed.
A “No” answer to any statement requires corrective action to be taken
Yes No N/A
1. Escape Data Analysis
1.1. Pareto escapes to select part numbers and events for review based on number of occurrenc-
es, occurrences over time, customer impact, processes, defects, etc.
1.2. Summary of each escape event where the investigation is complete
1.3. Freeze processes (no change unless rigorously validated)
1.4. Immediate screening in place
1.5. New Manufacturing Process Review for each part under ZDP
1.6. In-depth review and update of PFMEA following MPR. If PFMEA does not exist, complete
PFMEA
1.7. Statistical FAI on at least 25 pieces
1.8. 100% inspection of features with incapable processes
C.2 References
UTAS-PRO-0031 Process Failure Mode Effects Analysis & Controlled Build Re-
quirements
UTAS-FRM-0076 ZDP™ Manufacturing Process Review (MPR) Workbook
UTAS-PRO-0028 Critical Characteristic Selection and Management
UTAS-PRO-0036 International Trade Compliance for UTAS Employees and Con-
tractors
UTAS-GUI-1000 Production Part Approval Process (UPPAP)
UTAS-GUI-1251 The Creation of Process Flow Diagrams, PFMEAs, and Process
Control Plans
ZDP How-to book
UTCQR-9.1 Process Certification
UTAS-GUI-1251 The Creation of Process Flow Diagrams PFMEAs and Process
Control Plans
UTAS-FRM-1251 Process Control Plan
C.3 Instructions
An MPR can be initiated for any selected part or Line Replaceable Unit (LRU). The MPR
has five phases
1) Prework
a. Compile escape & yield history;
C.3.3 Assign owners for each checklist item in Section 1.0 Prework of Table 6
The ZDP™ Execution Owner for the targeted Part Number(s), or their delegate, should
review each checklist item of the Prework section (1.0) (c.f. Table 6) and assign owners
for all.
The Prework actions should be completed, reviewed, and validated a week prior to the
event. The ZDP™ MPR Facilitator is responsible for validating that the pre-work ac-
tions are complete prior to the onsite review.
C.3.4 Compile escape & yield history for target part number(s) and product
family
The owner of this action, typically a Quality Engineer, will compile the escape & yield
history of the target Part Number(s) and product family. It is recommended to present
the escape history by the DCERI categories. The team should have the Root Cause and
Corrective Action for each escape available during the event if questions come up.
If the targeted part number is top-level assembly / LRU, then the escape data analysis
should include a review of the lower level assemblies and parts produced internally
and by suppliers.
C.3.5 Mark up Ops Sheets to call out traceability to drawing location / design
specifications
The owner of this action, typically the Manufacturing Engineer, should mark-up each
operation step to identify which design specification is implemented in that step. A best
The Manufacturing Engineer should validate that all operations are in compliance with
the latest revision of the drawing – this includes validating called out tool settings in the
Ops Sheets are within design specifications called out on the drawing. If the units vary
between the design specification and the Ops Sheet, the units conversion should be ver-
ified to ensure the correct value is being implemented during the production of the part.
C.3.9 Ensure design and operations documentation are available for the event
The Manufacturing Engineer, Quality Engineer, and Design Engineer are responsible
for ensuring the following documents are available either in physical form or digitally
during the event: drawings, specifications, summary of in-process Engineering Chang-
es, marked up Ops Sheets (per C.3.5), and routers.
The team should also be able to pull up older versions of these documents during the
event in case an issue arises where the team needs to understand what was in place at
an earlier point in the program.
The drawings and marked up Ops Sheets should be available in paper copies for the
team to be able to review while on the floor.
Obtain required export authorizations (i.e. TEXPORT) if transfer of technical data or
manufacturing know-how will occur.
)
,9
,2
st
Product Family Process Matrix
(1
se
Te
e
te
te
nc
Ba
as
at
at
ty
la
la
Ba
Fe
y
Pl
Pl
ui
rB
rP
rP
ar
bl
in
ng
er
ar
er
em
ul
te
te
la
nt
g
pt
pt
l
gu
gu
Ri
ap
ap
t
Re
Co
ss
oa
a
Re
Re
Ad
Ad
Ad
Ad
+
-A
rC
EO
s
n
ub
ie
Product information
o
1
2
y
de
bl
bl
i
C
tS
ct
n
n
m
m
/
w
tio
tio
tio
tio
tio
pe
O
s
g
se
Po
se
NE
Re
ta
ta
ta
ta
ta
ng
vin
ns
As
As
lS
lS
lS
lS
lS
ng
t/
pi
ng
lI
ei
20
b-
in
ip
xi
na
na
na
na
na
na
ea
b
ec
tti
Su
Su
Pa
A3
Bo
Sh
Ki
Fi
Fi
Fi
Fi
Fi
Fi
R
Item # Product Family Part Description Part Number Op # 1 Op # 2 Op # 3 Op # 4 Op # 5 Op # 6 Op # 7 Op # 8 Op # 9 Op # 10 Op # 11 Op # 12 Op # 13 Op # 14 Op # 15 Total Ops per Part Number
Not Not
1 A320 NEO Widget X 2427 Done Done Done Similarity Done Done Similarity Similarity Done Done Similarity Done Done
Observed Observed
Not Not
2 A320 NEO Widget Y 2428 N/A Similarity NA Yes Similarity NA NA Yes Similarity NA Yes Similarity Similarity
Observed Observed
During the event debrief, the MPR Team Leader should include a recommendation on
how to handle processes not viewed. In some cases it may warrant a delta-MPR to
complete a review of the operations, in other cases a review of the escape data analysis
and the relatively complexity of the operation may lead to a recommendation to pro-
ceed with those gaps.
C.4.2 Witness each step of the operations, per MPR Scope Sheet and identify
sources of variation
Prior to commencing the operations, a local site leader should introduce the team to the
technicians / operators implementing the processes that will be observed throughout
the event. This introduction should clarify the goals of the event, and invite and em-
power the operator / technician to share their improvement ideas, as well as to speak up
if the team is becoming too intrusive on their ability to complete the operations on time.
Each team member should observe the operations and capture notes on potential
sources of variation that could lead to a non-conforming product. It is recommended to
capture prescriptive observations, as it can be difficult to recall the specifics of a cryptic
note at the end of a long day. Notes maintained as part of the MPR record need to be
evaluated for technical data, and export classified (i.e. xClass) and marked appropriate-
ly.
Specific team members should be assigned to actively review the marked-up Ops
Sheets, while others should actively review the drawings. Team members should be
paired up: one with Ops Sheets and the other with Drawings. This will help the team to
quickly trace the observations from the Ops Sheet down to the Drawing spec.
The team should solicit feedback from the technicians, operators, local ME’s and QE’s
on how to best minimize variation. The team should also capture observations that
could help improve the EH&S or help lean out the process. Quality is the primary focus
of the MPR; however, the team should take advantage of the diverse set of eyes viewing
the process and capture observations that will benefit the site.
C.5.6 Assess whether or not any new Key Process Characteristics (KPC)
should be created based on difficulty of observed operations
The team should review the KPC, the complexity of the manufacturing and assembly
processes observed, and determine whether or not additional KPCs should be identified
and managed moving forward. ZDP™ Action Items should be created to implement
new KPCs, as needed.
Owner Complete?
1.0 Prework
Form Team: Complete Tab #3 "ZDP MPR Team" of UTAS-FRM-0076
1.1
Note: a single person may cover more than one role.
1.2 Compile escape & yield history
Mark up Ops Sheets to call out traceability to drawing location / design specifica-
tion. Make physical copies for team members during review. Review Process Flow
1.3
Diagram (Tab 4 of UTAS-FRM-0076) to ensure all Significant Product Characteris-
tics are implemented.
Review and summarize Critical-to-Quality (CTQ) parts. Verify appropriate CTQ
1.4
characteristics selection per UTAS-PRO-0028
Compile summary of existing process capability data for targeted part(s) per
1.5
UTCQR-9.1
Review and update PFMEA, or equivalent, if available.
1.6
If PFMEA, or equivalent, does not exist create a ZDP Action to complete PFMEA
Ensure design and operations documentation are available for the event:
1.7 Drawings, specifications, marked up Ops Sheets (per 1.5), routers, summary of in-
process Engineering Changes
Complete MPR Scope Sheet (Tab 8A) in UTAS-FRM-0076 to identify and prioritize
1.8
which operations will be available to observe during event.
3.3 Note: Any non-conformance observed that necessitates stopping the line should
be an Escalate and result in an immediate meeting with key personnel to develop a
go forward plan
Review and validate available Process Capability data. Identify any observed dis-
3.4
crepancies or risks, capture in ZDP MPR RAIL.
Analyze and update PFMEA, or equivalent, as necessary. Drive updates into the
3.5
Process Control Plan (Tab 6A in UTAS-FRM-0076 or UTAS-FRM-1251)
Assess whether or not any new KPC’s should be created based on difficulty of
3.6
observed operations
D.1 References
AS13004 – Process Failure Mode and Effects Analysis (PFMEA) and Control
Plans (SAE)
SAE J1739 – Potential Failure Mode and Effects Analysis in Design (Design
FMEA), Potential Failure Mode and Effects Analysis in Manufacturing and As-
sembly Processes (Process FMEA) (SAE)
Potential Failure Mode and Effects Analysis (FMEA) Reference Manual, 4th Edi-
tion (AIAG)
Advanced Product Quality Planning and Control Plan, 2nd Edition (AIAG)
UTAS-GUI-1251 – The Creation of Process Flow Diagrams, PFMEAs, and Process
Control Plans
D.2 Objectives
PFMEA is an integral part of the manufacturing process review and is used to identify
all possible failure modes as well as their severity, likelihood of occurrence, and the
likelihood of detecting the failure mode. In addition to identifying failure modes, the
PFMEA also provides a structured approach to developing process improvement op-
portunities that mitigate the most serious risks and failure modes in order to limit the
likelihood that a defect reaches the next process or end customer.
D.3 Timing
PFMEA is a proactive and living tool. Ideally, this effort should be started before or at
the feasibility stage of a new product introduction and prior to tooling for production.
Early review and the analysis of new and/or revised processes allows the team to antic-
ipate, resolve or monitor potential process concerns during the manufacturing planning
stages of a new product. The PFMEA should be completed prior to tooling release. The
tooling release date is the date at which further design changes to the actual tooling be-
come difficult or impossible to incorporate beyond changes to the drawing or other
supporting documents.
Prior PFMEAs for a part or process family from similar manufacturing processes - if
available - can be used as the starting point. The prior Process FMEA or process family
D.4 Process
The PFMEA process has four major phases, with corresponding sequence of steps as
shown in figure 22. The feedback loop indicates that the PFMEA is an ever-changing,
living and breathing document.
The Process Flow Diagram (UTAS-FRM-1254) should be created prior to the PFMEA as
it aids in defining the scope of the PFMEA. Without a properly defined scope a PFMEA
can be incredibly time consuming. Customer escape data from similar existing product
E.1 Calculation
The top 20% RPNs of each PFMEA are extracted and pooled. The average RPN score
from this pool is
𝑛𝑖
∑𝑚
𝑖=1 ∑𝑗=1 𝑟𝑝𝑛𝑖,𝑗
̅̅̅̅̅̅ =
𝑅𝑃𝑁
∑𝑚
𝑖=1 𝑛𝑖
where 𝑚 is the number of different PFMEAs used to form the pool, 𝑛𝑖 is the number of
RPN scores extracted from the ith PFMEA, and 𝑟𝑝𝑛𝑖,𝑖 is the jth rpn score for the ith
PFMEA.
The calculation is graphically explained in figure 24 using PFMEAs for 2 parts and 1
process (A, B and C). The top 20% RPNs of each PFMEA are extracted and added into
the pool. Since each part has a different number of RPNs, each PFMEA contributes a
different number of RPNs to the pool. ̅̅̅̅̅̅
𝑅𝑃𝑁 is the pool average.
ZDP Curriculum
Processes
ACE
RRCA/MP 101296