Membership Resources Groups Events Awards About CII 

Blog


Home  ⟩  Resources  ⟩ Searc
Knowledge Base  ⟩  knowledge areas  ⟩  quality management   ⟩  rt-320

Search the Knowledge Base 

Searc

Definition and Measurement of

Engineering/Design Deliverable Quality (Best
Practice)
RT-320 Topic Summary

Overview
Defects in engineering/design deliverables negatively affect project performance in terms of cost,
schedule, and safety, by causing significant amounts of rework in the design and/or construction
phases. RT-320 offers capital project teams key guidance on assessing both the design quality and
the design completeness of the most problematic engineering/design deliverables.  
 
RT-320 took a bottom-up, priority-driven approach to understanding design quality defects, impacts,
causes, and methods of measuring design quality. The team began by identifying the 11 most
problematic deliverables and the 73 most common and significant defects associated with these
deliverables. The research team then identified 349 causal factors, from which were derived 118
leading and 23 lagging metrics. With additional insight from published literature and corporate
practices, the team identified 266 completeness checklist items for the 11 most problematic
deliverables. Finally, RT-320 developed two implementation tools: the Design Deliverable Quality
Assessment (DDQA) tool and the Completeness of Design Deliverable Checklist (CDDC) tool. IR320-2,
Tools for Enhancing the Quality of Problematic Design Deliverables, presents the major findings of
this research, the highlights of the two implementation tools, the inputs and outputs of the tools, and
the roles and responsibilities of potential users. 
Provide Feedback?

Key Findings and Implementation Tools

1 : Design Quality Essentials

Based on prior published literature, RT-320 defined design deliverable quality in terms of their
completeness, correctness, and timeliness.
 Membership Resources Groups Events Awards About CII 
Blog



Reference: (RS320-1)

2 : Relative Frequency of Deliverable Quality Problems per Deliverable Type

RT-320 surveyed industry to identify the most problematic deliverables in terms of quality (N=67).
The RT found similarities in the relative frequency of design quality problems encountered by
owners (X-axis value) and contractors (Y-axis value).

Reference: (RS320-1)

3 : The 11 Most Problematic Design Deliverables

 
No. Deliverable
1 FEED Validation Deliverables
2 Level 3 Baseline Schedule
3 Constructability Inputs
 4 P&IDs
5 Equipment Specifications & Data Sheets
Membership Resources Groups Events Awards About CII 
6
Blog Maintainability Inputs
7 Vendor Data 
8  3D Model & Clash Detection
9 Piping Routing & Isometrics
10 Nozzles, Ladders, & Platforms for Towers/Vessels/Tanks
11 Misc. Pipe Support Drawings
 
 
From the scatter plot shown in Key Finding #2, RT-320 concluded that deliverables are
“problematic” if quality problem frequency is between “Sometimes (3.0)” and “Too Often (5.0).”
 

Reference: (RS320-1)

4 : Analysis of 73 Significant Design Deliverable Defects (Deliverable Defects List)

The industry survey (N=36) identified 798 common defects associated with the 11 problematic
deliverables. RT-320 consolidated and aggregated these common defects, developing a list of 73
significant design deliverable defects (6.63 defects per deliverable on average). Among the 73
defects, 24 percent pertain to completeness, 60 percent pertain to correctness, and 16 percent
pertain to timeliness.

Reference: (IR320-2)

5 : Defects Analysis Table

RT-320 identified 349 causal factors associated with the 73 significant defects by utilizing a “5-
Whys” approach. The table summarizes the defect type, impact type, and causal factors of each
significant defect.
 Membership Resources Groups Events Awards About CII 
Blog



Reference: (IR320-2)

6 : Leading & Lagging Metrics (Metrics-Timing Table) 

The research team:

generated 118 leading metrics associated with the deliverable defects and causal factors.
generated 23 lagging metrics associated with the deliverable defects and defect impacts.
identified timing of measurement for each assessment.

Reference: (IR320-2)

7 : Deliverable Completeness Checklist

Based on prior published literature, four RT company models, and RT discussions, RT-320
developed a total of 266 completeness checklist items (approximately 24 items per deliverable
type, on average). This checklist can help project teams seeking a high level of completeness for
their engineering deliverables.
 Membership Resources Groups Events Awards About CII 
Blog



Reference: (IR320-2)

8 : Recommended Timing of Substantial Completeness by Deliverable 

RT-320 identified the recommended timing for application of the deliverable completeness
checklist.

Reference: (RS320-1)

9 : Implementation Tool #1

Design Deliverable Quality Assessment (DDQA) Tool

 The DDQA tool performs the following functions:
a. addresses the 11 most problematic deliverables
Membership Resources Groups Events Awards About CII 
b. selects the appropriate leading metrics according to user input on targeted design
Blog
deliverable(s) and relevant project timing milestone(s)

 indices for each targeted design milestone and deliverable.
c. provides design quality
d. provides a list of metrics that were responded to as "NO"
e. provides a list of potential defects possibly associated with metrics answered as "NO"
f. facilitates documentation of path-forward corrective actions (based on project team
discussions) to eliminate/mitigate potential defects.

Reference: (IR320-2)

10 : Implementation Tool #2

Completeness of Design Deliverable Checklist (CDDC) Tool

The CDDC tool performs the following functions:

a. focuses on the 11 most problematic deliverables
b. facilitates assessment of completeness checklist items pertaining to the selected
deliverable(s)
c. provides completeness indices for the selected deliverables
d. generates a list of items not currently substantially complete, for each selected deliverable.

Reference: (IR320-2)

rt-320

Key Performance Indicators

Improved design, Improved cost, Improved schedule, Improved safety, Improved quality (reduced
rework)

Research Publications

 Tools for Enhancing the Quality of Problematic Design Deliverables - IR320-2

Publication Date: 12/2016 Type: Implementation Resource Pages: 123 Status: Tool

 View Details  Order Now

 Engineering Deliverables: Get It Right the First Time - RS320-1

Publication Date: 12/2016 Type: Research Summary Pages: 25 Status: Supporting Product

 View Details  Order Now

 Study of Engineering/Design Deliverable Quality - RR320-11

Publication Date: 12/2016 Type: Research Report Pages: 244 Status: Reference

 View Details  Order Now

Presentations from CII Events

 Plenary Session - Engineering Deliverables: Get It Right the First Time

Publication Date: 08/2016 Presenter: Number of Slides: 20 Event Code: AC2016

 Implementation Session - Engineering Deliverables: Get It Right the First Time

Publication Date: 08/2016 Presenter: Number of Slides: 16 Event Code: AC2016

Tags Membership Resources Groups Events Awards About CII 
Blog

Knowledge Areas:  Quality Management

Project Phase: Detailed Design (Engineering)

Project Function/Role: Architects & Engineering, Commissioning & Startup,

Construction, External Stakeholders, Operations &
Maintenance, Project Management, Quality Management

Industry Group: Buildings, Heavy Industrial, Infrastructure, Light Industrial

Regions: Africa – South Africa, Asia – China, India, Southeast Asia,

Australia, Europe – Scandinavia, Russia, Middle East, North
America – USA, Canada, Mexico, South America – Central
America, Brazil

10-10 input Metrics: Controlling, Design Efficiency, Planning, Quality

Keywords
Problematic deliverables, Deliverable completeness, Defect analysis, Engineering deliverable quality,
Deliverable correctness, Defect impacts, Design deliverable quality, Deliverable timeliness, Defect
causal factor, Engineering quality, Deliverable defects, Leading indicators, Design quality,
Engineering/Design defects, Lagging indicators, rt320

Back To Knowledge Summary

 Print

 Share

 Advanced Keyword Search

Featured Items

About the Knowledge What's New

Knowledge Base Glossary
Base

CII, based at The University of Texas at Austin, is the Add An Account | Login
research and development center for the capital
projects industry.
Join Now

© 2023 Construction Industry Institute™ All rights

reserved
3925 W. Braker Lane, Austin, Texas 78759 map
Privacy Policy | Contact Us | Site Map
Membership Resources Groups Events Awards About CII 
Blog

