Professional Documents
Culture Documents
Document 55
Document 55
Assurance
CRITICAL CAPABILITIES AND THEIR PRIORITIES
“After purchasing The Art of Service toolkit, I was able to identify areas
where my company was not in compliance that could have put my job
at risk. I looked like a hero when I proactively educated my team on the
risks and presented a solid solution.”
1
“I customized The Art of Service toolkit to focus specifically on the
concerns of my role and industry. I didn’t have to waste time with a
generic self-help book that wasn’t tailored to my exact situation.”
“Many of our competitors have asked us about our secret sauce. When
I tell them it’s the knowledge we have in-house, they never believe me.
Little do they know The Art of Service toolkits are working behind the
scenes.”
“The risk of our competitors getting ahead has been mitigated because
The Art of Service has provided us with a 360-degree view of threats
within our organization before they even arise.”
2
Quality Assurance
CRITICAL CAPABILITIES
Notice of rights
All rights reserved for the book itself: this book may not be
reproduced or transmitted in any form by any means, electronic,
mechanical, photocopying, recording, or otherwise, without the
prior written permission of the publisher.
Trademarks
3
Table of Contents
About The Art of Service 5
Quality Assurance Critical Capabilities, Meaningful Metrics
And Their Prioritization 6
Background 6
Prioritization Of Requirements 7
The Prioritization Categories Are: 8
Must Have 8
Should Have 8
Ought to Have 9
Might Have 9
Could Have 10
Use In New Product/Service/Process Development 11
Benefits 12
The Critical Quality Assurance Capabilities And Their
Priorities: 14
Priority - Must Have
# From 1869 To 2331 16
Priority - Should Have
# From 1402 To 1869 162
Priority - Ought to Have
# From 935 To 1402 301
Priority - Might Have
# From 468 To 935 436
Priority - Could Have
# From 1 To 468 567
Index 695
4
About The Art of Service
T
he Art of Service, Business Process Architects since
2000, is dedicated to helping stakeholders achieve
excellence.
https://theartofservice.com
support@theartofservice.com
5
Quality Assurance Critical
Capabilities, Meaningful Metrics
And Their Prioritization
Background
This guide provides meaningful Quality Assurance metrics
underpinned by prioritization and is used in management,
business analysis, project/process management, development
and innovation to reach a common understanding with
stakeholders on the importance they place on the delivery of
each requirement.
6
This guide cuts down on wasted time, arguments, and
misdirection. It also omits as much bias as possible from the
process so that everyone involved can take an objective view of
the requirements at hand.
Prioritization Of Requirements
All requirements are important, however to deliver the greatest
and most immediate business benefits early the requirements
must be priortized. Organizations will initially try to deliver all
the Must have, Should have and Ought to have requirements
but the Should and Ought to requirements will be the first to be
removed if the delivery timescale looks threatened.
7
The Prioritization Categories Are:
Must Have
Requirements labelled as Must have are critical to the current
delivery timebox in order for it to be a success. If even one Must
have requirement is not included, the project delivery should
be considered a failure (note: requirements can be downgraded
from Must have, by agreement with all relevant stakeholders; for
example, when new requirements are deemed more important).
MUST can also be considered an acronym for the Minimum
Usable Subset.
Should Have
8
• May need some kind of workaround, e.g. management
of expectations, some inefficiency, an existing solution,
paperwork, etc.
Ought to Have
Might Have
9
Could Have
10
Use In New Product/Service/Process
Development
In new product, service or process development there is always
more to do than there is time or funding to permit (hence the
need for prioritization).
For example, should a team have too many potential tasks, they
can use this guide to select which tasks are Must have, which
Should have, and so on; the minimum viable product (or MVP)
would be all those epics marked as Must have.
Aim for a delivery probability of 60, 60, 40, 40 and 20% with
each of the categories. It is recommended to have no more
than 60% effort for Must Haves for a project. Anything higher
than 60% poses a risk to the success and predictability of the
project, unless the environment is well understood, the team is
established and the external risks are minimal.
11
Benefits
The benefits of this guide include:
12
13
The Critical Quality Assurance
Capabilities And Their Priorities:
14
15
Priority - Must Have
# From 1869 To 2331
16
performing requirement analysis and systems analysis,
facilitating design and development of software
solutions, assisting with the testing process, contributing
to the quality assurance processes and assisting with
management of helpdesk tickets and reporting.
17
the internal and external core teams.
18
Quality Assurance Systems/affiliate quality management
system to ensure compliance with organization standards
and regulatory guidelines.
19
Make sure the Supplier Quality Manager is responsible for
delivering all aspects of the Supplier Quality Assurance
and/or Supplier Quality Development function on an on-
going basis in line with the Quality Management System
to ensure products and services are fit for their intended
use and meet (internal) customer expectations.
20
# 2319 | Focus Area: ISO 14971 - QUALITY
21
What is transferable between teams?
22
# 2313 | Focus Area: Project Control - CENTER
23
How do PMOs identify which functions and services are?
24
# 2307 | Focus Area: Performance Management -
QUALITY
25
Ask the Senior Quality System Process Expertise
Manager:
26
# 2301 | Focus Area: Qa process - QUALITY
27
dissatisfied with the products availability?
28
# 2295 | Focus Area: Software QMS - QUALITY
29
# 2292 | Focus Area: pmi - MANAGEMENT
30
# 2289 | Focus Area: data resource management -
SOFTWARE
31
Do you receive robust assurance that all key risks are
managed in your supply chain?
32
Ask the Quality Director:
33
strategy, and process improvements, while working in an
embedded manner with cross-functional engineering and
product teams.
34
Make sure your group deploys Process Improvement and
Quality Assurance and makes the program organization
efficient and transparent, in line with business and
program processes.
35
Warrant that your team is involved in software
configuration management and software quality
assurance methodologies.
36
quality, compliance, and auditing activities to ensure
compliance of operations with corporate policies,
industry standards, and applicable regulations.
37
Ask the Senior Quality Engineer:
38
responsible for the development and implementation of
quality assurance processes and tools.
39
to (internal) customers.
40
Ask the Quality Management Systems Analyst:
41
Do you process information about a user?
42
# 2253 | Focus Area: Business Intelligence and
Analytics - QUALITY
43
Are there special IoT systems which are used in one
certain warehousing process?
44
Management teams operations and project work
assignments.
45
and produce change metrics and reports.
46
Management team input.
47
reduce cost through quality assurance on quality of
conformance to reduce scrap, rework internal supplier
material and (internal) customers complaints, (internal)
customer interface and support the organization goals in
achieving total (internal) customer satisfaction.
48
Partners, Application Development, and Software Quality
Assurance Teams to understand scope, solutions,
constraints, and risks.
49
specification, data loading plan, data maintenance plan
and security policy.
50
and coordinates QA activities with the QA Officer and the
Quality Control Unit.
51
clients business problem?
52
- PROCESS
53
# 2220 | Focus Area: APQP - QUALITY
54
Collaborate with product managers, software engineers,
and blockchain intelligence specializations to optimize
research, data collection, and quality assurance
processes.
55
management system as well as systematic program
management for the Fabrication Division.
56
# 2210 | Focus Area: GISF - RISK
57
Management - MANAGEMENT
58
Achieve quality assurance operational objectives by
monitoring quality metrics; generate and oversee the
development of quality standards and protocols for
quality assurance and testing; implement standard
operating procedures; identify and resolve problems;
implement change following the continuous
improvement process.
59
Management - QUALITY
60
When does the ISO 9000 quality assurance standard lead
to performance improvement?
61
Do you allow tenants to use third party identity assurance
services?
62
MANAGEMENT
63
# 2189 | Focus Area: Train all employees - QUALITY
64
and quality assurance measures as well as problem
management and process improvement processes.
65
Ask the Quality Improvement Coach:
Which of the new trends have already found the way into
day to day testing?
66
Develop and maintain quality assurance procedures
and work instructions regarding inspection and data
gathering/analysis.
67
projects, process reviews and process improvements in
support of quality assurance initiatives.
68
Ask the APQP Quality Engineer:
69
# 2169 | Focus Area: Process Improvement
Methodology - PROCESS
70
Work as a member of the IT Project Quality Assurance
team to continually improve process, drive cost reduction
activities and build overall domain knowledge.
71
Make sure the Quality Assurance Manager is responsible
for assisting management in assessing the adequacy
of your organizations internal control environment by
performing audits and value added services.
72
expectations and disseminate the outcome with all
involved stakeholders.
73
initiatives.
74
How can there be any consistency to quality or through
put, under circumstances?
75
# 2150 | Focus Area: IT Service Management -
PROCESS
76
Lead Quality Manager in directing plant Quality Control/
Quality Assurance program to ensure compliance with
policies and procedures, all regulatory requirements and
standards.
77
organizational standards and external departments.
78
to maintain a competitive service environment.
79
technologies/processes and complex change controls
with validation and regulatory impact.
80
Ask the Project Quality Engineer:
81
Ask the Director of Quality Engineering:
82
How do you differentiate between failures due to poor
implementation, failures due to process changes that
were flawed or inappropriate, and failures due to poor
contractor performance?
83
Ask the Director of Quality Systems Management:
84
assurance, and quality engineering?
85
personal attention to all concerns brought to the
attention so as to ensure consumer satisfaction.
86
How will you provide ongoing staff training on new
policies/procedures and other important topics?
87
How adequate are any data quality assurance procedures
and data validation that were followed?
88
Design and maintain business intelligence and analytics
reports to provide quality assurance and monitoring
of business processes, as well as providing insight
to stakeholders for continuous improvement of the
business.
89
# 2106 | Focus Area: UML - SOFTWARE
90
of interface standards, quality assurance standards,
performance standards, and cost-benefit analysis of
modern state-of-the art information systems; analyzes
available technologies and makes recommendations of
technologies to use and how best to use them.
91
of the vendor and summarizing those findings.
92
# 2096 | Focus Area: target operating model -
MANAGEMENT
93
Make sure your operation drives innovation and
integration of new technologies into projects and
activities in the software quality assurance organization.
94
Make sure the Quality Technician is responsible for
conducting routine tests and inspections on products,
assisting the Quality Assurance Manager with data
collection.
95
companies?
96
Set up project data quality assurance mechanisms, and
periodically participate/co lead the project internal data
quality assessments.
97
Ask the Senior Quality Engineer:
98
# 2076 | Focus Area: Cloud Migration -
DEVELOPMENT
99
in production support cases by triaging issues and
working with engineering to resolve issues.
100
How can workflow management system diagnose and
react to any disruptions occurred during the execution of
the workflows?
101
Is the processing cycle time too long?
102
# 2063 | Focus Area: Breaking Down a Problem -
QUALITY
103
Use common quality assurance processes, tools, and
techniques to determine if a software product or service
being developed is meeting the specified requirements.
104
How do you build principles into your process and realize
tangible improvements?
105
quality requirements?
106
profession?
107
assurance reviews of security requirements and audit
recommendations for the implementation of identified
solutions.
108
is collected?
109
# 2040 | Focus Area: Employee Handbook -
MANAGEMENT
110
organization and/or (internal) customer quality assurance
organizations.
111
Ask the Automotive Quality Manager:
112
Ask the Quality Improvement Specialist:
113
Verify that your operation ensures that the Quality
Assurance program adapts with newly developed
training, new or revised Standard Operating Procedures
(SOPs), departmental goals and objectives, and changing
priorities.
114
Ask the Sr Supplier Quality Engineer:
115
Is the invoice document in compliance with contract
requirements?
116
# 2017 | Focus Area: ISO 55001 - QUALITY
117
Ask the Software Quality & Customer Experience
Engineer:
118
# 2010 | Focus Area: Anomaly detection - QUALITY
119
# 2007 | Focus Area: APQP - QUALITY
120
# 2004 | Focus Area: ISO 14000 - QUALITY
121
Ask the Quality Improvement Team Leader:
122
monitoring evaluations?
123
Learn the basics of the Quality Assurance Lifecycle and
how it fits into the Software Development Lifecycle.
124
Does the hosted document management system
conduct automatic integrity checks, or will it accept any
document?
125
Who sets the standards for Quality Assurance?
126
# 1984 | Focus Area: IT Operating Model
Governance - DEVELOP
127
quality assurance standards in service delivery and staff
performance.
128
Ask the Software Quality Engineer:
129
# 1974 | Focus Area: Business Process Intelligence -
DEVELOPMENT
Make sure the team also deploys and supports site quality
assurance and auditing of network sites with (internal)
customer coordination.
130
documentation, quality assurance and deployment.
131
# 1967 | Focus Area: Web Applications - QUALITY
132
Ask the Quality (Business) Senior Analyst:
133
# 1960 | Focus Area: Vendor Management -
VENDOR
134
ensure that a solution is fit for end users needs.
135
# 1953 | Focus Area: Information Governance -
QUALITY
136
Safeguard that your personnel contributes to developing
and executing a quality assurance program to meet both
organizational and individual project needs.
137
# 1946 | Focus Area: gxp - QUALITY
138
# 1943 | Focus Area: ISO 27000 Series -
COMPLIANCE
139
# 1940 | Focus Area: IT Asset Management ITAM -
QUALITY
140
Healthcare - DATA
141
Review and provide quality assurance of risk
management deliverables submitted to regulators.
142
Ask the Manager of Quality:
What are some key tools and programs for measuring and
improving quality?
143
# 1927 | Focus Area: SaaS Delivery Model -
SOFTWARE
144
What data quality assurance system is in place?
145
Assurance and/or Operations.
146
# 1916 | Focus Area: COBOL - DEVELOPMENT
147
# 1913 | Focus Area: logs and reports - QUALITY
148
Ask the Quality Analyst, Privacy Third Party Risk
Assessments, Global Data and Privacy Center of Expertise
(COE):
149
MANAGEMENT
150
Ask the Senior Quality Program Manager:
151
quality assurance/ control?
152
# 1896 | Focus Area: Insurance Data Models -
QUALITY
153
NETWORK
154
Ask the Quality Assurance Manager:
155
Make sure the primary objective of the Quality Assurance
Automation Engineer is taking ownership of your internal
test framework and additionally maintain and improve its
capabilities.
156
# 1882 | Focus Area: ISO 8000 - QUALITY
157
Support functional modifications/updates/test cases
for development and quality assurance teams from a
functional perspective.
158
requirements for IT to meet overarching regulations that
apply to computerized systems.
159
software teams.
160
How are mistakes handled, reviewed, investigated?
161
Priority - Should Have
# From 1402 To 1869
162
# 1866 | Focus Area: ISO 20000 - PROCESS
163
# 1862 | Focus Area: cloud governance - LEAD
164
# 1859 | Focus Area: iso 13485 - QUALITY
165
Develop experience and background in credit approval
and/or credit analysis, to ensure that quality assurance
observations and proposed solutions resonate with the
core underlying activities.
166
Ask the Director Operational Quality Excellence:
167
# 1849 | Focus Area: Configuration Management -
SOFTWARE
168
# 1846 | Focus Area: iso 13485 - QUALITY
169
input for forecasting, training program assessment, and
quality assurance program calibration.
170
monitoring and quality assurance of key processes,
including select high impact functions.
171
Are all aspects of the assurance process conducted by
competent persons with sufficient authority?
172
How do you ensure consistent quality compliance?
173
to continually define Quality Assurance guidelines.
174
# 1826 | Focus Area: CMMi - QUALITY
175
Make headway so that your company employees must
immediately report and remove any foreign objects found
to the Quality Assurance Department and production
supervisor.
176
Ask the Sr. Quality Systems Specialist:
177
departments on audit or quality assurance subject
matter.
178
What will the improvement of the forest management
yield?
179
Be confident that your company ensures the quality
assurance programs and policies are maintained and
modified regularly.
180
Does your organization determine action to eliminate the
causes of potential nonconformities in order to prevent
occurrence?
181
Does the design allow the use of efficient material
handling techniques?
182
# 1799 | Focus Area: Integrated IT Service
Management - DEVELOPMENT
183
Are audit trails reviewed according to the applicable
procedures?
184
# 1792 | Focus Area: ISO 26000 - PROJECT
185
Ask the Manager Finance Business Partnering:
186
long term improvement of quality assurance process,
workflow and QA department.
187
Are efforts at sustainability likely to succeed?
188
Develop strategies, systems and processes that deliver
enhanced quality assurance and efficiency.
189
# 1774 | Focus Area: Third Party Risk Management
- PROCESS
190
Should data analytics be an integral part of cybersecurity
assurance?
191
DEVELOPMENT
192
Does your organization have a board that provides
oversight of the operation?
193
# 1760 | Focus Area: data resource management -
QUALITY
194
marketing program/campaign objectives.
195
Ask the Supplier Quality Auditor:
196
What quality assurance systems do you put in place?
197
Ask the Senior Quality Manager:
198
Have operational goals been prioritized and the direction
been set for implementation?
199
Interface so that your staff partners heavily with relevant
technology area(s) to manage relationships with
enterprise Data Quality Management solutions vendors
including ensuring software maintenance levels are
reasonably current and updates and enhancements are
prioritized and planned effectively to align with overall
enterprise Data Quality Management plans.
200
What product quality assurance processes are in place to
ensure the quality of the COTS product?
201
Be confident that your organization collaborates and
assists QA and developers in solving quality assurance
issues.
202
Are the vendors practices and procedures focused on
providing high quality products and services?
203
# 1726 | Focus Area: APQP - QUALITY
204
supporting a high performing quality assurance team.
205
Does the vendor have sufficient resources to support
your organization?
206
Ensure your group ensures completion of the quality
assurance testing of the delivered solutions.
207
Ask the Director IT Quality & Compliance:
208
# 1709 | Focus Area: Process Audit - QUALITY
209
Program Management among others to ensure on time
delivery of Technology Transfer activities.
210
Why does your organization conduct a break even
analysis?
211
Utilize Quality Assurance methodologies to facilitate
issue resolutions, including root cause investigations
and effective corrective and preventive actions, which
involves using problem-solving disciplines like risk
analysis, FMEA, 5-Whys, 8D, etc.
212
response to questions and findings from Clinical Quality
Assurance (Quality Assurance) and other audits at the
study vendor level.
213
and accept positive feedback as well as constructive
criticism.
214
# 1689 | Focus Area: Application Security - BUILD
215
materials planning, procurement, supplier quality
assurance, productivity, materials systems, and (internal)
customer service.
216
# 1682 | Focus Area: Digital Workplace - QUALITY
217
reviewing and participating in the completion of various
quality assurance related documents.
218
# 1675 | Focus Area: Process Audit - QUALITY
219
Ask the Automotive Quality Manager:
220
Ask the Automotive Quality Manager:
221
Ensure your workforce prepares internal auditors and
coordinates technical and quality assurance audits.
222
Ask the Manufacturing Engineering & Quality Manager:
223
# 1658 | Focus Area: gxp - QUALITY
224
of the CMO or CEO.
225
dynamic knowledge economies?
226
Review calls for Quality Assurance according to
department guidelines and schedule monthly feedback
meetings with representatives.
227
personnel have the authority to approve or disapprove
suppliers for use?
228
Assess and recommend available automated quality
assurance solutions in the context of designing a UI
automated testing service.
229
Ask the Data Management Specialist:
230
Develop portfolio quality assurance framework, standards
and tooling.
231
# 1630 | Focus Area: Management Assistant -
QUALITY
232
Ask the Manager Quality Assurance:
233
# 1623 | Focus Area: APQP - QUALITY
234
Serve on various committees for the purpose of
formulating of policies and quality assurance methods.
235
# 1616 | Focus Area: laboratory information
management system - QUALITY
236
Ask the Specialist, Quality Engineering:
237
# 1609 | Focus Area: ISO 26262 - SOFTWARE
238
Work closely with Designers, Quality Assurance
Engineers, and Account/Project Managers to
communicate status of projects.
239
# 1602 | Focus Area: Package Engineering -
QUALITY
240
Ensure you have an understanding and thorough
interpretation of quality assurance sampling and
inspection techniques.
241
# 1595 | Focus Area: Supplier Performance
Management - QUALITY
242
Accelerator quality assurance solutions, systems, and
services.
243
# 1588 | Focus Area: Cloud Security Compliance -
VENDOR
244
Lead in the formulation, review, and direction of
policies, as well as quality assurance components of all
operations.
245
# 1581 | Focus Area: Must possess high motivation
- DEVELOPMENT
246
Ask the Supplier Quality Manager:
247
Ensure you are currently partnering with a large scale
manufacturer for a Quality Assurance Manager.
248
# 1570 | Focus Area: gxp - QUALITY
249
What are the key metrics or leading indicators necessary
to ensure quality improvement?
250
Develop quality assurance budget.
251
leadership as evidenced by project planning, problem
resolution, change control and quality assurance, in
accordance with established policy.
252
# 1557 | Focus Area: Catastrophe - QUALITY
253
# 1554 | Focus Area: Quality Assurance - QUALITY
254
# 1551 | Focus Area: Information management -
DATA
255
# 1548 | Focus Area: Quality Assurance - QUALITY
256
budgets, and goals.
What are the intended uses of the data and what level of
confidence does the use require?
257
What are the tangible business benefits resulting from
high performance practices in the financial, operational,
customer satisfaction, and product and service quality
areas?
258
What is contract management/administration?
259
# 1535 | Focus Area: Data Quality Assurance -
QUALITY
260
# 1532 | Focus Area: Quality Assurance - QUALITY
261
to test standards or goals that meet organizational
objectives; defines resources required to test and
revise components; advocates the formal evaluation of
products, solutions, services, and technology throughout
the organization; evaluates and adopts best practices for
quality assurance.
262
Ask the Supplier Quality Assurance Technician:
263
measures it uses to monitor the effectiveness of
delegated authority?
264
Do you identify analysts who will be able to carry out any
independent quality assurance functions?
265
# 1516 | Focus Area: Production Leveling - DATA
266
Manage quality assurance, control processes,
and programs by developing, implementing, and
administering quality standards and procedures assuring
product quality, continual improvement, and (internal)
customer satisfaction across 2 distribution center sites
10%.
267
programming teams internally to ensure highest quality
service and seamless operations delivery to (internal)
clients.
268
mission, and values?
269
# 1503 | Focus Area: Cloud Security Compliance -
DATA
Drive the overall vision and strategy for quality and strive
to continuously improve the development and quality
processes by assessing testing efforts at various stages
of development and at various layers of the applications
and by researching emerging tools and technologies.
270
Oversee that your company prepares and analyzes
internal and external quality reports for management staff
review.
271
appropriate operational and cyber safeguards of the
business objectives, reputation, and assets.
272
What is the evidence linking communication with safety
and quality?
273
# 1490 | Focus Area: Endpoint Protection Platform
- SOFTWARE
274
# 1487 | Focus Area: Succession Planning -
QUALITY
275
Make headway so that your organization performs
technical quality reviews of suppliers to support
purchasing personnel certifying suppliers.
276
Teams.
How did you ensure that data are the most up to date
available?
277
to the data strategy for the SIEM.
278
# 1474 | Focus Area: Linux - SYSTEMS
279
# 1471 | Focus Area: Quality Assurance - QUALITY
280
Ask the Quality Engineering and System Analyst
Manager:
281
How familiar are the team members with Agile methods?
282
# 1461 | Focus Area: inclusive family - QUALITY
283
Work with supervisors and management to ensure that all
associates are meeting quality standards.
284
Is the assumed process productivity consistent with
completed projects?
285
Execute test cases in the field and interpret and report
testing results, and be a vocal proponent for quality in
every phase of the development process.
286
control and configuration staff.
287
from the project development team?
288
Ask the Quality Management System (QMS) Coordinator:
289
Has configuration management and quality assurance
been used for tool software?
290
Support and maintain the multiple application
environments (development, quality assurance, staging
and production) required for software fixes and new
features to be developed, tested, and approved for use in
the production system.
291
Who participates in the planning process?
292
How will the Quality System be maintained, what scale of
resources are to be apportioned to it?
293
# 1423 | Focus Area: Data Quality Assurance - DATA
294
Ask the Data Analyst Online Application Specialist:
295
# 1416 | Focus Area: OpenShift - DEVELOPMENT
296
Service and Warehouse.
297
# 1409 | Focus Area: Data Quality Assurance -
QUALITY
298
# 1406 | Focus Area: Quality Assurance - QUALITY
299