Professional Documents
Culture Documents
HSE Auditing PDF
HSE Auditing PDF
Fundamentals, Skills
and Techniques for
Team Members
2005
Reference 20365
Copyright © 2005 by Arthur D. Little Limited. All rights reserved.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 2
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Table of Contents
Chapter Page
No
Overview of Environmental, Health, and Safety Auditing 5
Audit Approach 12
Basic Steps in the Typical Audit Process 23
Pre-Audit Activities 25
On-site Opening Activities 42
Understanding HSE Management Systems 55
Effective Interviewing 75
Preparing Working Papers 105
Assessing Strengths and Weaknesses 135
Gathering Audit Evidence 161
Sampling Strategies 189
Evaluating Audit Results 220
Writing Audit Findings 242
Post Audit Activities 260
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 3
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
List of Exercises
Exercise Page
No
1 Understanding HSE Management Systems 69
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 4
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 5
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing
Audit Programme
Investors/Shareholders Facilities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 6
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 7
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing –
What is Health, Safety and Environmental Auditing?
Management Tool
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 8
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing –
Definition of Health, Safety and Environmental
Auditing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 9
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing –
Definition of Health, Safety and Environmental
Auditing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 10
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Overview of Health, Safety and Environmental
Auditing –
Standards Against Which to Audit
Audit Criteria
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 11
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 12
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
Pre-Audit Activities
Post-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 13
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
Pre-Audit Activities
1. Initial planning
activities Identification of key site
issues
2. Document review
Preparation of detailed
plans
3. Audit plan preparation
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 14
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
On-Site Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 15
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
Principal Activities
What you look for Output
Deficiencies, problems, risks, Professional opinion as to
conformance with good practice performance with regard to
Assessment
(performed during Steps 1, 2 and 4) accepted practice and
recommendations for improvement
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 16
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
Step 1: Understand
Management Systems
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 17
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
Conducting interviews
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 18
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach
Post-Audit Activities
2. Distribute report
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 19
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach -
Context for Health, Safety and Environmental
Auditing
Supporting
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 20
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach -
Context for Health, Safety and Environmental
Auditing
Supporting
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 21
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Audit Approach –
Conducting Effective Audits
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 22
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Basic Steps in the Typical Audit Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 23
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Basic Steps in the Typical Audit Process –
Overview
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 24
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 25
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
• Pre-audit questionnaire
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 26
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 27
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
Pre-Audit Activities
Administrative Planning
Goal
Hit the ground running
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 28
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 29
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
• Planning/logistical details:
− Safety and security requirements
− Administrative/logistical details
− Initial interview schedule
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 30
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 31
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 32
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
Local laws, regulations, and ordinances related to the scope of the audit
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 33
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
Training records
Annual PCB reports (for the five years preceding the audit)
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 34
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
Planning/Logistical Details
During the team leader’s communications with the facility contact,
any planning details should be resolved, such as:
• Safety and security requirements
• Administrative/logistical details
• Initial interview schedule
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 35
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
• Establishing a time during the day when the audit team can
meet daily with the key HSE staff to discuss their preliminary
findings and concerns. These meetings are typically referred
to as daily debriefs.
Initial interview schedule. The team leader may want to obtain the
names of facility contacts to begin scheduling interviews with key
HSE staff for the first one or two days of the audit. The benefits
associated with having the team leader and the facility put
together an initial interview schedule with key HSE staff are two-
fold: 1) the facility is given an opportunity to feel a part of the
audit process and to establish interviews at convenient times,
lessening the impact on their day-to-day activities; and 2) the
audit team will be able to begin their understanding of how the
facility manages environmental, health, and safety areas
immediately after the opening meeting and orientation tour.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 37
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 38
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 39
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 40
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Pre-Audit Activities
Percentage
Activity
of Time
15 Understand the management system for assigned topics
Assess the apparent strengths and weaknesses of those
10
management systems
40 Gather audit evidence
30 Re-assess strengths and weaknesses and evaluate audit results
5 Formally report the audit findings to site management
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 41
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 42
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 43
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities –
A “Typical” Audit
11:00 - 12.00
Lunch Lunch Lunch Lunch Lunch
Understand
Details of
Systems Team Meeting
Team Meeting
2:30 - 5.30 4:00 - 5.30
4:30 - 5.30
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 44
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Purpose of the On-Site Opening Activities
The opening meeting and the orientation tour are the initial
activities undertaken by the audit team to begin their
understanding of the facility’s management systems.
On-Site Activities
Goal
Understand, who, what, where, how
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 45
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Conducting the Opening Meeting
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 46
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Conducting the Opening Meeting
Community issues
Regulatory climate
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 47
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Conducting the Opening Meeting
Necessary clearances
Safety rules and procedures
Work space for the team
Names of facility contacts
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 48
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Conducting the Orientation Tour
• Stay together.
• Focus on obtaining an
overview, not on making
inspections.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 49
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Reviewing the Audit Strategy
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 50
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Example of an Opening Meeting Discussion
Chemplant
Opening Meeting Discussion Guide
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 51
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Example of an Opening Meeting Discussion
Purpose
Scope
• Employee Safety
• Industrial Hygiene
• Loss Prevention
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 52
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Example of an Opening Meeting Discussion
Approach
Period of Review
Reporting
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 53
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
On-Site Opening Activities -
Example of an Opening Meeting Discussion
Report Schedule
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 54
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 55
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
Why Understand HSE Management Systems?
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 56
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
Why Understand HSE Management Systems?
Purpose
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 57
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
What Are Management Systems?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 58
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
What Are Management Systems?
Supporting
Training and awareness Documenting/recordkeeping Managing information
Organisation Resources
Foundation
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 59
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
What Are Management Systems?
Assessing is used by the facility for identifying Identify / evaluate HSE issues
Assessing conditions / aspects & materials on facility that Identify on-site hazards
“What do we need to
manage?”
have HSE implications, & for determining the Review HSE activities and projects
applicability of regulations Review applicable regulations
Planning is used by the facility for designing and Formulate HSE strategies & policies with clear
establishing programs & systems for HSE objectives & targets that reflect the importance of the
compliance HSE issues applicable on site
Develop HSE procedures for compliance & record
Planning keeping activities, as well as prevention plans with
“How should we manage
it?” specific operating criteria
Identify & design engineered controls & equipment
Develop emergency response procedures; create
procedures regarding critical HSE activities / issues or
departures from established criteria
Implementing is used by the facility for ensuring Acquire permits
effective and consistent implementation of its Disseminate policies & procedures
HSE programs Assign & communicate roles & responsibilities
Implementing Install, calibrate & maintain engineered controls
“Let’s manage it”
Handle situations that deviate from an established
standard
Undertake activities in accordance with established
schedules
Reviewing is used by the facility for measuring & Conduct drills
assuring HSE program effectiveness Conduct inspections / self-audits in accordance with
documented procedures
Reviewing Review compliance data / performance
“How are we doing?” Track continuous improvement
Review the effectiveness of management systems
Undertake corrective actions in response to identified
directors from procedures or established criteria
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 60
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
What Are Management Systems?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 61
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
The Methodology for Understanding HSE
Management Systems
Warningwith, if applicable)
Contains (or manufactured
(insert name of substance), a substance which har ms
public health and environ ment b y destro ying ozone
in the upper atmosphere
Warningwith, if applicable)
Contains (or manufactured
(insert name of substance), a substance which har ms
public health and environ ment b y destro ying ozone
in the upper atmosphere
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 62
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
The Methodology for Understanding HSE
Management Systems
Technique Activities
Talk to several people (e.g., line management, HSE staff,
Talk to Key
operating personnel, maintenance personnel) to obtain a
People
comprehensive understanding of the activities that are in place
to manage compliance and to increase your sense of
confidence in the information obtained.
Look at Key Walk around the facility to understand the nature of the HSE
Equipment/ issues that need to be managed and the types of engineered
Facilities controls in place. (This is primarily accomplished during the
orientation tour.)
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 63
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
The Methodology for Understanding HSE
Management Systems
Technique Activities
Review Key Briefly review procedures, plans, etc., that explain how the
Programme facility manages HSE obligations. For example:
Documents • Compliance-related programme documents
• Operational procedures
• Checklists or inspection forms
• Training programme description
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 64
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
The Methodology for Understanding HSE
Management Systems
Management
Things the Auditor Wants to Learn
Process
• How are regulations tracked (i.e., identifying, tracking,
Assessing
interpreting, and communicating regulations)?
• How are HSE risks and effects assessed (e.g., waste
stream inventory, air emissions inventory, natural
resources consumed, likelihood and magnitude of
unplanned events, potential exposure to hazardous
substances, etc.)?
• How does the facility manage changes in procedures or
facility design (e.g., HSE review and consideration for
new products, processes, equipment, acquisitions and
divestitures, maintenance modifications, etc.)?
• What type of basic compliance programmes (e.g.,
Planning
permitting, monitoring, training, recordkeeping,
reporting, etc.) have been or are being established and
do they include critical operating parameters and
schedules?
• How does the facility prepare for emergencies (e.g.,
developing scenarios, response capability, response
plans, etc.)?
• What type of issue-specific risk reduction programmes
(e.g., groundwater monitoring, pollution prevention,
waste management practices, spill containment
programmes, ergonomics, engineered controls, etc.) are
developed?
• What engineered controls or alarms are in place to help
achieve desired results?
• What measures have been taken to reduce the
likelihood of nonconformance with established criteria?
• What types of policy and related goals and objectives
are established (e.g., vision statements, basic policies
and guiding principles, specific goals and milestones,
etc.)?
• What strategies are developed for managing HSE risks
and effects?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 65
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
The Methodology for Understanding HSE
Management Systems
Management
Things the Auditor Wants to Learn
Process
• Has the facility fully implemented the various HSE
Implementing
programmes?
• How does the facility maintain operating equipment
(e.g., preventive maintenance programmes, testing and
monitoring, etc.)?
• How is nonconformance with established criteria
handled?
• Are facility operations being inspected (e.g., routine
Reviewing
walk-throughs, use of checklists, etc.)?
• How are HSE effects being measured?
• Does the facility analyse its performance (e.g., evaluate
“findings,” “lessons learned,” trends, etc.)?
• Are programmes in place for developing, implementing,
and tracking corrective actions?
• What formal training have key personnel had to assist
Training and
them in performing their HSE tasks and functions?
Awareness
• What training and awareness activities are conducted to
provide an understanding of HSE obligations and
responsibilities?
• What type of training programmes (e.g., compliance-
related training, emergency drills, on-the-job training,
etc.) are available?
• What types of experience or background are required to
perform HSE tasks?
• Are procedures and practices for both compliance and
Documenting
remediation generally written down?
and Record-
• What records are routinely developed and retained in
keeping
carrying out various tasks and functions?
• What exception reports are developed?
• What is the general nature or character of the
documentation that is developed?
• How does the relative importance of HSE activities
correspond to the nature and level of documentation that
is developed?
• Where is information retained?
• How long is information retained?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 66
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
The Methodology for Understanding HSE
Management Systems
Management
Things the Auditor Wants to Learn
Process
• How is important HSE information conveyed to
Managing
personnel?
Information
• Can the facility readily access HSE information?
• How does the facility ensure that reports are submitted
in a timely manner and that essential records are
retained?
• Are there procedures in place for responding to external
requests for information?
• How are responsibilities and accountabilities defined,
Organisation
established, and communicated?
• How are assignments of responsibilities reinforced?
• Are any key responsibilities overlapping, shared, or
conflicting?
• What potential exists for “conflict of interest” in
accomplishing key HSE tasks and functions?
• How is authority granted to carry out assigned
responsibilities?
• How have responsibilities for implementation been
Resources
communicated to personnel who need to know?
• Are there sufficient resources to carry out the various
HSE programmes?
• Who has the authority to waive adherence to, or
conformance with, an established standard or
requirement and are deviations recorded?
• Are there perfunctory approvals—authorisations without
understanding what is involved?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 67
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Understanding HSE Management Systems -
How Much is Enough?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 68
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 1A
Understanding HSE Management Systems -
Confined Space Entry
Objective
Background
Instructions
Other activities?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 70
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 1A – Potential Answers
Understanding HSE Management Systems -
Confined Space Entry
Other activities?
Ask to go and see the confined spaces
Ask to observe if any maintenance is scheduled during the audit
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 71
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 1B
Understanding HSE Management Systems -
Spill Control
Objective
Background
Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 72
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 1B
Understanding HSE Management Systems -
Spill Control
Other activities?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 73
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 1B – Potential Answers
Understanding HSE Management Systems -
Spill Control
Other activities?
Observe loading/unloading
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 74
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 75
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 76
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
Planning
Opening
Documenting
Conducting
Closing
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 77
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 78
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
Example Interviewee
Social Style Orientation
Questions/Responses
Analytical/ Technically- “What’s your methodology?”
Thinker oriented
“How will the results be used?”
Driving/Doer Results- “What can I do for you in the next ten
oriented minutes?”
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 79
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 80
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
+
Ended production capacity?” one-word answer.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 81
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
+++
process?”
Active Listening
Another important component to conducting successful
interviews involves active listening. Active listening allows the
interviewer to:
• Summarise information accurately.
• Test the interviewee’s understanding of the topic being
discussed.
• Probe for confirmation.
• Facilitate the interview.
• Display empathy/establish greater rapport.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 83
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
Nonverbal Communication
A significant portion of the information exchanged in any
interview is done nonverbally. Nonverbal communication is a
combination of the meanings expressed by the interviewer and
the interviewee through gestures, facial expressions, voice
inflections, and posture. Auditors should be aware of nonverbal
communication and pay attention to the following:
• Shake hands.
• Maintain eye contact.
• Keep the right distance.
• Tolerate silence.
• Mirror the interviewee’s body movements.
• Be sensitive to culture and customs (especially outside of your
native country).
Actions to Avoid
In addition to the positive actions that should be taken in
preparing for and conducting the interview, there are also some
actions the interviewer should avoid. These include:
• Debating with the interviewee or wasting time disagreeing on
any one point.
• Forcing a meeting with the interviewee if he/she is otherwise
occupied.
• Rushing the interview.
• Amplifying criticism given.
• Using sarcasm or subtle humor.
• Telegraphing your assessment of the interview.
• Jumping to conclusions/not watching your assumptions.
• Communicating incomplete or unsubstantiated findings or
conclusions.
• Using a tape recorder.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 84
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
Because the interviewee may feel that this phase of the interview
is his/her final opportunity to be heard, closing questions used by
the auditor can be extremely productive. Some examples
include:
• Is there anything you expected me to ask about that I did not
mention?
• A little earlier you said that...
• We have heard that...Is that really the way it is?
• Can you elaborate on that point?
• Would others say the same?
• Is it like that at other times/places/divisions/companies?
• Playing devil’s advocate, would some people fundamentally
disagree?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 85
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
• Never try to hide the fact that you are taking notes. Rather,
draw the interviewee’s attention to what you are doing by
explaining the need to take notes and involving the
interviewee in the process. If necessary, address the issue
regarding the confidentiality of working papers.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 86
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Effective Interviewing –
The Basic Interview Process
• Take notes about facts that are relevant to the audit. Avoid
listing points that do not relate to the audit topics of concern.
For example:
− Record name, title, and job description of person with
whom you spoke.
− Reference the appropriate protocol step(s) addressed in
the interview.
− Note relevant interview information.
− Highlight key statements/observations.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 87
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 2
Effective Interviewing - Difficult Interview Situations
Objective
Instructions
Scenario A
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 88
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 2
Effective Interviewing - Difficult Interview Situations
Scenario B
Scenario C
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 89
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 2
Effective Interviewing - Difficult Interview Situations
Scenario D
On the last day of the audit of the Orecrush Mill water pollution
control programme, you realise you have a specific question
about the site’s backflow prevention devices. You decide to call
Mr Ahraby, the wastewater treatment operator you spoke with
earlier in the week. After calling the treatment plant, you learn
that Mr. Ahraby is out sick and that Mr Karami, one of the on-duty
water treatment operators, is covering for Mr. Ahraby. You ask to
speak with Mr Karami; after he answers the telephone, you
explain that you spoke with Mr. Ahraby at length earlier in the
week and have a specific question regarding water backflow
prevention devices. Mr Karami answers, ‘I’d be happy to answer
any of your questions. In Mike’s absence, I’m responsible for the
entire wastewater treatment plant. Do you know this plant
handles 20,000 gallons of wastewater a day, seven days a
week? That’s over seven million gallons annually.’ You interrupt,
‘How interesting. Can you tell me if the backflow prevention
devices are routinely inspected?’ Mr Karami replies, ‘Sure. Why
just last week we had a full plant inspection. The inspectors even
made us clean out our personal lockers. I’ll tell you, that took
some doing. I had so much stuff in my locker that I couldn’t even
get it open . . . ‘
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc c 90
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 2
Effective Interviewing - Difficult Interview Situations
Scenario E
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 91
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 2 – Potential Answers
Effective Interviewing - Difficult Interview Situations
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 92
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3
Effective Interviewing - Conducting Interviews
Objective
Instructions
If you are No. 1 you will be the Observer for this role play. If you
are No. 2, you will be the Auditor. If you are No. 3, you will be
the Plant Representative. There are different sets of instructions
for your assigned role, which are on the following pages:
Environmental Specialists
No. 1 Observer Page 100
No. 2 Auditor Page 101 - 102
No. 3 Plant Representative Page 103 - 104
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 93
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3A
Effective Interviewing - Conducting Interviews:
‘Lockout/tagout’
Observer’s Instructions
Helpful Hint
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 94
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3A
Effective Interviewing - Conducting Interviews:
‘Lockout/tagout’
Auditor’s Instructions
Take time now to plan for the interview. Think how you will open,
conduct, and close the interview.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 95
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3A
Effective Interviewing - Conducting Interviews:
‘Lockout/tagout’
Auditor(s)/ Working
Comments Paper
Reference
Control of Hazardous Energy (Lockout/Tagout)
13. Examine documentation and interview key
personnel to confirm that a written hazardous
energy control programme has been
developed.
14. Review the written hazardous energy control
programme, interview affected personnel, and
review records. Confirm that:
a. Site and local management have
developed and implemented a written
hazardous energy control programme for
all operations where the unexpected
energising, startup, or release of stored
energy could occur and cause injury
b. Local management has provided the
necessary material (e.g. locks, chains,
tags) to their employees for implementing
the hazardous energy control programme
c. The facility has implemented a training
programme of lockout/tagout policies and
procedures, including locking isolation
valves
d. The facility has established a programme
to perform and document periodic
inspections (at least annually) of the
energy control programme
e. There are procedures for briefing
contractor personnel on the emergency
control procedures
f. Only authorised employees implement
energy control measures
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 96
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3A
Effective Interviewing - Conducting Interviews:
‘Lockout/tagout’
Auditor(s)/ Working
Comments Paper
Reference
15. Examine lockout/tagout devices dedicated to
controlling hazardous energy to confirm that
the element is included
a. Standardised throughout the facility
b. Able to withstand environmental conditions
c. Substantial enough to prevent accidental
removal
d. Traceable to the employee applying the
device
16. Interview employees who work in areas where
lockout/tagout devices are used to confirm that
they are notified prior to the application and
removal of a lockout/tagout device
17. Confirm that there are procedures in place to
ensure the continuity of lockout at shift change
and during group lockout/tagout activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 97
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3A
Effective Interviewing - Conducting Interviews:
‘Lockout/tagout’
Your role in this exercise is to play the part of the facility safety
supervisor, who is fairly co-operative, but is concerned about how
the audit findings will be presented to management. Although
you answer specific questions, you tend not to readily volunteer
information.
In this exercise, you are embarrassed by the fact that the facility
does not rigorously enforce its ‘one lock/one key’ policy.
Combination locks are sometimes used instead of keyed locks,
and several employees may know the combination. Also,
because of inadequate labelling of sources, there have been a
few recent instances in which a supervisor observed that the
wrong energy source was locked/tagged out. Although no actual
incidents occurred, this indicated a failure to verify isolation of the
equipment. You will withhold this information unless asked a
question that requires you, in all honesty, to reveal it. Do not lie,
but make the auditor probe.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 99
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3B
Effective Interviewing - Conducting Interviews:
Air Pollution Control
Observer’s Instructions
Helpful Hint
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 100
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3B
Effective Interviewing - Conducting Interviews:
Air Pollution Control
Auditor’s Instructions
Take time now to plan for the interview. Think how you will open,
conduct, and close the interview.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 101
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3B
Effective Interviewing - Conducting Interviews:
Air Pollution Control
Auditor(s)/ Working
Comments Paper
Reference
Understanding Management Systems
1. Obtain and document your understanding as to
how the facility manages its air emission
control programmes. Considerations may
include:
a. Emission source identification, registration,
and permitting
b. Emission control equipment
c. Monitoring programmes
d. Maintenance and inspection programmes
e. Training
f. Reporting and recordkeeping etc.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 102
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3B
Effective Interviewing - Conducting Interviews:
Air Pollution Control
You can feel free to share your skepticism of the audit and your
perspective that the plant has been and is in great shape.
Your facility does have 23 air permits, 26 air sources (stacks from
furnesses, process vents and drains), and 6 emission control
devices (scrubbers and dust collectors). You do monitor ambient
air for fugitive emissions but are not required to report the results.
Your maintenance department does inspect all control equipment
every six months as specified in your permit applications. You
are responsible for completing all emission inventories and
submitting them to the regulator.
In this exercise, you are embarrassed by the fact that the facility
has just recently (last month) undergone expansion that has
resulted in the installation of two new ovens for which the facility
did not obtain the required installation permits and does not have
operating permits. The facility has also added a flare without
revising the permit. Also, some of your permits are past their
expiration dates and timely re-applications were not submitted.
You will withhold this information unless asked a question that
requires you to tell the interviewer honestly about these
oversights. Do not lie, just make the auditor probe to discover
this fact.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 103
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 3B
Effective Interviewing - Conducting Interviews:
Air Pollution Control
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 104
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 105
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers
Definition of Working Papers
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 106
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers
Step 1:
Understand Management Systems Record understanding in working papers
Step 2:
Assess Strengths &
Weaknesses of Management Record assessment of soundness of
Systems system design
Step 3:
Gather Audit Evidence Document verification testing plan and results
Step 5: Working
Report Audit Findings Papers
Document audit findings
at exit meeting
Audit
Audit Follow-Up Report
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 107
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Purpose of Working Papers
• Provide data that support the audit report and that may be
useful in subsequent action-planning and follow-up activities.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 108
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Retention of Working Papers
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 109
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Working Paper Standards
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 110
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Confidentiality of Working Papers
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 111
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Techniques for Recording Information
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 113
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Techniques for Recording Information
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 114
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers –
Format
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 115
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers –
Format
2. Date
1. Applicable
protocol step
5. Source of
information
6. Tick marks
7. Referenced
exhibit
9. Initialed
cross-outs
10. Working
paper
references
4. Page number
11. Confidentiality
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 116
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers –
Example of Flowcharting
MAC p1 of 675
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 117
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Example of Organisational Charts
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 118
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Example of Interview Summary Notes
M DG 7 of 42
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 119
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Example of Descriptions of Actions Taken and Tests
Performed
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 120
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Example of an Interim Summary
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 121
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Example of “To Do” Items (pending and completed)
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 122
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Example of an Exhibit List
MDG - 85
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 123
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Review of Working Papers
1. On-Site Review
2. Post-Audit Review
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 124
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Preparing Working Papers -
Review of Working Papers
Format
Each working paper page is clearly labeled with the applicable protocol
step.
Content
All findings in the working papers have been included on the audit exit
meeting discussion sheet.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 125
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4
Preparing Working Papers
You will have the same role number (1, 2, or 3) as in the previous
interviewing exercise. However, the roles have been switched. If
your number is ‘1’, you will be the ‘Observer’ for this role play. If
your number is ‘2’, you will be the ‘Plant Representative’. If your
number is ‘3’, you will be the ‘Auditor’. There are different sets of
instruction for each role; please read only the instruction for your
assigned role, as listed on the following pages
Environmental Specialists
No. 1 Observer Page 131
No. 2 Plant Representative Page 132 – 133
No. 3 Auditor Page 134
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 126
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4A
Preparing Working Papers –
Safety Inspection Programme
Observer’s Instructions
Helpful Hint:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 127
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4A
Preparing Working Papers –
Safety Inspection Programme
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 128
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4A
Preparing Working Papers –
Safety Inspection Programme
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 129
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4A
Preparing Working Papers –
Safety Inspection Programme
Auditor’s Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 130
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4B
Preparing Working Papers – Spill Response
Observer’s Instructions
Helpful Hint
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 131
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4B
Preparing Working Papers – Spill Response
Tank Farm
Acrylonitrile 2 x 15,000 gallons
Toluene 1 x 10,000 gallons
Fuel Oil 2 x 10,000 gallons
Sulfuric Acid 1 x 10,000 gallons
Hexane 2 x 10,000 gallons
Isobutyl Methacrylate 1 x 5,000 gallons
Other
Chlorine 6 x 1-ton cylinders manifolded
at wastewater plant
12 x 1-ton full spares
Ammonia 1 x 20-ton tank
Emulsifiers 55-gallon drums
Catalysts 55-gallon drums
Other additives 55-gallon drums; 50-pound
bags
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 132
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4B
Preparing Working Papers – Spill Response
• The spill team has its own meeting room and storage area for
self-contained breathing apparatus, chemical resistant suits,
etc.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 133
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 4B
Preparing Working Papers – Spill Response
Auditor’s Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 134
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 135
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 136
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Purpose of Assessing Strengths and Weaknesses
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 137
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Process for Assessing Strengths and Weaknesses
Consider Potential Determine the range of potential impacts if a particular HSE issue is not
Impacts managed appropriately
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 138
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
General Approach for Considering Potential Impacts
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 139
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Assessing Health, Safety and Environmental
Management Systems
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 140
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
General Principles for Assessing Management
Systems
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 141
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
General Principles for Assessing Management
Systems
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 143
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
General Principles for Assessing Management
Systems
Management
Strengths Weaknesses
System Activity
Assessing Hired an outside Do not have formal procedure
consultant five years ago to review capital projects for
to review operations and wastewater impacts.
identify wastewater issues.
Do not keep P&IDs current.
Have hard copies (2004) of
regulations on site. Have not reviewed latest
Corporate HSE provides stormwater regulations.
monthly updates on
changes.
Planning Have formal inspection Do not have formal inspection
and preventive and PM programme for
maintenance (PM) laboratory equipment.
programme for
Wastewater Treatment Do not have written pollution
Plant equipment. prevention plan.
Management
Strengths Weaknesses
System Activity
Implementing Have continuous monitors Do not do sampling and
for wastewater flow, analysis of process-specific
temperature, and pH at inputs to Wastewater
outfall. Wastewater Treatment Plant.
Treatment Plant operator
is responsible for Have not identified points for
preventative measures. stormwater sampling.
Inspected and calibrated
weekly. Process upsets cause “slug”
flow to Wastewater Treatment
Periodically have outside Plant; no advance notice given.
laboratory analyze split
samples as quality control Laboratory wastewater goes to
check. Publicly owned treatment
works, not Wastewater
Treatment Plant.
Reviewing Reviewed and updated site Do not have formal self-
policies and procedures in inspection programme.
June 2000.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 145
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
General Principles for Assessing Management
Systems
Management
Strengths Weaknesses
System Activity
Resources Have sufficient number of
qualified staff for
Wastewater Treatment
Plant and lab.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 146
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Balancing Management Systems/Controls Strengths
vs. Potential Impacts
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 148
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Setting Priorities for Verification
Weak
Weak
Strong
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 149
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Setting Priorities for Verification
For example:
High/Weak
High/Strong
Low/Weak
Low/Strong
Level of Effort
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 150
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Assessing Strengths and Weaknesses -
Setting Priorities for Verification
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 151
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5A
Assessing Strengths and Weaknesses
Objective
Instructions
Potential Management
Protocol Element Impacts Systems Priority
(low/high) (weak/strong)
Hazardous Waste
Manifests
Waste Accumulation
and Storage
Waste Classification
Training
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 152
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5A
Assessing Strengths and Weaknesses
Based on interviews with selected key staff, you have learned the
following:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 153
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5A
Assessing Strengths and Weaknesses
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 154
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5A
Assessing Strengths and Weaknesses
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 155
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5B
Assessing Strengths and Weaknesses
Objective
Introduction
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 156
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5B
Assessing Strengths and Weaknesses
Based on interviews with selected key staff, you have learned the
following:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 158
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5B
Assessing Strengths and Weaknesses
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 159
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 5A – Potential Answers
Assessing Strengths and Weaknesses
Potential Management
Protocol Element Impacts Systems Priority
(low/high) (weak/strong)
Process Hazard
High Weak 2
Assessments / HAZOPs
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 160
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 161
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 162
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence -
Purpose of Gathering Audit Evidence
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 163
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
Task Description
1. Evaluate what needs to be done “What do I need to look at and how
much time do I have to do it?”
2. Determine the depth and rigor of “How deep do I need to dig? How many
review kinds of evidence do I need to gather?”
3. Select the types of evidence “What types of data will I gather and
needed and the methods to how can I collect them?”
gather them
4. Compare practices against “How does the facility rate against the
requirements applicable requirements?”
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 164
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 165
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
Following this step, the auditor should prioritise the steps that will
be completed. This task builds upon the priorities established
during Step 2. That is, if an auditor determined in Step 2 that
priority should be given to reviewing a facility’s respiratory
protection programme, he/she now needs to decide what
emphasis should be given to the various elements of the
respiratory protection programme—verifying that a written
programme has been established, training is conducted,
inspections are performed, etc. The auditor should base his/her
decisions on those elements that will provide the greatest
insights regarding the functioning/implementation of the
respiratory protection programme.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 166
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
4 2
Strong Don’t Dig? Dig Deep
After the auditor has determined how deep to dig, he/she is now
in a position to select what types of information to gather and
how.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 167
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
• If the spill plan has not been updated in four years, then
perhaps the auditor will need to focus efforts on gathering
physical data to determine whether and how current activities
compare against the elements of the plan.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 168
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 169
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
Physical Evidence
Documentary Evidence
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 170
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
Testimonial Evidence
Circumstantial Evidence
Examples The order and neatness of records and files, the attitudes of facility
personnel, the apparent relevance of facility staff’s background and
experience to their HSE responsibilities.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 171
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
1 Testing in this context does not mean effluent or emissions sampling or chemical analysis.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 172
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
Types of Testing
Retracing Data This test would uncover omissions in reported data and
involves reviewing the original data records to ensure that
all results are appropriately reported. For example, pH
strip charts might be reviewed to identify all excursions
from permit conditions. The auditor would then verify that
no excursions were omitted from the monthly Discharge
Monitoring Reports.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 173
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
5. Document Results
Which protocol steps were The verification strategy (i.e., what topics were
reviewed and which were not examined in depth and why).
What data were gathered and The testing plans that were utilised and the
the source information actually collected/reviewed by the
auditor.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 175
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Gathering Audit Evidence –
Basic Tasks
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 176
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6
Gathering Audit Evidence -
Developing Verification Strategies
Objective
Instructions
You should assume that you are in fact at Step 3 in the audit
process, that you have already spoken with the key HSE
personnel, and that you have a general understanding of
management systems.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 177
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6A
Gathering Audit Evidence -
Developing Verification Strategies: Contractor’s
Safety
Background
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 178
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6A
Gathering Audit Evidence -
Developing Verification Strategies: Contractor’s
Safety
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 179
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6A
Gathering Audit Evidence -
Developing Verification Strategies: Contractor’s
Safety
Instructions
• When you have decided what you could do, decide which of
these data-gathering activities you would do to address the
highlighted protocol steps.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 180
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6A
Gathering Audit Evidence -
Developing Verification Strategies: Contractor’s
Safety
What evidence
would you
gather?
Where or from
whom would
you gather the
evidence?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 181
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6B
Gathering Audit Evidence -
Developing Verification Strategies: Hazardous Waste
Manifests
Background
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 182
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6B
Gathering Audit Evidence -
Developing Verification Strategies: Hazardous Waste
Manifests
b. Compare the waste streams shipped off site to your list developed
previously. For those materials not covered by Waste Manifests
during the review period, interview staff in the operating area(s) where
the waste is usually produced and determine if the waste was
generated during the review period. If so, resolve how this stream
was disposed of without being covered by Waste Manifests.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 183
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6B
Gathering Audit Evidence -
Developing Verification Strategies: Hazardous Waste
Manifests
Instructions
• When you have decided what you could do, decide which of
these data-gathering activities you would do to address the
highlighted protocol steps.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 184
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6B
Gathering Audit Evidence -
Developing Verification Strategies: Hazardous Waste
Manifests
What evidence
would you
gather?
Where or from
whom would
you gather the
evidence?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 185
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6A– Potential Answers
Gathering Audit Evidence -
Developing Verification Strategies
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 186
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6B– Potential Answers
Gathering Audit Evidence -
Developing Verification Strategies
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 187
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 6B– Potential Answers
Gathering Audit Evidence -
Developing Verification Strategies
How would • Compare the drums • Check consignment • Ask the HSE
in the hazardous note signed copy coordinator /
you test the
waste storage area from the waste maintenance
facility’s to the information on disposal company, manager how they
management the accumulation where applicable. obtain the
systems to storage logs. • Compare Waste information
address the • Check the Manifests versus the regarding various
highlighted accumulation start annual hazardous wastes generated
protocol dates on the waste report. (i.e., waste
steps? hazardous waste • Compare Waste characterisation,
drums to determine Manifests versus time generated etc.).
if drums are being waste profiles and/or • Ask affected
stored over 90 days. process information employees how they
• Review facility to verify correctness manage the
processes to identify of waste hazardous waste
potential hazardous classification. accumulation area.
waste streams and • Compare lists • Ask the records
compare to the versus Waste clerk how she/he
facility’s identified Manifests. manages the
waste streams. • Review purchasing / hazardous waste
shipping records consignment note
and verify that records (e.g.,
Waste Manifests are retention, signed
on file for a sample copy from the waste
of shipments. disposal company
etc.).
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 188
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 189
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 7
Sampling Strategies 1
Objective
Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 190
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Overview
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 191
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 192
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
Sampling Methods
Judgmental Probabilistic
Random
Block
Interval
Stratification
3. Select Sampling Method
Judgmental Sampling
Judgmental sampling is used to gather examples of deficiencies
or problems to support an auditor’s assessment of a weak or
improper health, safety and environmental management system.
Sampling is directed toward segments of the population where
problems are likely to exist. Judgmental sampling cannot be
used to draw compliance conclusions about an entire population
because it focuses on only a portion or subset of that population.
Judgmental sampling can be used as a first step to provide the
auditor with an indication of whether to use a probabilistic
sampling technique such as random, block, interval, or
stratification sampling.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 193
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
Probabilistic Sampling
Random. The objective is to select items by a statistically-based
chance. If properly done, each item in the population should
have an equal chance of being selected, and there should be no
subjective determinations to bias the sample. (Note: For auditing
purposes, “random” is not the same as “haphazard.” Haphazard
means “characterised by lack of order or planning; aimless;
independent of any reasoning process.” An example of
haphazard sampling would be closing your eyes and grabbing
one file out of a drawer.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 194
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
• The auditor must be sure that the sample size is large enough
to be representative of the total population.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 195
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
5. Document Results
A B C
(These percentages do not imply any specific confidence level but are intended as
guidelines only.)
The random number table (on the following page) is intended for
use when the auditor has chosen random sampling as the
preferred sampling method. (See discussion above on “random
sampling.”) To use the table, start at any location on the table;
then, moving in a given direction (across, down, or up), identify
the numbers in sequence. For example, in randomly selecting 25
of 90 records, designate values of 1 to 90 for each record, then
moving along the table in the direction you have chosen, use the
first two digits of each number to choose 25 records. Assuming
you start in the upper left-hand corner of the random number
table, and move down, your first number is 104 (record 10); the
second number is 465 (record 46); the third number is 225
(record 22); etc. If you get a duplicate or a number outside the
defined range, ignore it. Stop when you have 25 records to
review.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 197
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 198
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Sampling Strategies –
Basic Sampling Process
Sampling Strategies
Random Sampling
Block Sampling
Interval Sampling
Stratification Sampling
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 199
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
Objective
Background
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 200
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 201
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 202
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
R B I S
1 Maintenance Domingo, P.
2 Maintenance Bell, M.
3 Maintenance Cort, A.
4 Maintenance Greeno, L.
5 Maintenance Herald, M.
6 Maintenance Higgins, H.
7 Maintenance Getchell, M.
8 Maintenance Jones, T.
9 Maintenance Monteiro, L.
10 Maintenance Obbagy, J.
11 Maintenance Plunkett, J.
12 Maintenance Reid, R.
13 Maintenance Rotberg, F.
14 Maintenance Savoie, M.
15 Maintenance Sellers, G.
16 Maintenance Young, R.
17 Operator Allen, M.
18 Operator Arnold, E.
19 Operator Bach, J.S.
20 Operator Bateman, R.
21 Operator Butler, L.
22 Operator Catmur, J.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 203
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
R B I S
23 Operator Cavalcanti, C.
24 Operator Coburn, T.
25 Operator Davanzo, L.
26 Operator DiBerto, M.
27 Operator Fitch, T.
28 Operator Fletcher, J.
29 Operator Harris, J.
30 Operator Hasselreis, D.
31 Operator Hryciuk, R.
32 Operator Jones, M.
33 Operator Lennon, J.
34 Operator Lewis, S.
35 Operator Loren, S.
36 Operator McGinnes, M.
37 Operator McLean, R.
38 Operator Moody, C.
39 Operator Murray, E.
40 Operator Neville, N.
41 Operator Nott, M.
23 Operator Nureyev, R.
43 Operator Patel, B.
44 Operator Picasso, P.
45 Operator Ryder, W.
46 Operator Schmidt, H.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 204
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
R B I S
47 Operator Smith, F.
48 Operator Smith, J.
49 Operator Smith, N.
50 Operator Stone, O.
51 Operator Tallchief, M.
52 Operator Umscheid, M.
53 Operator Voeller, R.
54 Operator Wescott, W.
55 Operator Windsor, C.
56 Operator Yetskalo, V.
57 Supervisor Berstein, L.
58 Supervisor Boehm, P.
59 Supervisor Canton, C.
60 Supervisor Capogna, S.
61 Supervisor Dolittle, E.
62 Supervisor Ferguson, S.
63 Supervisor Fonteyn, N.
64 Supervisor Gedanke, M.
65 Supervisor Harris, R.
66 Supervisor Hedstrom, G.
67 Supervisor Hill, R.
68 Supervisor Hogwood, C.
69 Supervisor Lopez, D.
70 Supervisor Major, J.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 205
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
R B I S
71 Supervisor Moore, T.
72 Supervisor Morrison, J.
73 Supervisor Nutty, P.
74 Supervisor Parigot, M.
75 Supervisor Presley, E.
76 Supervisor Robinson, J.
77 Supervisor Shrimpton, J.
78 Supervisor Starr, R.
79 Supervisor Stricoff, S.
80 Supervisor Thomas, M.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 206
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 207
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 208
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8
Sampling Strategies 2
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 210
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers
Sampling Strategies
1. Random
The total population is 80 and you have decided that this is an
important issue for the audit. The suggested minimum sample
size is therefore 25%. You therefore want to pick 20 random
numbers between 1 and 80.
13 36 24 6
54 19 51 18
26 41 59 77
43 75 4 15
12 46 11 16
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 211
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
7 of 16 maintenance workers
10 of 40 operators
3 of 24 supervisors
2. Block
For this type of information, the most logical “block” method to
use might be by the first letter of the last name, by generating
random numbers between 1 and 26. Using the random number
generator on a programmable pocket calculator, you might have
selected the numbers : 8, 18, 1, 14, 23 and 4 which correspond,
respectively, to last names beginning with H, R, A, N, W and D.
A quick count tells you that the first four of these letters will be
enough to give a sample of 20.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 212
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
3. Interval
To get a 25% sample, you need to select every fourth name on
the list. You could choose any number between 1 and 4 as the
starting point.
4. Stratified
Suppose you decided that annual retraining was very important
for the operators, less important for the maintenance workers,
and a relatively low priority for the supervisors. The guidelines
would then suggest sampling 50% of the operators, 40% of the
maintenance workers, and 20% of the supervisors. Applying the
interval method within each stratum would require taking every
third maintenance worker, every other operator, and every fifth
supervisor.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 213
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
Analyze Results
1. Random
Five of the sample of 20 had not received training, according to
the records. Of these, 3 were maintenance workers, 1 was an
operator, and 1 was a supervisor.
2. Block
Seven of the sample of 20 had not received training, according to
the records. Of these, 3 were maintenance workers, 3 were
operators, and 1 was a supervisor.
3. Interval
Six of the sample of 20 had not received training, according to
the records. Of these, 1 was a maintenance worker, 4 were
operators, and 1 was a supervisor.
4. Stratification
Three of the sample of 6 maintenance workers and 7 of the
sample of 20 operators had not received training, according to
the records. All of the supervisors in this sample of 5 had
received training. (Note: When using this method, it is not correct
to combine the results and say “10 out of a sample of 31”.)
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 214
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 215
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
Table 1
Employee Roster
No Job Category Employee Sampling Trained in
Name Method Chosen Past Year
(Y/N)
R B I S
1 Maintenance Domingo, P. B S Y
2 Maintenance Bell, M.
3 Maintenance Cort, A. I Y
4 Maintenance Greeno, L. R S N
5 Maintenance Herald, M. B N
6 Maintenance Higgins, H. R B Y
7 Maintenance Getchell, M. I S N
8 Maintenance Jones, T.
9 Maintenance Monteiro, L.
10 Maintenance Obbagy, J. S Y
11 Maintenance Plunkett, J. R I Y
12 Maintenance Reid, R. R B N
13 Maintenance Rotberg, F. R B S N
14 Maintenance Savoie, M.
15 Maintenance Sellers, G. R I Y
16 Maintenance Young, R. R S Y
17 Operator Allen, M. B S N
18 Operator Arnold, E. R B Y
19 Operator Bach, J.S. R I S Y
20 Operator Bateman, R.
21 Operator Butler, L. S Y
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 216
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
R B I S
22 Operator Catmur, J.
23 Operator Cavalcanti, C. I S Y
24 Operator Coburn, T. R Y
25 Operator Davanzo, L. S Y
26 Operator DiBerto, M. R Y
27 Operator Fitch, T. I S N
28 Operator Fletcher, J.
29 Operator Harris, J. B S N
30 Operator Hasselreis, D. B Y
31 Operator Hryciuk, R. B I S Y
32 Operator Jones, M.
33 Operator Lennon, J. S Y
34 Operator Lewis, S.
35 Operator Loren, S. I S Y
36 Operator McGinnes, M. R Y
37 Operator McLean, R. S Y
38 Operator Moody, C.
39 Operator Murray, E. I S Y
40 Operator Neville, N. B Y
41 Operator Nott, M. R B S Y
23 Operator Nureyev, R. B Y
43 Operator Patel, B. R I S N
44 Operator Picasso, P.
45 Operator Ryder, W. B S N
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 217
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
R B I S
46 Operator Schmidt, H. R
47 Operator Smith, F. I S N
48 Operator Smith, J.
49 Operator Smith, N. S Y
50 Operator Stone, O.
51 Operator Tallchief, M. R I S Y
52 Operator Umscheid, M.
53 Operator Voeller, R. S Y
54 Operator Wescott, W. R Y
55 Operator Windsor, C. I S N
56 Operator Yetskalo, V.
57 Supervisor Berstein, L. S Y
58 Supervisor Boehm, P.
59 Supervisor Canton, C. R I Y
60 Supervisor Capogna, S.
61 Supervisor Dolittle, E.
62 Supervisor Ferguson, S. S Y
63 Supervisor Fonteyn, N. I Y
64 Supervisor Gedanke, M.
65 Supervisor Harris, R. B Y
66 Supervisor Hedstrom, G. B N
67 Supervisor Hill, R. B I S Y
68 Supervisor Hogwood, C. B Y
69 Supervisor Lopez, D.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 218
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 8 – Potential Answers (continued)
Sampling Strategies
R B I S
70 Supervisor Major, J.
71 Supervisor Moore, T. I Y
72 Supervisor Morrison, J. S Y
73 Supervisor Nutty, P. B Y
74 Supervisor Parigot, M.
75 Supervisor Presley, E. R I N
76 Supervisor Robinson, J. B Y
77 Supervisor Shrimpton, J. R S Y
78 Supervisor Starr, R.
79 Supervisor Stricoff, S. I Y
80 Supervisor Thomas, M.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 219
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 220
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 221
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
There is a Everything is
problem OK
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 222
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Relevance
Objectivity
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 223
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Persuasiveness
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 224
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
• Written respiratory
Respiratory The facility has √
protection programme has
protection implemented an
been prepared.
programme. effective
• Fit testing and medical
respiratory √
protection clearance have been
programme. performed.
• Periodic inspections of
√
respirators are conducted.
• Personnel are trained in
√
the use and maintenance
of respirators.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 225
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Listed below are some basic techniques for the auditor and audit
team to consider in evaluating audit results and determining if
there are sufficient data to substantiate the findings.
As an Individual
2. Summarise Conclusions
Having satisfied him/herself that he/she has gathered sufficient
evidence for each assigned protocol topic, the auditor should
next summarise his/her conclusions and outline his/her findings.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 226
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
As a Team
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 227
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 228
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Two unlabelled 25-liter drums were observed on the concrete pad behind the
fire water pump building. (Containers elsewhere at the site were labelled
properly.)
One wooden ladder being used outside the aerosol gas house was found to be
unstable. Facility personnel removed and disposed of it immediately. (The
team did not note any other defective ladders.)
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 229
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9
Evaluating Audit Results -
Specific “Local” vs. “Report” Decisions
Objective
Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 230
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9
Evaluating Audit Results -
Specific “Local” vs. “Report” Decisions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 231
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9
Evaluating Audit Results -
Specific “Local” vs. “Report” Decisions
a. The facility has not measured the air flow for the hood in the
quality control laboratory at any time since installation, when
the flow was checked by the vendor.
b. The facility has not measured the air flow for the hood in the
quality control laboratory at any time since installation, when
the flow was checked by the vendor. There are no flow
measurement instruments available on site for testing the
performance of ventilation systems used for air contaminant
exposure control in the process areas; flows in process areas
are checked once yearly by a contractor.
c. The facility has not measured the air flow for the hood in the
quality control laboratory at any time since installation, when
the flow was checked by the vendor. There are no flow
measurement instruments available on site for testing the
performance of ventilation systems used for air contaminant
exposure control in the process areas; flows in process areas
are checked once yearly by a contractor. The site has
installed three new ventilation systems since the last
contractor inspection; no flow measurements have been
made on these systems.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 232
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9
Evaluating Audit Results -
Specific “Local” vs. “Report” Decisions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 233
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9
Evaluating Audit Results -
Specific “Local” vs. “Report” Decisions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 234
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9
Evaluating Audit Results -
Specific “Local” vs. “Report” Decisions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 235
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 9 – Potential Answers
Specific “Local” vs. “Report” Decisions
You may find that this opinion may change in the light of
additional background information. For example the
recommended answers for set 2 would be dependent on what
the ventilation hood is used for, its toxicity and the frequency of
exposure to employees.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 236
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
For example, the audit team may have several findings all related
to the same general topic, such as training, and the findings
themselves all point to the underlying management systems
deficiency that there is no means to identify and track HSE-
related training.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 237
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Individual
Individualfindings
findingsrelated
relatedto:
to: The
Themanagement
managementsystem
system
deficiency:
deficiency:
Hazardous
Hazardouswaste
wastetraining
training
Spill
Spillresponse
responsetraining
training No
Nomeans
meanstotoidentify
identifyand
andtrack
track
Hazard
Hazardcommunication
communicationtraining
training HSE-related
HSE-relatedtraining
training
Respirator
Respiratoruse
usetraining
training
Confirmed
Confirmedspaces
spacesentry
entrytraining
training
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 238
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 239
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Finding
The facility exceeded its wastewater pH limit on several occasions during
the review period. Upon investigation, the team learned that the wastewater
treatment system controls had not been maintained regularly and, thus,
failed to properly adjust the pH of the effluent.
Incident/Effect
An exceedance of the pH (level of acid/base) was noted at the wastewater
treatment plant.
Possible Causes
• Failure of pH controls resulting from lack of maintenance
• Training
• Inspection
• Lack of redundant systems
• Wrong equipment
• System to ensure QA (procedures)
• Labor shortage
Finding
During the audit, the team observed that the employee’s hand could be
pulled into the mobile pumping unit because the unit does not have a guard.
Upon investigation, the team learned that the guard had been removed to
make access to the equipment easier and a system is not in place to
periodically verify that guards are in place where required.
Incident/Effect
The belt-driven pulley on mobile pumping unit 5123 does not have a guard.
Possible Causes
• Training
• Inspection
• Lack of equipment
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 240
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Evaluating Audit Results
Cause 1 Incident
Cause 2
Cause 3
Root cause
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 241
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 242
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
State the facts as you have discovered them but avoid drawing
overly broad conclusions.
The facility does not have a PCB The facility’s PCB inspection
inspection programme. programme does not include PCB-
contaminated transformers.
Weekly ladder inspections are not Weekly ladder inspections are not
conducted. documented.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 243
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
3. Avoid Generalities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 244
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Hazardous waste drums were not Drums storing hazardous waste were
labeled as required by 40 CFR not labeled with the words, “Hazardous
262.34. Waste,” or other words indicating their
contents. (40 CFR 262.34(c)(1)(ii))
During the review period, the facility During the review period, the facility did
was not in compliance with 29 CFR not conduct annual hearing
1910.95. conservation training. (29 CFR
1910.95)
Because the basis for a finding may not always be clear to the
report recipient, particularly if the report recipient is an individual
who is not involved with environmental, health, and safety issues
on a daily basis, regulatory or company policy references should
be included.
Poor Improved
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 245
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Poor Improved
Poor Improved
The facility does not have pollution The facility does not have pollution
prevention equipment to prevent prevention equipment to prevent
exceedances of TSS, BOD, and oil and exceedances of total suspended solids
grease in its discharges to the POTW. (TSS), biochemical oxygen demand (BOD),
and oil and grease in its discharges to the
publicly owned treatment works (POTW).
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 246
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Poor Improved
John Doe and Jane Smith were The team observed maintenance
observed . . . . personnel . . . .
Poor Improved
Although the facility has a well-written The facility’s waste analysis plan
waste analysis plan, it does not does not include the following:
include parameters for each
hazardous waste analyzed or the a. Parameters for each hazardous
frequency of analysis. waste analyzed.
b. Frequency of analysis.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 247
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Poor Improved
Individual Grouped
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 248
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Individual Grouped
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 249
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 250
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
A Sharper Picture
Clearly Defined Responsibilities
The recent organisation has left undefined the issue of whether the new HSE
Manager position shares any joint responsibilities or accountabilities with the
now combined Engineering and Maintenance department.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 251
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Tracking of Training
The facility has not developed a comprehensive system for tracking the
movement of employees who change job positions to ensure that regulatory
required training is provided in a timely fashion. For example, environmental
management staff do not know which employees (some may be security
contractors) are responsible for chemical and petroleum product loading and
unloading.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 252
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 253
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Writing Audit Findings
Adequate Occasionally
Inadequate Insufficient
Some Compliance
Few Noncompliance
Many Required
Not all Violation
Sometimes
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 254
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 10
Writing Audit Findings - Critiquing Audit Findings
Objective
Instructions
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 255
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 10
Writing Audit Findings - Critiquing Audit Findings
Audit Team Present John Collins, Brenda Fields, Bob Taylor, Jane Smith
# Exception Critique
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 256
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 10
Writing Audit Findings - Critiquing Audit Findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 257
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 10 – Potential Answers
Writing Audit Findings - Critiquing Audit Findings
Audit Team Present John Collins, Brenda Fields, Bob Taylor, Jane Smith
# Exception Critique
1 We could not verify that waste manifests − Implies auditor has not done job
were received from TSDFs within 45 days properly
of shipment.
− Need to include citation
− What does TSDF stand for?
2 Current storage of emergency response − Should not use ambiguous terms
equipment may result in increased (e.g. may, increased)
likelihood of failure.
− So what?
− Which equipment?
3 There is minimal on-site compliance with − Not specific
corporate or department contractor safety
policy and procedures. − Does not describe problem to help
site correct it
4 Some of the air sources are being − Do not use “some” or “proper” or
operated without proper permits and some “adequately”
are not adequately maintained.
− Be specific; which sources, how
many?
5 The facility’s central MSDS file is very neat − What does MSDS stand for?
and accessible to those employees who
should see it. Not all materials used or − Combines good and bad findings
stored by the facility have MSDSs in the − Do not use “not all” or “appeared”
central file. Those MSDSs reviewed
appeared complete and contained the
appropriate information.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 258
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Exercise 10 – Potential Answers
Writing Audit Findings - Critiquing Audit Findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 259
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 260
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities
Conduct Follow-up
Step 4: Evaluate Audit Results Track status of corrective
Evaluate audit results actions
Write audit findings Confirm closure of findings
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 261
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Introduction
Objectives Responsibilities
• To ensure that the audit results Meeting this objective is typically part
are clearly communicated to the of the audit team’s responsibility. This
appropriate levels of management. is accomplished by means of a formal,
written audit report, as described in
this section of the manual.
• To ensure that all audit findings Meeting this objective is typically the
are addressed by management responsibility of line management,
through the implementation of a although the audit team may be asked
formal corrective action process.
to make recommendations, review
proposed action plans, and/or track
the implementation and closure of
corrective action.
• To evaluate the effectiveness of Meeting these last two objectives is
the audit and provide suggestions frequently among the responsibilities
for improving future efforts. of the audit programme manager and
team leader(s).
• To share lessons learned during
the audit, especially to similar
facilities.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 262
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 263
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Report Recipients
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 264
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
I. Introduction
Purpose, date, and scope of the audit
Name, location, and description of the audited site
Names of the audit team members
Criteria utilised in performing the audit
Deviations from the planned scope
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 265
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Similarly, ISO 14000 (ISO 14010, Section 5.7 and ISO 14011,
Section 5.4.2) describes the contents of the audit report as
follows:
The audit report should be dated and signed by the lead auditor. The audit
report should contain the audit findings or a summary thereof with reference to
supporting evidence. Subject to agreement between the lead auditor and the
client, the audit report may also include the following:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 266
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 267
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Exceptions Only
3. Etc.....
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 268
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Recommendations
The facility should require that the The facility should establish
plant environmental coordinator authorisation procedures to ensure
review all proposed changes to that accountable personnel assess the
process chemicals. impacts of process chemical changes
on waste stream characteristics.
The facility should hire an industrial The facility should assess the need for
hygienist and two additional process additional industrial hygiene and
safety engineers. process safety resources to perform
an employee exposure assessment
and process hazards analysis in units
A, B, and C.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 269
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Audit Opinion
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 270
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Opinion Criteria
On the basis of its review, the audit The facility is in compliance with all (or
team believes that the environmental, virtually all) of the applicable
health, and safety programmes and requirements included in the audit scope.
practices that were reviewed meet Isolated exceptions to a few requirements
governmental and internal are noted, but are judged to be
requirements. occasional, anomalous, and
inconsequential in comparison to the
level of compliance achieved.
On the basis of its review, the audit Audit results substantiate a high degree
team believes that the environmental, of compliance. Only a few requirements
health, and safety programmes and are not satisfied. These represent
practices that were reviewed isolated weaknesses in implementation of
substantially meet governmental and an otherwise effective compliance
internal requirements. programme.
Strengths
In its review of the facility’s programmes and practices, the team noted the
following as areas of real strength:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 272
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Executive Summary
A health, safety and environmental (HSE) audit was conducted at ABC Company’s XYZ facility
on Month/Day/Year. The time period under review was January 1, 199X, through the last day
of the audit. The purpose of the audit was to verify compliance with applicable federal, state,
and local safety and health laws and regulations. The scope of the audit included air pollution
control, water pollution control, solid and hazardous waste management, industrial hygiene,
employee safety, and loss prevention. Specific deficiencies in the HSE programmes and
practices are described in detail in the body of this report.
On the basis of its review, the audit team believes that XYZ facility will need to develop and
implement more formal HSE management programmes to achieve the HSE goals recently
established by facility management. In the audit team’s opinion, the HSE programmes
currently in place are heavily dependent upon the capability and good intention of facility
personnel and are being implemented in the absence of clearly defined written procedures and
plans. In addition, the level of familiarity with regulatory obligations varied among the staff
responsible for HSE compliance activities.
The management of XYZ facility in Anytown, Anystate, has initiated a programme to ascertain
the status of HSE programmes on site, to develop appropriate corrective actions to remediate
problems, and to develop overall systems to ensure compliance with governmental rules and
regulations. In addition, the facility has undergone a recent management reorganisation
creating a more centralised HSE group. Thus, these activities represent an increased
commitment to manage compliance.
To develop more formal HSE programmes suitable to the operations of XYZ facility, we
recommend the following for consideration:
• Developing clearly stated and well-defined descriptions of roles and responsibilities for all
HSE activities, and communicating those to facility staff.
• Undertaking a facility programme to periodically review and monitor HSE compliance and
to identify problems.
• Developing an active, formal training and awareness programme for key staff in all areas
of HSE requirements.
Lastly, we believe the facility should continue in its efforts to identify and assess site
contamination and to develop appropriate remedial plans.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 273
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Preparation of Audit Reports
Explanation of Requirements
In many instances, the readers of audit reports are not all equally
familiar with the regulatory or company policy requirements to
which the team has identified exceptions. In these situations, it
may be helpful for the audit report to include a brief description of
the regulation or company policy that is being cited as the basis
for the finding. For ease of reading, it is useful to identify the
requirement and the exception separately. For example:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 274
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities –
Audit Policy Statement
One of the most common concerns with audit reports and audit-
related documentation is the risk of disclosure in an enforcement
or litigation situation. Therefore, many organisations will
establish or utilise one or several mechanisms to protect their
audit results. Some of the various means that can be used to
protect audit results include:
• Physical limitations on distribution
• Attorney-client privilege
• Attorney work product
• Audit privilege
Attorney-Client Privilege
Attorney-client privilege protects the confidential communications
between a “person” (who may, in fact, be a company) and his/her
attorney. Legal protection under this privilege requires that:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 276
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities -
Quality Assurance in the Audit Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 277
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities -
Quality Assurance in the Audit Process
Auditor Name
Facility Audited
Audit Dates
Team Leader/Reviewer
1 2 3 4 5
Technical Knowledge
• HSE science and
technology
• Facility operations
• Regulatory requirements
• HSE management systems
• Audit procedures and
techniques
− Interviewing
− Using the protocol
− Keeping working papers
− Writing findings
Personal Attributes
• Clarity in oral
communication
• Foreign language capability
• Diplomacy, tact, and
listening skill
• Independence and
objectivity
• Personal organisation and
time management
• Ability to reach sound
judgments based on
objective evidence
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 278
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities -
Quality Assurance in the Audit Process
Customer/Facility Feedback
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 279
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities -
Quality Assurance in the Audit Process
Location
Date of Audit
Responder
Comments:
_____________________________________________________________________________
_____________________________________________________________________________
_____________________________________________________________________________
_____________________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 280
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Post-Audit Activities -
Quality Assurance in the Audit Process
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 281
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix A
Confirmation Letter
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 282
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix A
Confirmation Letter
*[Date]
*[Name]
*[Title]
*[Company]
*[Address]
*[City, State]
Dear __________:
The audit will address air pollution control, water pollution control, spill control and
emergency response planning, solid and hazardous waste management, underground
storage tanks, soil and groundwater contamination, drinking water management,
PCB management, employee safety, loss prevention, and industrial hygiene as well
as company policies, guidelines, etc. The audit team will arrive on site on *[Date].
They would like to meet with you and other appropriate personnel on Monday
morning to briefly describe the audit and to answer any questions. At that opening
conference, it would be helpful if the team could receive a brief description of the
current organisation and operations at the facility as well as an orientation tour.
Those facility personnel involved with environmental, health, and safety activities
will be needed on site for discussions during the audit week.
At the conclusion of the audit, the audit team will again meet with you and other
appropriate personnel to discuss the team’s findings. This closing conference is a
critical part of the audit, and it is very important that you be present.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 283
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix A
Confirmation Letter
*[Date] Page 2
*[Name]
*[Title]
*[Company]
The audit team will make its own lodging and transportation arrangements,
including cars for use during the week. A dedicated meeting room (work area) is
needed at the facility with one large conference table or several smaller tables to
accommodate the team members and their working papers. Also, access to a
telephone and a copier would be helpful.
To assist us in our preparation, we would appreciate having the facility complete the
enclosed pre-audit questionnaire (Attachment 1), and provide a copy of as many as
possible of the applicable items listed in Attachment 2. The pre-audit documents
should be sent to *[The Team Leader] ’s attention by *[Date].
Please do not hesitate to call me if you have any questions about this audit or the
Environmental, Health, and Safety Audit Programme in general.
Sincerely,
[Team Leader]
Attachments
cc:
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 284
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 285
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
I General Information
1. Number of Employees on-site
6. Products
3.
3.
4.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 286
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
II Locality/Neighbourhood Description
1. Nature of facility location e.g.,
commercial, industrial, residential,
agricultural, rural
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 287
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 288
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
III Policy and Organisation
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 289
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
5. List site specific training programmes/topics below or attach an index if
preferred
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 290
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
IV Functional Areas
A Occupational Environment
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 291
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
B Technical Equipment and Machinery Protection
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 292
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
C Materials, Goods and Hazardous Substances
Main Hazardous Materials, Goods and Substances used and stored on-site
Type of material¹ Use² Approximate Maximum quantity Type of storage4 Storage Area Spill6 containment
quantity used per stored on site Description5 type and capacity
year³ (m3)
e.g. Solvent Plant degreasing 1000 kg 10 kg AST Covered concrete 15m³ with retention
pad basin
Notes:
1 Indicate major hazardous materials used in operations or activities, and include potentially hazardous waste materials
2 Describe use of hazardous material listed, for example, boiler/furnace fuel, degreasing/metal cleaning chemical, wastewater treatment
chemical, etc.
3 Indicate use per year in kilograms or litres
4 Please describe the type of container(s) the material is stored in using one of the following symbols :
AST: Aboveground non-buried storage tank D200: 200 Litre drums
UST: Buried underground storage tank D25: Approx. 25 litre or smaller
O: Other (please specify) e.g., IBC/containers/piles
5 Briefly describe storage area (for example, inside, outside, covered, fenced, locked, restricted access, fireproofed etc.)
6 Indicate type of spill containment provided, if any (for example, retention basin, collection sump, oil/water separator, paved/sealed area,
concrete pad, curbing, bunded area, etc,) and indicate by 'yes' or 'no' if the containment will retain firewater in the event of an emergency.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 294
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
D New or Modified Processes
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 295
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
E Hazardous Work
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 296
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 297
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
F Electrical Safety
3. Is a lock-out/tag-out programme in
place at the facility for electrical and Yes No N/A
other energy isolation?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 298
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
G Work at Height
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 299
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
H Noise Control
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 300
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 301
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
I Personal Protective Equipment (PPE)
5. Is there a formalised
inspection/maintenance Yes No N/A
programme?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 302
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
J Vehicles and Driving
3. Is there a formalised
inspection/maintenance Yes No N/A
programme?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 303
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
K First Aid, Medical Examinations and Care
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 304
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 305
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
L Fire Protection and Control
If so, what
certificates/permits/licences does the
facility hold?
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 306
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 307
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
L Fire Protection and Control (continued)
Please specify
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 308
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
M Air Pollution Control
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 309
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 310
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
N Water Pollution Prevention
Please specify
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 311
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
O Waste Management
Please specify
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 312
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________________________________________________
6. Please complete the following table.
Notes :
1 Indicate which type of equipment or operation generates this waste stream.
2 Please enter one of the following letters as appropriate. If the disposal or treatment is on-site, please circle the letter.
Re = Recycled externally S = Sold for further use (please specify) T = chemical or physical I = Incinerated
Treatment
Ri = Recycled Internally L = Landfill O = Other (please
specify
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 313
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
P Soil and Groundwater Protection
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 314
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
7. Please complete the following table.
Notes:
1 Indicate volume of tank in litres (I) or cubic metres (m³)
2 Indicate whether tank is above ground - use letters AST, or below ground - use
letters UST
3 Indicate whether the tank is equipped with leak detection measures, overfill
protection, or corrosion protection
4 Indicate date of most recent leak test (including hydrostatic pressure testing,
sampling and analysis of surrounding soil, etc.). If not tested, indicate ‘None’.
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 315
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
Q Product Stewardship
4. Do manufacturing machinery
specifications routinely include HSE
requirements? Yes No N/A
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 316
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 1
Example of Pre-Audit Questionnaire
__________________________________________________________________
R Energy Conservation
Please specify
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 317
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Letter Attachment 2
Pre-Audit Information Request
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 318
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix B
Roles and Responsibilities of the Audit Team
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 319
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix B
Roles and Responsibilities of the Audit Team -
Audit Team Leader Responsibilities
Pre-Audit Activities
On-Site Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 320
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix B
Roles and Responsibilities of the Audit Team -
Audit Team Leader Responsibilities
• Document the rationale for changing the scope of the audit (if
necessary).
• Review all findings with key facility personnel prior to the exit
meeting to ensure the accuracy of all findings.
Post-Audit Activities
Pre-Audit Activities
On-Site Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 322
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix B
Roles and Responsibilities of the Audit Team -
Audit Team Member Responsibilities
Post-Audit Activities
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 323
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix C
Guide to Some Health, Safety and Environmental
Acronyms
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 324
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.
Appendix C
Guide to Some Health, Safety and Environmental
Acronyms
AAQS Ambient Air Quality Standards NSR New Source Review
ACGIH American Conference of Governmental Industrial OCAW Oil, Chemical, and Atomic Workers
Hygienists
AHERA Asbestos Hazard Emergency Response Act of 1986 OEL Occupational Exposure Limit
(Title II of TSCA)
ANSI American National Standards Institute OSHA Occupational Safety and Health Administration
ARAR Applicable or Relevant and Appropriate OTA Office of Technology Assessment
Requirements
AQCR Air Quality Control Region PEL Permissible Exposure Limit (for workplace)
ASHRAE American Society of Heating, Refrigeration, and Air PCBs Polychlorinated Biphenyls
Conditioning Engineers
BACT Best Available Control Technology pH Measure of acidity or alkalinity
BOD Biochemical Oxygen Demand PHA Process Hazard Analysis
BPCT Best Practicable Control Technology P&ID Piping and Instrumentation Design
BPT Best Practical Treatment PM Particulate Matter (in air)
BTU British Thermal Unit PM10 PM with <10 micron diameter; respirable
CAA Clean Air Act PMN Premanufacture Notification (under TSCA)
CAAA Clean Air Act Amendments POTW Publicly Owned Treatment Works
CAS Chemical Abstracts Service Registration Number PRPs Potentially Responsible Parties (under CERCLA
CAG EPA’s Carcinogen Assessment Group PSD Prevention of Significant Deterioration
CAIR Comprehensive Assessment Information Rule (under PSM Process Safety Management
TSCA)
CERCLA Comprehensive Environmental Response, RACT Reasonably Available Control Technology
Compensation, and Liability Act (The Superfund Law)
CFCs Chlorofluorocarbons RCRA Resource Conservation and Recovery Act
CFR Code of Federal Regulations RQ Reportable Quantity (for spill reporting)
CMA Chemical Manufacturers Association RTECS Registry of Toxic Effects of Chemical Substances
CO Carbon Monoxide SARA Superfund Amendments and Reauthorisation Act of
1987
COD Chemical Oxygen Demand SDWA Safe Drinking Water Act
CPSC Consumer Product Safety Commission SERC State Emergency Response Commission
CWA Clean Water Act SIC Standard Industrial Classification
DMR Discharge Monitoring Report SIP State Implementation Plan
DOT Department of Transportation SNUR Significant New Use Rule
EPA Environmental Protection Agency SPCC Plan Spill Prevention Control and Countermeasures Plan
EPCRA Emergency Planning and Community Right-to-Know SQG Small Quantity Generator (of hazardous waste)
Act (Title III of SARA, commonly called Right-to-
Know or SARA Title III)
FIFRA Federal Insecticide, Fungicide, and Rodenticide Act STS Standard Threshold Shift
GEP Good Engineering Practice SWDA Solid Waste Disposal Act
HAZOP Hazard and Operability Study TCLP Toxicity Characteristic Leaching Procedure (under
RCRA)
Hazwoper Hazardous Waste Operations and Emergency Title III Emergency Planning and Community Right-to-Know
Response Act
HCS OSHA Hazard Communication Standard (Worker TLV Threshold Limit Values (for workplace exposure)
Right-to-Know)
HMTA Hazardous Materials Transportation Act TPQ Threshold Planning Quantity (for emergency planning
HSWA Hazardous and Solid Waste Amendments (1984 TSCA Toxic Substances Control Act
RCRA Amendments)
IARC Internal Agency for Research on Cancer TSDF Treatment, Storage, and Disposal Facility
IDLH Immediate Danger of Life and Heath TSP Total Suspended Particulate (in air)
IH Industrial Hygienist TSS Total Suspended Solids (in water)
LAER Lowest Achievable Emission Rate UST Underground Storage Tank
LEPC Local Emergency Planning Committee VHAP Volatile Hazardous Air Pollutant
LOTO Lockout/Tagout (Control of Hazardous Energy) VOC Volatile Organic Compound
MACT Maximum Available Control Technology WWTP Wastewater Treatment Plant
MSHA Mine Safety and Health Administration Z List OSHA list of hazardous chemicals (29 CFR 1910
Subpart Z, Worker Right-to-Know)
MSDS Material Safety Data Sheet
NAAQS National Ambient Air Quality Standards
NEPA National Environmental Policy Act
NESHAP National Emission Standards for Hazardous Air
Pollutants
NIOSH National Institute for Occupational Safety and Health
NOAA National Oceanic and Atmospheric Administration
NOx A mixture of nitrous oxide and nitrogen dioxide
NRC National Response Center
NPDES National Pollutant Discharge Elimination System
NSPS New Source Performance Standards
NPC/20365/Mod6_158Audit_Skills_Training_Handbook.doc 325
Copyright © 2005 by Arthur D. Little Ltd. All rights reserved.