You are on page 1of 4

BEST PRACTICES

SAFETY METRICS
Corporate & Site-Level Scorecards
By Paul A. Esposito

Metrics: what you measure happens. For more than 50 years now, W. Edwards Deming and others have extolled
the value of upstream and process metrics as a means of driving bottom-line results (e.g., outcome metrics such
as incident rates).

The well-known quote attributed to improvements, but also as a tool to help tive maintenance schedules may need to
Deming says, “If you measure the pro- operational organizations know where to be revised and other corrective actions
cess, results will come.” Leading compa- improve next. put in place.
nies recognize that safety performance •Management systems improvement
is now defined by a balance of leading initiatives: Assessments typically generate Learning & Growth Metrics
and lagging metrics, sometimes known improvement initiatives. The timely clo- •Training completion and retention:
as a balanced scorecard, where multiple sure of these initiatives is also tracked as Training completion by itself is a lagging
financial, process, learning and growth, part of a global scorecard. metric. It does not factor in quality of the
and customer metrics are combined to •Risk reductions: Moving from an instructor or learning that occurred. Often,
better measure both the progress and incident-based to a risk-based approach as part of an inspection or observation
status of a company or program (Kaplan to metrics is also more in line with the program, knowledge-based quizzes are
& Norton, 1996). current trend toward world class. Risk incorporated to generate a retention met-
Petersen (2001) published a list of six reductions are measured by many dif- ric. Many other retention metrics can be
essential and suggested metrics. This ferent means. implemented that are often added to the
article explores leading metrics to mea- Depending on the data available, some scorecard, such as instructor evaluations or
sure safety performance presented in a measure: Number of residual risks and specific exam question failure rates.
balanced scorecard format, discusses what their trend based on initiation of safety •Conformance rate: Significant or crit-
metrics may be most valuable to start improvements; upstream data or the ical to safety controls based on inspection
with and identifies risk-centric alterna- number of corrective actions implement- and observation data. Significant risks
tives to incident rate metrics. ed that had elimination, substitution or and their controls are identified. The
engineering controls; closure rate of these conformance of these specific controls
Key Financial Metrics corrective actions; or the reduction in is calculated as a conformance rate as a
•Workers’ compensation: While not people required to wear PPE. result of site inspection and observation
consistent across states or countries, it A subset of risk reductions is to mea- programs. Typically targets of 95% to
is one measure to keep track and com- sure the specific reductions in risk factors, 100% are expected.
pare annually. such as severity or consequence levels and •At-risk trend reductions: When
•Budget implementation: Track the likelihood levels. trends occur for inspection or obser-
budget for safety improvements through- Another subset is the hierarchy of vation nonconformances or at-risk
out the year. If budget is taken away in controls. Adding additional controls and behaviors, Pareto analysis determines
the third or fourth quarter, this should additional layers of controls is how risks the most serious and pervasive trends.
impact the overall safety performance are reduced. Only new or additional These trends are then subject to root-
and be reported. controls or mitigations reduce severity or cause analysis and subsequent preventive
•Manpower: In addition to other likelihood. So, leading companies mea- actions. The number of repeat findings
resources, this includes things such as sure the number of hazards eliminated, could also be trended.
time for employees to participate in the number of new controls, the number •Incident hazard trends: When per-
safety committees, conduct inspections, of new engineering controls and the forming incident analysis, the hazardous
staffing and available time, and access to number of tasks that now have multiple energy that was supposed to be controlled
third-party consultants. layers of controls. can be listed and trended. Again, any sig-
•Critical to safety failure rates: Many nificant trends can be an opportunity to
Key Process Metrics of the better engineering controls require improve the risk assessment process.
•Safety management systems (SMS) preventive maintenance to maintain their •Incident hierarchy of control trends:
assessment scores: Leading companies readiness. Controls such as cranes, hoists Trending the highest level of control fail-
such as GE, Honeywell, Standard Aero and fire protection systems are critical ure provides valuable insight into what is
and Eaton use the key element audit to work as designed. Often, third parties working and not working, especially for
management systems as a means of maintain these for a facility. Failure rates incidents that have occurred. Prevention
measuring process. This can be seen in of these critical components should not plans help reduce these trends.
ANSI Z10, ISO 45001, 14001 and 9000, be a secret tucked inside of the preventive •Incident causal factors: Pareto analysis
and OHSAS 18001. If the audit process is maintenance database, but should be in- of the causal or contributing factors is
sound and substantial in its verification cluded on a regular monthly report that especially valuable if trends are apparent,
of process (not just documentation), the testing was competed and that there and corrective actions can reduce these
it is valuable not only as a means of were no failures. If failures occur, preven- trends. Corrective actions may or may not
reporting accountability and process

30 PSJ PROFESSIONAL SAFETY JUNE 2018 assp.org


address the real issues, trends may not
recognize any significant change. Moni-
toring these trends helps verify the effica-
cy of corrective actions.
•Incident root causes: If the root causes
turn out to be safety management sys-
tems, Pareto analysis can be especially
helpful. In addition to an SMS audit, this
is another way to validate the strengths
and weaknesses of management systems.
•Compliance: This is an optional lead-
ing metric typically generated from some
type of facility audit and performed by
•Serious injuries and fatalities: When engagement. Some companies measure
the site with third-party audit verification.
potentially catastrophic actual or near-hit the number of suggestions or positive
Often, compliance will be verified for sig-
incidents are recorded they are calculated, recognitions awarded. In other cases,
nificant high-risk exposures. Regulation
tracked and trended. companies measure the percentage of
citations or violations are often recorded
•Number of overexposures: Occupa- people who get involved in various safety
within this metric.
tional illnesses can often take years to activities such as inspections. A percent-
Customer Metrics manifest themselves due to the latency age is a better measure of the breadth of
•Total incident rate: This is a lagging period of many of the more potent sub- involvement, as sometimes the involve-
metric of injury frequency. stances and physical hazards. In advance ment can come from the same small
of the manifestation of illness, overexpo- group of employees.
TINPIXELS/E+/GETTY IMAGES

•Days away and restricted case rate:


This is a lagging metric of severity. These sure reductions can help prevent occu- •Perception or culture surveys: Surveys
are the two significant metrics of OSHA’s pational illness if targeted and measured are a valuable tool for determining the gap
Voluntary Protection Programs, along (AIHA, 2001). between the perceptions of workers and
with the SMS audit and closure rate of •Employee engagement: Many different those of management. Real or perceived,
SMS action plans. means can be used to measure employee perception and cultural differences in

26
Celebrating

OSHA Training
Institute Education
Centers provide safety
& health education
s at
isit u th nationwide for the
V oo benefit of public &
B 830
#2 private sector workers
osha.gov/otiec and employers.

EXPERIENCE THE DIFFERENCE


OSHA Training Institute (OTI) Education Centers are a national
network of non-profit organizations authorized by OSHA to provide
innovative and effective safety and health training to improve the
safety culture and performance in the workplace. OTI Education
Centers play a prominent role in curriculum development and offer
subject matter expertise based on their organizational competencies.

assp.org JUNE 2018 PROFESSIONAL SAFETY PSJ 31


BEST PRACTICES

communication and expectations or ac-


countabilities are a continual process that
Like any situation in life, Metrics of Little Value
This article does not discuss some
many companies try to improve each year. you need the right tool common historical safety metrics. These
Categories are scored on the Likert scale, metrics have often been misapplied, mis-
while online tools make designing and de- for the job. understood or overvalued. Some safety
livering these surveys easier. One weakness Risk assessment yields a full breadth professionals may take a different view; any
is the delay between the survey and getting of metrics. Initially the number of assess- diversity in the debate or discussion can
improvement initiatives in place. The lon- ments can be a target, but to be worth only help strengthen the use of metrics in
ger the time lag, the less effective the next the time investment, changes must be safety and health programs. For example:
survey will be as participants may suspect identified, otherwise it is simply a paper •Injury by parts of the body: If PPE is
management does not value their opinions. exercise. These changes must be closed the ultimate solution, this may be an ef-
While many of these metrics take time and stay closed, so some organizations fective metric. Otherwise, it is addressing
to develop, an audit program is a com- add a 30-day timer to the closure as an only a symptom.
mon starting point. The audit could be a additional metric. Finally, effectiveness •Incidents by time of day: There is
first data collection mechanism to begin is based on the type of control that gets no argument that when shifts run into
verifying some of the metrics. The audit implemented. More effective controls extra hours, the frequency of incidents
is also normally completed by an inde- include substitution and elimination or increase. Nighttime versus daytime
pendent third party, at least as part of the engineering controls, rather than just activities are also viable. Fatigue is ab-
audit team, to lend some objectivity to training or PPE. Whether the target is a solutely a confounding factor. However,
the generation of metrics. The audit can number or a percentage defined or com- the morning, lunch and evening analyses
generate some of the other metrics (e.g., pared to the previous reporting period, are only partially viable if administrative
systems scores, closure rate of manage- comparison against a target is essential. controls such as training or awareness
ment systems improvement initiatives, Building up to this level of scorecard are the ultimate risk reduction weapon.
employee survey summaries). may take time. Thus, the circled metrics This type of thinking also leads to blam-
in Figure 1 are common starting points. ing employees.
Site/Organizational Level In reality, the starting points may actually •Unsafe acts versus unsafe conditions: Pe-
At the site or organizational level, an be the data you have, rather than what tersen has always maintained that these are
additional level of detail is typically need- you want, until the data you want is avail- just symptoms of something wrong with the
ed to better monitor, review and react to able for collection. management system. Who is responsible
the various safety programs and initia- Big data is a buzz phrase now making for the unsafe conditions? Have any of these
tives. Specifically, the amount of change its way into the safety and health vocabu- been tied to management decisions not to
and closure are the key data points, along lary. Many software providers offer plat- resource higher-level controls? Workers
with some measure of quality. The lower forms for leading companies to manage do not create the hazards in the workplace.
into the organization you can measure, and analyze the myriad of potential safety They can only strive to implement the con-
the more accountability you have. performance data. trol given to them, effective or not.

FIGURE 1
DEPARTMENT SCORECARD
No. of changes Closure rate Effectiveness
identified/ (from date (control type or
OSH preventive maintenance No. of events needed closed) conformance)
report topics Actual Target Actual Target Actual Target Actual Target
Current program risk assessment
5 20 4 5 5% 30% 23% 20%
changes to controls
Monthly safety review incidents 9 10 10 5 5% 10% 10% 30%
Monthly inspections or discrepancies
20 10 5 20 93% 95%
high-risk control conformance
Monthly observations
50 10 20 0 93% 95%
conformance or % safe operations
Supervisor communication (OSH
10 20 5 10 5% 30%
toolbox) resulting in suggestions
OSH action plan status 5 20 95% 90%

OSH rewards and recognition 50 30

32 PSJ PROFESSIONAL SAFETY JUNE 2018 assp.org


•Number of observations: Observations Conclusion negative metrics, people are motivated
alone do not necessarily change behavior. Leading organizations understand that to provide discretionary effort. Discre-
The ABCs of behavior motivation, atti- there is no single metric for either the tionary effort is the one cultural dynamic
tudes and beliefs are dictated more by the entire program or the individual compo- that can give any company a competitive
volume of antecedents (A) and positive nent parts. A balance, or complementary advantage. PSJ
consequences (C). More astute organi- set of leading and lagging or, better input,
zations set goals for the number of new process and output metrics are used in References
ideas generated by the observation dia- addition to the standard lagging metrics AIHA. (2001). Industrial hygiene performance
logue process. Closure of these ideas and metrics. Fairfax, VA: Author.
such as workers’ compensation and inci-
Daniels, A.C. (2016). Bringing out the best in
suggestions are the positive consequences dent rates to drive continual improvement people: How to apply the astonishing power of
that drive behaviors. in safety performance. positive reinforcement. New York, NY: McGraw-
•Zero incidents: Without a doubt, this These metrics are just the beginning Hill.
is the outcome expected from all of our of the list. They are the new measure of Kaplan, R.S. & Norton, D.P. (1996). The
efforts. But as a metric it is lagging and safety performance. Line management is balanced scorecard: Translating strategy into
as a measure it is only an indicator that held accountable to these metrics as part action. Boston, MA: Harvard Business School
must be measured and reported. It is im- of the performance appraisal process. At Press.
portant, however, as the primary metric the worker level, these metrics become Petersen, D. (2001, Apr. 30). The safety
or goal it is akin to driving a car by only the basis for recognition programs. There scorecard: Using multiple measures to judge
looking in the rearview mirror. It does not safety system effectiveness. EHS Today.
is no substitute for holding the right Retrieved from www.ehstoday.com/safety/best
measure safe. Risk reduction, the number people accountable to the right things. -practices/ehs_imp_34484
of new controls, the elimination of haz- In addition, if there is an overwhelming
ards and conformance rates measure safe. recognition to the positive rather than
Zero nonconformances would be a much
improved metric. Paul A. Esposito, CSP, CIH, SMS, is president of STAR Consultants Inc., a business that provides advanced
Like any situation in life, you need the level strategic planning, training and systems development consultation to Fortune 500 and leading or-
right tool for the job. Metrics can be used ganizations worldwide toward the continual improvement of their safety and health programs. Esposito
to motivate or demotivate depending upon holds an M.S. in Safety and Health from Johns Hopkins University and is a professional member of ASSP’s
delivery, methodology and application. Chesapeake Chapter which he serves as a Delegate and Nominations and Elections Chair.

assp.org JUNE 2018 PROFESSIONAL SAFETY PSJ 33

You might also like