Safety Indicators and ALoS Performance 6-Mar-14

Contents:
Sheet 1 Safety Indicator Examples (SSP & SMS)
Sheet 2 Sample SSP Safety Indicator Chart (with Alert & Target levels setting)
Sheet 3 Data Sheet to Sample Safety Indicator Chart
Sheet 4 Example of SSP ALoS Safety Indicators Performance Summary (Quantitative & Qualitative)

Purpose –
Template for the selection and development of individual SPIs with harmonized Alert & Target setting procedure.
Include procedure for consolidation of the SPIs’ individual Alert and Target performance outcomes to derive the
ALoSP (applicable for SSP & SMS).
Safety Indicators Development and ALoS Performance Monitoring
Instructions for Working Groups:

1 Browse SMM Chapter 3 Appendix 6 "SPI & ALOSP" extract provided (SPI_ALOSP_A6C3_Intro.docx)
2 This exercise is to develop one example of a high consequence SSP/ SMS Safety Performance Indicator chart using
attached SPI (Excel Wsht) in Sheet 3.
3 Elect a group discussion coordinator and also have some one (with laptop) to make entries in the SPI Excel data
sheet (Sheet 3).
4 Browse examples of SPIs for the various sectors, as listed in Sheet 1 (Indicator examples) attached.
5 Decide on one high consequence (accidents/ serious incidents data trend) SPI chart to be developed.
6 Fill out the SPI Excel data sheet (Sheet 3) with required details for your intended SPI chart i.e occurrence numbers
and FH/ FC/ Air or Grd Movements. Actual data preferred, otherwise provide approximate viable figures based on
experience. Customize column descriptions to suit your SPI description.

7 If time permit, develop another lower consequence SPI chart (routine incidents, etc) using the same procedure.
(Browse lower consequence SPI examples column in Sheet 1)
8 Be prepared to share your completed SPI charts and comments with others.
 Examples of Safety Indicators (SSP) & Safety Performance Indicators (SMS) 6Mar14

SSP Safety Indicators (Aggregate State) SMS Safety Performance Indicators (Individual Service Provider)
High Consequence Indicators Lower Consequence Indicators High Consequence Indicators Lower Consequence Indicators
(Occurrence/ Outcome-based) (Event/ Activity-based) (Occurrence/ Outcome-based) (Event/ Activity-based)

Alert level Target level Alert level Target level Safety Performance Alert level Target level Safety Performance Alert level Target level
Safety Indicator Safety Indicator
criteria criteria criteria criteria Indicator criteria criteria Indicator criteria criteria
Air Operators (Air Operators of the State only)
CAA aggregate Air Ave + 1/2/3 SD. __% (eg 5%) CAA aggregate Air Operator Air Operator Individual Fleet Ave + 1/2/3 SD. __% (eg 5%) Operator Combined Fleet Ave + 1/2/3 SD. __% (eg 5%)

Consideration

Consideration
Operators monthly serious (annual or 2 improvement annual surveillance Audit monthly serious incident rate (annual or 2 improvement monthly Incident rate (eg per (annual or 2 improvement
incident rate (eg per yearly reset) between each LEI% or findings rate (eg per 1000FH) yearly reset) between each 1000FH) yearly reset) between each
1000FH) annual Mean (findings per audit) annual Mean annual Mean
Rate. Rate. Rate.

CAA aggregate Air Ave + 1/2/3 SD. __% (eg 5%) CAA aggregate Air Operator Air Operator Combined Fleet Ave + 1/2/3 SD. __% (eg 5%) Operator Internal QMS annual

Consideration

Consideration

Consideration

Consideration
Operators quarterly Engine (annual or 2 improvement annual Line Station monthly serious incident rate (annual or 2 improvement audit LEI% or findings rate
IFSD incident rate (eg per yearly reset) between each Inspection LEI% or findings (eg per 1000FH) yearly reset) between each (findings per audit)
1000 FH) annual Mean rate (findings per inspection) annual Mean
Rate. Rate.

CAA aggregate Air Ave + 1/2/3 SD. __% (eg 5%) CAA annual Foreign Air Air Operator Engine IFSD Ave + 1/2/3 SD. __% (eg 5%) Operator Voluntary Hazard

Consideration

Consideration

Consideration

Consideration
Operators quarterly IFTB (annual or 2 improvement Operators Ramp incident rate (eg per 1000 FH) (annual or 2 improvement reports rate [eg per 1000 FH]
incident rate (eg per 1000 yearly reset) between each surveillance inspection Ave yearly reset) between each
FH) annual Mean LEI% (for each Foreign annual Mean
Rate. Operator). Rate.

CAA aggregate Operators' Ave + 1/2/3 SD. __% (eg 5%) Air Operator Air Turn Back Ave + 1/2/3 SD. __% (eg 5%) Operator DGR incident reports Ave + 1/2/3 SD. __% (eg 5%)
DGR incident reports rate (annual or 2 improvement (ATB, technical) incident rate (annual or 2 improvement rate [eg per 1000 FH] (annual or 2 improvement
[eg per 1000 FH] yearly reset) between each (eg per 1000 FH) yearly reset) between each yearly reset) between each
annual Mean annual Mean annual Mean
Rate. Rate. Rate.
 SSP Safety Indicators (Aggregate State) SMS Safety Performance Indicators (Individual Service Provider)
High Consequence Indicators Lower Consequence Indicators High Consequence Indicators Lower Consequence Indicators
(Occurrence/ Outcome-based) (Event/ Activity-based) (Occurrence/ Outcome-based) (Event/ Activity-based)

Alert level Target level Alert level Target level Safety Performance Alert level Target level Safety Performance Alert level Target level
Safety Indicator Safety Indicator
criteria criteria criteria criteria Indicator criteria criteria Indicator criteria criteria
ETC Air Operator RTO (high speed) Ave + 1/2/3 SD. __% (eg 5%)
incident rate (eg per 1000 FH) (annual or 2 improvement
yearly reset) between each
annual Mean
Rate.

Aerodrome Operators
CAA aggregate aerodromes Ave + 1/2/3 SD. __% (eg 5%) CAA aggregate Aerodrome Aerodrome Operator quarterly Ave + 1/2/3 SD. __% (eg 5%) Aerodrome Operator Internal

Consideration

Consideration

Consideration

Consideration
quarterly ground accident/ (annual or 2 improvement Operators annual ground accident/ serious (annual or 2 improvement QMS annual audit LEI% or
serious incidents rate - yearly reset) between each surveillance Audit LEI% or incident rate - involving any yearly reset) between each findings rate (findings per audit)
involving any aircraft [eg per annual Mean findings rate (findings per aircraft [eg per 10,000 ground annual Mean
10,000 ground movements] Rate. audit) movements] Rate.

CAA aggregate aerodromes Ave + 1/2/3 SD. __% (eg 5%) Aerodromes Operator quarterly Ave + 1/2/3 SD. __% (eg 5%) Aerodrome Operator quarterly

Consideration

Consideration
monthly/ quarterly Runway (annual or 2 improvement Runway Excursion incidents (annual or 2 improvement Runway Foreign Object Report
Excursion incidents rate - yearly reset) between each rate - involving any aircraft [eg yearly reset) between each (FOR) rate [eg per 10,000
involving any aircraft [eg per annual Mean per 10,000 departures] annual Mean ground movements]
10,000 departures] Rate. Rate.
 SSP Safety Indicators (Aggregate State) SMS Safety Performance Indicators (Individual Service Provider)
High Consequence Indicators Lower Consequence Indicators High Consequence Indicators Lower Consequence Indicators
(Occurrence/ Outcome-based) (Event/ Activity-based) (Occurrence/ Outcome-based) (Event/ Activity-based)

Alert level Target level Alert level Target level Safety Performance Alert level Target level Safety Performance Alert level Target level
Safety Indicator Safety Indicator
criteria criteria criteria criteria Indicator criteria criteria Indicator criteria criteria
CAA aggregate aerodromes Ave + 1/2/3 SD. __% (eg 5%) Aerodromes Operator quarterly Ave + 1/2/3 SD. __% (eg 5%) Operator Voluntary Hazard

Consideration

Consideration
monthly/ quarterly Runway (annual or 2 improvement Runway Incursion incidents rate (annual or 2 improvement reports rate [per operational
Incursion incidents rate - yearly reset) between each - involving any aircraft [eg per yearly reset) between each personnel per quarter]
involving any aircraft [eg per annual Mean 10,000 departures] annual Mean
10,000 departures] Rate. Rate.

Aerodrome Operator quarterly Ave + 1/2/3 SD. __% (eg 5%)

aircraft ground Foreign Object (annual or 2 improvement
Damage (FOD) incident report yearly reset) between each
rate - involving damage to annual Mean
aircraft [eg per 10,000 ground Rate.
movements]

ETC
ATS Operators
CAA aggregate ATS Ave + 1/2/3 SD. __% (eg 5%) CAA aggregate ATS Ave + 1/2/3 SD. __% (eg 5%) ATS provider quarterly FIR Ave + 1/2/3 SD. __% (eg 5%) ATS Operator quarterly FIR Ave + 1/2/3 SD. __% (eg 5%)
quarterly FIR (airspace) (annual or 2 improvement quarterly FIR TCAS RA (annual or 2 improvement serious incidents rate - involving (annual or 2 improvement TCAS RA incidents rate - (annual or 2 improvement
serious incidents rate - yearly reset) between each incidents rate - involving any yearly reset) between each any aircraft [eg per 100,000 yearly reset) between each involving any aircraft [eg per yearly reset) between each
involving any aircraft [eg per annual Mean aircraft [eg per 100,000 flight annual Mean flight movements] annual Mean 100,000 flight movements] annual Mean
100,000 flight movements] Rate. movements] Rate. Rate. Rate.
 SSP Safety Indicators (Aggregate State) SMS Safety Performance Indicators (Individual Service Provider)
High Consequence Indicators Lower Consequence Indicators High Consequence Indicators Lower Consequence Indicators
(Occurrence/ Outcome-based) (Event/ Activity-based) (Occurrence/ Outcome-based) (Event/ Activity-based)

Alert level Target level Alert level Target level Safety Performance Alert level Target level Safety Performance Alert level Target level
Safety Indicator Safety Indicator
criteria criteria criteria criteria Indicator criteria criteria Indicator criteria criteria
CAA aggregate quarterly Ave + 1/2/3 SD. __% (eg 5%) CAA aggregate ATS Ave + 1/2/3 SD. __% (eg 5%) ATS provider quarterly/ annual Ave + 1/2/3 SD. __% (eg 5%) ATS Operator quarterly FIR Ave + 1/2/3 SD. __% (eg 5%)
near miss incident rate [eg (annual or 2 improvement quarterly FIR Level Bust (annual or 2 improvement near miss incident rate [eg per (annual or 2 improvement Level Bust (LOS) incident rate - (annual or 2 improvement
per 100,000 flight yearly reset) between each (LOS) incident rate - yearly reset) between each 100,000 flight movements] yearly reset) between each involving any aircraft [eg per yearly reset) between each
movements] annual Mean involving any aircraft [eg per annual Mean annual Mean 100,000 flight movements] annual Mean
Rate. 100,000 flight movements] Rate. Rate. Rate.

CAA aggregate ATS ATS provider quarterly/ annual Ave + 1/2/3 SD. __% (eg 5%) ATS Operator Internal QMS

Consideration

Consideration

Consideration

Consideration
Operators annual GPWS/ EGPWS incident rate (annual or 2 improvement annual audit LEI% or findings
surveillance Audit LEI% or [eg per 100,000 flight yearly reset) between each rate (findings per audit)
findings rate (findings per movements] annual Mean
audit) Rate.

Other examples - Minimum

ETC
POA/ DOA/ MRO Organizations
CAA aggregate MRO
Separation Infringement,
Airspace infringement,
Deviation from ATC clearance,
Deviation from Airspace
Procedures
Ave + 1/2/3 __% (eg 5%) CAA aggregate MRO/ MRO/ POA quarterly rate Ave + 1/2/3 __% (eg 5%) MRO/ POA/ DOA Internal
Consideration

Consideration

Consideration

Consideration
quarterly Mandatory SD. (annual improvement POA/ DOA annual of component technical SD. (annual improvement QMS annual audit LEI%
Defect Reports (MDR) or 2 yearly between each surveillance Audit LEI% warranty claims. or 2 yearly between each or findings rate (findings
received reset) annual Mean or findings rate reset) annual Mean per audit).
Rate. (findings per audit) Rate.
 SSP Safety Indicators (Aggregate State) SMS Safety Performance Indicators (Individual Service Provider)
High Consequence Indicators Lower Consequence Indicators High Consequence Indicators Lower Consequence Indicators
(Occurrence/ Outcome-based) (Event/ Activity-based) (Occurrence/ Outcome-based) (Event/ Activity-based)

Alert level Target level Alert level Target level Safety Performance Alert level Target level Safety Performance Alert level Target level
Safety Indicator Safety Indicator
criteria criteria criteria criteria Indicator criteria criteria Indicator criteria criteria
CAA aggregate POA/ MRO/ POA quarterly rate MRO/ POA/ DOA
Consideration

Consideration

Consideration

Consideration

Consideration

Consideration
DOA quarterly rate of of component Mandatory/ quarterly final inspection/
operational products Major Defect Reports testing failure/ rejection
which are subject of raised. rate
Airworthiness
Directives (ADs) [per
product line]

MRO/ POA/ DOA

Consideration

Consideration
Voluntary Hazard reports
rate [per operational
personnel per quarter]

ETC
SSP High Consequence Safety Indicator Example (with Alert and Target Setting Criteria) / SafetyIndicators_N_ALoS_Performance_v9

0.40
0.35 Ave+3 SD
0.30 Ave+2 SD
0.25 Ave+1 SD
0.20
0.15 Target
0.10
0.05
0.00
jan feb mar apr may jun jul aug sep oct nov dec dec jan feb mar apr may jun jul aug sep oct nov dec

Preceding Year Combined Operators Monthly Current Year Combined Operators Monthly
Reportable Incident rate (per 1000FH) Reportable Incident rate (per 1000 FH)
Preceeding Year Average (Ave) Current Year Target Average

A) Alert Level Setting: C) Target Level Setting(Planned Improvement) :

Alert level for a new monitoring period (current year) is based on the preceding Target setting may be less structured than Alert level setting - eg target the new (current
period's performance (preceding year), namely its data points Average & Std Deviation. year) monitoring period's Ave rate to be say 5% lower (better) than the preceding
The 3 alert lines are Ave+1SD, Ave+2SD and Ave+3SD period's Ave value.

B) Alert Level Trigger: D) Target Achievement:

An Alert (abnormal/ unacceptable trend) is indicated if ANY of the conditions below are
met for the current monitoring period (current year):
- Any single point is above 3 SD line
- 2 consecutive points are above 2 SD line
- 3 consecutive points are above 1 SD line
When an Alert is triggered (potential high risk or out of control situation), appropriate
follow-up action is expected, such as further analysis to determine source and root
cause of the abnormal incident rate and any necessary action to address the
unacceptable trend .
At end of the current year, if the Ave rate for the current year is at least 5% or more
lower than the preceding year's Ave rate, then the set Target of 5% improvement is
deemed to have been achieved.
E) Alert & Target Levels - Validity Period:
Alert & Target levels should be reviewed/reset for each new monitoring period, based
on the equivalent preceding period's Ave rate & SD, as applicable.
When an Alert is triggered (potential high risk or out of control situation), appropriate E) Alert & Target Levels - Validity Period:
follow-up action is expected, such as further analysis to determine source and root
cause of the abnormal incident rate and any necessary action to address the Alert & Target levels should be reviewed/reset for each new monitoring period, based
unacceptable trend . on the equivalent preceding period's Ave rate & SD, as applicable.
SSP High Consequence Safety Indicator Example (with Alert and Target Setting Criteria)
Preceding Year Current year Current Year Alert Levels
Current
Year
All All All All Preceding Preceding Preceding Target
Operators Operators Incident Ave Operators Operators Incident Year Ave Year Ave Year Ave (line)
Mth Total FH Incidents Rate* (line) Mth Total FH Incidents Rate* +1SD (line) +2SD (line) +3SD (line)
jan 51,837 10.00 0.19 0.16 dec 53006 9.00 0.17
feb 48,406 15.00 0.31 0.16 jan 51635 9.00 0.17 0.23 0.29 0.35 0.15
mar 53,354 7.00 0.13 0.16 feb 44295 8 0.18 0.23 0.29 0.35 0.15
apr 52,513 4.00 0.08 0.16 mar 48323 10 0.21 0.23 0.29 0.35 0.15
may 54,037 9.00 0.17 0.16 apr 47176 11 0.23 0.23 0.29 0.35 0.15
jun 52,673 6.00 0.11 0.16 may 47469 13 0.27 0.23 0.29 0.35 0.15
jul 54,086 5.00 0.09 0.16 jun 0.23 0.29 0.35 0.15
aug 54,043 13.00 0.24 0.16 jul 0.23 0.29 0.35 0.15
sep 52,383 7.00 0.13 0.16 aug 0.23 0.29 0.35 0.15
oct 53,042 10.00 0.19 0.16 sep 0.23 0.29 0.35 0.15
nov 51,353 7.00 0.14 0.16 oct 0.23 0.29 0.35 0.15
dec 53,006 9.00 0.17 0.16 nov 0.23 0.29 0.35 0.15
Ave 0.16 dec 0.23 0.29 0.35 0.15
SD 0.06

Ave+1SD Ave+2SD Ave+3SD * Rate Calculation:( per 1000 FH)

0.23 0.29 0.35

Current Year Target is say 5% Ave rate

Current Year Alert Level setting criteria is:
Preceding Year Ave + 1/2/3 SD
improvement over the Ave rate for the 0.15
preceding year, which is:
 Example: State "X" SSP ALoS Performance Summary (say for Year 2010)
High Consequence Safety Indicators
Alert level
Target
SI Alert Level/ Not SI Target level/
Safety Indicator (SI) Description Achieved
Criteria (for 2010) Breached criteria (for 2010)
[Yes/ No]
[Yes/ No]
1 CAA aggregate Air Operators 5 % improvement of
monthly accident/ serious 2009 Average Rate + the 2010 Average Rate
incident rate [per 1000 FH] Y N
1/2/3 SD. (annual reset) over the 2009 Average
Rate.
2
CAA aggregate Aerodromes
3 % improvement of
monthly ground accident/
2009 Average Rate + the 2010 Average Rate
serious incidents rate - involving Y Y
1/2/3 SD. (annual reset) over the 2009 Average
any aircraft [per 10,000 ground
Rate.
movements]
3 CAA aggregate ATS monthly 4 % improvement of
FIR serious incidents rate - 2009 Average Rate + the 2010 Average Rate
N N
involving any aircraft [per 1/2/3 SD. (annual reset) over the 2009 Average
100,000 air movements] Rate.

Lower Consequence Safety Indicators

Alert level
Target
SI Alert Level/ Not SI Target level/
Safety Indicator (SI) Description Achieved
Criteria (for 2010) Breached criteria (for 2010)
[Yes/ No]
[Yes/ No]
CAA aggregate Air Operators >25% Average LEI;
Organization annual <10% Average LEI;
OR any level 1 finding;
surveillance/ audit outcomes Y AND <1 level 2 finding N
OR >5 level 2 findings
per audit
per audit

>25% Average LEI;

CAA annual Air Operator Line
OR any level 1 finding;
Station surveillance inspection Y <10% Average LEI Y
OR >5 level 2 findings
Ave LEI% (for each Operator).
per audit

>25% Average LEI;

OR any level 1 finding;
CAA annual Foreign Air Not less than 50% of
OR >5 level 2 findings
Operators Ramp sampling Y Foreign Operators to be N
per audit; OR <25% of
inspection program. inspected
Foreign Operators
inspected

CAA aggregate Aerodrome >25% Average LEI;

Operators Organization annual <10% Average LEI;
OR any level 1 finding;
surveillance/ audit outcomes N AND <1 level 2 finding N
OR >5 level 2 findings
per audit
per audit
 Lower Consequence Safety Indicators
Alert level
Target
SI Alert Level/ Not SI Target level/
Safety Indicator (SI) Description Achieved
Criteria (for 2010) Breached criteria (for 2010)
[Yes/ No]
[Yes/ No]
CAA aggregate ATS Operators >25% Average LEI;
Organization annual <10% Average LEI;
OR any level 1 finding;
surveillance/ audit outcomes Y AND <1 level 2 finding Y
OR >5 level 2 findings
per audit
per audit
CAA aggregate ATS quarterly 5 % improvement of
FIR TCAS RA incidents rate - 2009 Average Rate + the 2010 Average Rate
involving any aircraft [per Y N
1/2/3 SD. (annual reset) over the 2009 Average
10,000 flight movements] Rate.

CAA aggregate D&M/ MRO >25% Average LEI;

Organization annual
surveillance/ audit outcomes
CAA aggregate AMO (MRO)
quarterly rate of component
warranty claims due to (Major) 2009 Average Rate +
technical defects.
<10% Average LEI;
OR any level 1 finding;
Y AND <1 level 2 finding Y
OR >5 level 2 findings
per audit
per audit
5 % improvement of
the 2010 Average Rate
N N
1/2/3 SD. (annual reset) over the 2009 Average
Rate.

Note 1: Other Process Indicators - Apart from above SSP level Safety Indicators, there may
be other systems level indicators within each operational areas. Examples would include
process or system-specific monitoring indicators in AIR, OPS, AGA etc or indicators
associated with performance-based programs such as fatigue risk management or fuel
management. Such process or system-specific indicators should rightly be administered as
part of the system or process concerned. They may be viewed as specific system or process
level indicators which undergird the higher level SSP monitoring safety indicators. They
should be addressed within the respective system or process manuals/ SOPs as appropriate.
Nevertheless, the criteria for setting alert or target levels for such indicators could preferably
be aligned with that of the SSP level safety indicators where applicable.

Note 2: Selection of Indicators & Settings - The combination (or package) of High and Lower
Consequence Safety Indicators is to be selected by a State according to the scope of their
aviation system. For those Indicators where the suggested Alert or Target levels setting
criteria is not applicable, the State may consider any alternate criteria as appropriate.
General guidance is to set Alerts and Targets that take into consideration recent historical or
current performance.
 Example: State "X" SSP ALoS Performance Measurement (say for Year 2010)
High Consequence Safety Indicators
Safety Indicator (SI) Description
1 CAA aggregate Air Operators
monthly accident/ serious
incident rate [per 1000 FH]
2
CAA aggregate Aerodromes
monthly ground accident/
serious incidents rate - involving
any aircraft [per 10,000 ground
movements]
3 CAA aggregate ATS monthly
FIR serious incidents rate -
involving any aircraft [per
100,000 air movements]
Alert level
Target
Not
SI Alert Level/ SI Target level/ Achieved
Breached
Criteria (for 2010) criteria (for 2010) [Yes (3),
[Yes (4),
No (0)]
No (0)]
5 % improvement of
2009 Average Rate + the 2010 Average Rate
4 0
1/2/3 SD. (annual reset) over the 2009 Average
Rate.
3 % improvement of
2009 Average Rate + the 2010 Average Rate
4 3
1/2/3 SD. (annual reset) over the 2009 Average
Rate.
4 % improvement of
2009 Average Rate + the 2010 Average Rate
0 0
1/2/3 SD. (annual reset) over the 2009 Average
Rate.
Sub-total 8 Sub-total 3
Max 12 Max 9

Lower Consequence Safety Indicators

Alert level
Target
Not
SI Alert Level/ SI Target level/ Achieved
Safety Indicator (SI) Description Breached
Criteria (for 2010) criteria (for 2010) [Yes (1),
[Yes (2),
No (0)]
No (0)]
CAA aggregate Air Operators >25% Average LEI;
Organization annual <10% Average LEI;
OR any level 1 finding;
surveillance/ audit outcomes 2 AND <1 level 2 finding 0
OR >5 level 2 findings
per audit
per audit

>25% Average LEI;

CAA annual Air Operator Line
OR any level 1 finding;
Station surveillance inspection 2 <10% Average LEI 1
OR >5 level 2 findings
Ave LEI% (for each Operator).
per audit

>25% Average LEI;

OR any level 1 finding;
CAA annual Foreign Air Not less than 50% of
OR >5 level 2 findings
Operators Ramp sampling 2 Foreign Operators to be 0
per audit; OR <25% of
inspection program. inspected
Foreign Operators
inspected
CAA aggregate Aerodrome >25% Average LEI;
Operators Organization annual <10% Average LEI;
OR any level 1 finding;
surveillance/ audit outcomes 0 AND <1 level 2 finding 0
OR >5 level 2 findings
per audit
per audit

CAA aggregate ATS Operators >25% Average LEI;

Organization annual <10% Average LEI;
OR any level 1 finding;
surveillance/ audit outcomes 2 AND <1 level 2 finding 1
OR >5 level 2 findings
per audit
per audit
CAA aggregate ATS quarterly 5 % improvement of
FIR TCAS RA incidents rate - 2009 Average Rate + the 2010 Average Rate
involving any aircraft [per 2 0
1/2/3 SD. (annual reset) over the 2009 Average
10,000 flight movements] Rate.

CAA aggregate D&M/ MRO >25% Average LEI;

Organization annual
surveillance/ audit outcomes
CAA aggregate AMO (MRO)
quarterly rate of component
warranty claims due to (Major) 2009 Average Rate +
technical defects.
<10% Average LEI;
OR any level 1 finding;
2 AND <1 level 2 finding 1
OR >5 level 2 findings
per audit
per audit
5 % improvement of
the 2010 Average Rate
0 0
1/2/3 SD. (annual reset) over the 2009 Average
Rate.

Sub-total 12 Sub-total 3
Max 16 Max 8

No Alert % 71.4% Target Achieved % 35.3%

Overall ALoS Performance
57.8%
(for Year 2010)

Note 1: Other Process Indicators - Apart from above SSP level Safety Indicators, there may
be other systems level indicators within each operational areas. Examples would include
process or system-specific monitoring indicators in AIR, OPS, AGA etc or indicators
associated with performance-based programs such as fatigue risk management or fuel
management. Such process or system-specific indicators should rightly be administered as
part of the system or process concerned. They may be viewed as specific system or process
level indicators which undergird the higher level SSP monitoring safety indicators. They
should be addressed within the respective system or process manuals/ SOPs as appropriate.
Nevertheless, the criteria for setting alert or target levels for such indicators should preferably
be aligned with that of the SSP level safety indicators where applicable.

Note 2: Indicators & Settings - The combination (or package) of High and Lower
Consequence Safety Indicators is to be selected by a State according to the scope of their
aviation system. For those Indicators where the suggested Alert or Target levels setting
criteria is not applicable, the State may consider any alternate criteria as appropriate.
General guidance is to set Alerts and Targets that take into consideration recent historical or
current performance.
Note 3: Weightage - Alert and Target scores between High and Lower Consequence
indicators are weighted (4, 3, 2, 1) as indicated in the respective header columns. High
consequence indicator "Alert Not Breached" has highest (4 pt) score whilst Lower
consequence indicator "Target Achieved" has lowest (1 pt) score.

Note 4: Overall Score Interpretation - A SSP with 100% overall performance score implies
that the SSP has achieved ALL Target Levels of its Safety Indicators as well as not breached
ANY Alert levels of its Safety Indicators. Conversely, a SSP with 0% overall performance
score implies that the SSP has not achieved ANY Target Levels of its Safety Indicators as
well as having breached ALL Alert levels of its Safety Indicators.