IATA Training & Qualification

Initiative (ITQI)
Evidence-Based Training
Captain Mike Varney
Project Leader – Evidence-based Training
ICAO NGAP Symposium 1-4 March 2010, Montreal
ICAO NGAP
ICAO NGAPSymposium
Symposium, Montreal 1 1-4 March 2010
1 March 2010
ICAO NGAP Symposium, Montreal 2 1-4 March 2010
 Dakota DC-3 Rand Airport South Africa 2003

ICAO NGAP Symposium, Montreal 3 1-4 March 2010

ICAO NGAP Symposium, Montreal 4 1-4 March 2010
 Ilyushin IL-18 Moscow 2005

ICAO NGAP Symposium, Montreal 5 1-4 March 2010

ICAO NGAP Symposium, Montreal 6 1-4 March 2010
 Sud SE-210 Caravelle III Zurich July 1961

ICAO NGAP Symposium, Montreal 7 1-4 March 2010

ICAO NGAP Symposium, Montreal 8 1-4 March 2010
 Continental Airlines Boeing 757-200 August 2005

ICAO NGAP Symposium, Montreal 9 1-4 March 2010

ICAO NGAP Symposium, Montreal 10 1-4 March 2010
 Airbus A380

ICAO NGAP Symposium, Montreal 11 1-4 March 2010

ICAO NGAP Symposium, Montreal 12 1-4 March 2010
 Boeing 787

ICAO NGAP Symposium, Montreal 13 1-4 March 2010

ICAO NGAP Symposium, Montreal 14 1-4 March 2010
 JAR-FCL Mandatory Items
 Flight Preparation
 Before take-off checklist
 Engine failure between V1 and V2
 Rejected take-off before reaching V1
 Instrument departure and arrival procedures
 Engine-out Precision Approach to minima
 NDB/VOR/LOC approach to MDA Outlook
 Go-Around engine-out
 Landing critical engine inoperative

ICAO NGAP Symposium, Montreal 15 1-4 March 2010

 The Airline Burden
Crowding of training requirements
 Existing framework
 Mandatory items – licensing and operations
 Low Visibility mandatory items
 Special airport operations
 ETOPS, RNP SAAAR, RNAV
 Very little scope for effective additional training within
existing cost structure
 Too much focus on abnormal procedures
 Much more needed in approach & landing
ICAO NGAP Symposium, Montreal 16 1-4 March 2010
 The Problem
 Regulatory prescriptions for flight crewmember training
and checking are based on events, which may be
highly improbable in aeroplanes designed to meet
modern standards.

 Training programmes are consequently saturated with

items that may not necessarily mitigate the real risks, or
enhance the safety of modern air transport operations.

ICAO NGAP Symposium, Montreal 17 1-4 March 2010

 Objective

Develop a new paradigm for competency based

training and evaluation of airline pilots based on
evidence

ICAO NGAP Symposium, Montreal 18 1-4 March 2010

 Working Group

ICAO NGAP Symposium, Montreal 19 1-4 March 2010

 Flight Operations Areas
Evidence-based Type-Rating and Recurrent Q3 2011
Training (EBT)
- ICAO Doc 9868 + ICAO Manual EBT
Multi-Crew Pilot licensing (MPL) Q4 2010
- Harmonisation of implementation
Instructor & Evaluator Qualification (IEQ) Q3 2011
- ICAO Doc 9868 Qualification standards
Selection Criteria Q2 2010
- IATA guidance material
Flight Simulator Training Devices (FSTD) Aug 2009
- ICAO Doc 9625 + Data document

ICAO NGAP Symposium, Montreal 20 1-4 March 2010

 Hull Loss 1st generation: 2nd generation: 3rd generation: 4th generation:
per million departures
Early jet 2nd jet generation Glass-cockpit FBW
10 Nav display Flight Envelope
FMS Protection
9
Includes western built jets
8
Excludes training, flight test, war, terrorism
1st generation

5
Hull Loss rate – June 2009
4

2 All aircraft
4th generation 3rd generation 2nd generation
1

ICAO NGAP
0 ICAO NGAPSympsium
Symposium, Montreal Page
21 21 1-4March
1st March 2010
2010
0 10 20 30 40 50
Sources: Airclaims, Airbus Years Of Operation
 Relative Importance of contributing factors
in fatal accidents
cockpit crew

aircraft

environment
powerplant

maintenance
air traffic control

airport

0% 10% 20% 30% 40% 50%

(Source: Civil Aviation Safety Data, 1989-2003)

ICAO NGAP Symposium, Montreal 22 1-4 March 2010

 STEADES

ICAO NGAP Symposium, Montreal 23 1-4 March 2010

 Max vertical acceleration and vertical
speed (at touchdown)
A340-300
A340-600

ICAO NGAP Symposium, Montreal 24 1-4 March 2010

 Max vertical acceleration and vertical
speed (at touchdown)
A340-300
A340-600

ICAO NGAP Symposium, Montreal 25 1-4 March 2010

 Data can mislead
 Should we train for the statistically
likely?
 We can anticipate 95% of
events
 The BIG problem is the
other 5%

ICAO NGAP Symposium, Montreal 26 1-4 March 2010

 Black Swans
 Data is reactive
 Accidents are difficult to predict
 Pilot behaviour is difficult to predict

When people and complex systems interact, there will always be an

infinite number of possible outcomes

ICAO NGAP Symposium, Montreal 27 1-4 March 2010

The Unforeseen, a
“typical” Black Swan!
If we could anticipate all, failures
should be designed out (Sioux City)

ICAO NGAP Symposium, Montreal 28 1-4 March 2010

 Operational System Operational System
Reactive Proactive
failures failures failures failures

Environment Environment

Repetitive & foreseeable Unique & unforeseeable

Evidence

What we What we
know don’t know

Same skills to
manage the foreseen
and the unforeseen

ICAO NGAP Symposium, Montreal 29 1-4 March 2010

ICAO NGAP Symposium, Montreal 30 1-4 March 2010
 System malfunction
Fire
MEL
Eng Fail
Birds
Terrain
Upset A310
Wake vortex A320
Poor Visibility A330
R/W incursion A340
Traffic A380

Loss of comms
NAV
ATC
Crosswind
Adverse Weather/Ice
Windshear

0 50 100 150 200 250 300

ICAO NGAP Symposium, Montreal 31 1-4 March 2010

 Threats Risk Training
KSA Elements
Events Matrix Priorities

- Jet 1st
Generation Generation - LOE
- Jet 2nd Guidance for - Manoeuvres
Specific - Jet 3rd Specific
evaluation & - Event Training
Training - Jet 4th Program
training - Evaluator
Guidance - Turboprop 1st Examples - Instructor
- Turboprop 2nd

EBT Development Process

ICAO NGAP Symposium, Montreal 32 1-4 March 2010

 ICAO Doc 9868 PANS-TRG
Evidence Based Instructor Evaluator
Training Qualification Qualification

ICAO Manual – EBT

Includes Example Link to available
Comprehensive
Programs data

ICAO NGAP Symposium, Montreal 33 1-4 March 2010

 KSA Elements
 Situation awareness
 Communication
 Manual aircraft control
 Workload management
 Flight management, guidance and automation
 Knowledge
 Application of procedures and knowledge
 Problem solving & decision making
 Leadership & teamwork

ICAO NGAP Symposium, Montreal 34 1-4 March 2010

 Emirates - GCAA
 Dubai Meetings 15th -16th Nov 2009
 Emirates – Airbus – Boeing – IATA
 Preliminary Discussions
 Emirates – GCAA – Airbus – Boeing
 Joint Letter to GCAA EK+IATA
 GCAA Agreement 21st Dec 2009
 EK adopt EBT – EU OPS 1.978
(ATQP)
 Airbus, Boeing, IATA support

ICAO NGAP Symposium, Montreal 35 1-4 March 2010

 Risk of doing nothing

ICAO NGAP Symposium, Montreal 36 1-4 March 2010

 Benefits

Evidence based programmes adapted by fleet and operation

Greater focus on normal operations

Greater emphasis on human performance

Encourage “out of the box” thinking with developed methodologies to manage risk

ICAO NGAP Symposium, Montreal 37 1-4 March 2010

 Improvements in
design &
reliability

Train real skills

to Examine the
manage real Evidence
threats

Evolve training
New Paradigm
from inventory
for Training
approach

ICAO NGAP Symposium, Montreal 38 1-4 March 2010

 Thank you
itqi@iata.org

ICAO NGAP Symposium, Montreal 39 1-4 March 2010