Professional Documents
Culture Documents
Mica R. Endsley
Department of Industrial Engineering
Texas Tech University
Lubbock, Texas
Mark D. Rodgers
FAA Civil Aeromedical Institute
P.O. Box 25082
Oklahoma City, Oklahoma 73125
©
U.S. Department
of Transportation
Federal Aviation
Administration
19950104 028
NOTICE
This study was conducted with the help and cooperation of the FAA Academy. We would like to
thank Mr. Richard W. Pollard (Manager, En Route Training Branch), Mr. Robert E. Davis (Manager,
En Route Radar Associate Section), and the Instructional Air Traffic Control Specialists of the Academy
who participated as subject matter experts and contributed their time and expertise in performing this
analysis. Special thanks are due to the Quality Assurance Specialists at Atlanta Air Route Traffic Control
Center for their assistance in reviewing the SA requirements analysis.
Accesion For
NT1S CRA&I
DTIC TAB D
Unannounced D
Justification
By
Distribution j
Availability Codes
Avail and | or
Dist Special
111
TABLE OF CONTENTS
Introduction 1
Objective & Scope 4
Approach 4
Methodology 5
Results & Discussion 8
References 9
Appendix A: Goal Hierarchy Al
Appendix B: Goal Directed Task Analysis - En Route Air Traffic Control Bl
SITUATION AWARENESS INFORMATION REQUIREMENTS FOR
EN ROUTE AIR TRAFFIC CONTROL
INTRODUCTION
Air traffic control specialists (ATCSs) are called munications channels forms the basis for situation
upon to sort-out and project the paths of an ever- awareness. The quality of a controller's SA is moder-
increasing number of aircraft in order to ensure goals ated by his/her capabilities, training and experience,
of minimum separation and safe, efficient take-off, en preconceptions and objectives, and ongoing taskwork-
route and landing operations. This job relies upon the load.
situation awareness (SA) of controllers who must Situation awareness forms the critical input to, but
maintain current assessments of the rapidly changing is separate from, decision making, which is the basis
location of each aircraft (in three-dimensional space) for all subsequent actions. Proper implementation of
and their projected future locations relative to each rules and procedures will depend on the quality of the
other, along with other pertinent aircraft parameters controller's SA. Even the best trained and most expe-
(destination, fuel, speed, etc...)- Controllers have his- rienced controllers can make the wrong decisions if
torically called this "the picture" — their mental they have incomplete or inaccurate SA. Conversely,
model of the situation upon which all of their deci- an inexperienced controller may accurately under-
sions rely. "The central skill of the controller seems to stand what is occurring in the environment, yet not
be the ability to respond to a variety of quantitative know the correct action to take. For this reason, it is
inputs about several aircraft simultaneously and to important that SA be considered separately from the
form a continuously changing mental picture to be decision making and performance stages. To further
used as the basis for planning and controlling the expand on the above definition, SA can be described
course of the aircraft" (Dailey, 1984). Providing con- in three hierarchical phases, as depicted in Figure 1.
trollers with an accurate, complete, and up-to-date
picture of the situation may prove to be a daunting Level 1 SA - Perception of the elements in the
challenge as the environment in which they work environment
becomes even more complex and demanding. The first phase in achieving SA involves perceiving
While several definitions of SA have been offered, the status, attributes, and dynamics of relevant ele-
the most generally applicable definition is that pro- ments in the environment. The ATCS needs to accu-
vided by Endsley (1987; 1988). "Situation awareness rately perceive each of the aircraft in his/her airspace
is the perception of the elements in the environment and their relevant attributes (ID, airspeed, position,
within a volume of time and space, the comprehen- route, direction of flight, altitude, etc.), weather, pilot
sion of their meaning, and the projection of their and controller requests, emergency information, and
status in the near future." A crucial factor in under- other pertinent elements.
standing SA in the ATC environment rests on a clear
elucidation of the elements in this definition. The Level 2 SA - Comprehension of the current
objective of this effort was to determine those ele- situation
ments for En Route ATC. Comprehension of the situation is based on a
Figure 1 presents a description of SA in relation to synthesis of disjointed Level 1 elements. Level 2 SA
decision making and performance. The controller's goes beyond simply being aware of the elements that
perception of the elements in the environment, as are present to include an understanding of the signifi-
determined from various displays, readouts, and com- cance of those elements in light of the controller's
Situation Awareness
FEEDBACK
WORKLOAD
SITUATION AWARENESS
(j AM)
OBJECTIVES
EXPERIENCE,
TRAINING)
PROCEDURES,
goals. Based upon knowledge of Level 1 elements, Second, SA is highly spatial in nature in this envi-
particularly when put together to form patterns with ronment. In addition to a consideration of the spatial
the other elements, a holistic picture of the environ- relationships between aircraft, the ground, weather
ment will be formed, including a comprehension of patterns, winds, etc., there is also a spatially-deter-
the significance of objects and events. The controller mined and goal-determined specification ofjust which
needs to put together disparate bits of data to deter- subsets of the environment are currently important to
mine the impact of a change in one aircraft's flight SA, based on the tasks at hand. ATCSs typically have
status on another, or deviations in aircraft positions well-defined spatial boundaries within which their
ffom expected or allowable values. A novice controller responsibility lies. Within these boundaries, the re-
might be capable of achieving the same Level 1 SA as gion may be further subdivided, based on importance
a more experienced one, but may fall short in the to SA. For example, the boundary may shift spatially
ability to integrate various data elements, along with and temporally to include different aircraft, depend-
pertinent goals to comprehend the situation, as well. ing on current goals and tasks, or may shift function-
ally to include different aspects of aircraft that are
Level 3 SA - Projection of future status being controlled. This subdivision can be dynamically
First it is the ability to project the future actions of modified as various tasks present themselves by refo-
the elements in the environment, at least in the near cusing on different elements within the problem space
term, that forms the third and highest level of situa- or by changing the boundaries of the problem space
tion awareness. This is achieved through knowledge itself.
of the status and dynamics of the elements and a Within the list of elements that controllers find
comprehension of the situation (both Level 1 and necessary for good SA, not all elements have equal
Level 2 SA). For example, the controller must not only importance at all times. When conditions are clear,
comprehend that three aircraft, given their directions for instance, weather may not be a primary consider-
of flight and altitudes, are likely to violate separation ation. Controllers may opt to shift attention away
rules within a certain period of time, but also deter- from some aircraft to concentrate on a few that are
mine what airspace will be available to make routing potentially conflicting. It is important to note, how-
decisions, and ascertain where other potential con- ever, that elements never become irrelevant or unim-
flicts may develop. This ability gives the controller the portant, just secondary at certain points in time. At
knowledge (and time) necessary to decide on the most least some SA on all elements is required at all times,
favorable course of action. to know which can be made secondary and which
While SA can be described as the controller's knowl- should be primary. And at least some SA is required
edge of the environment at a given point in time, it even on secondary elements in order to know that they
should be recognized that SA is highly temporal in have not become primary. Many times it is those
nature. It is not acquired instantaneously, but is built elements, deemed as secondary, that cause serious
up over time. Ascertaining aircraft dynamics based on errors when SA on those elements is totally lost.
past actions and conditions is part of what allows the Danaher (1980) reported on a near mid-air collision
controller to project the state of the environment in between a DC-10 and an L-1011, in which the con-
the near future. It is for this reason that adherence to troller was aware of the potential of a traffic conflict
procedures associated with the position relief briefing between the two jets, yet "became preoccupied with
is critical. Position relief briefings, involving the use secondary tasks" and failed to monitor the progress of
of a checklist, are used to ensure the completeness of the situation or to report it to the relief controller.
information shared. During the briefing, the relief Twenty-four people were injured in the resultant
controller typically acquires adequate SA to perform evasive maneuver by one of the pilots who managed to
his/her job. avoid a collision at the last minute.
Situation Awareness
Situation awareness is highly important for suc- including perception (level 1), comprehension (level
cessful performance in the demanding ATC environ- 2), and projection (level 3) of elements per the prior
ment. Mogford and Tansley (1991) investigated the definition of SA. These requirements can be used as
relationship between controller SA and success in input to system/equipment design, training, and re-
training. They found that SA was positively correlated search and evaluation efforts which need to consider
with performance in an ATC simulator. In a recent the situation awareness needs of the controller.
Table 1
Subject Experience
1 4 6 Oakland
2 6 8 Memphis
3 4.5 8 Memphis
4 7 9 Cleveland
5 9 6 Oakland
6 6 19 Houston
7 5 8 Anchorage
8 8 24 Anchorage
Situation Awareness
Table 2
En Route ATC SA Requirements
LEVEL 1
Aircraft Emergencies Airports
• aircraft ID, CID, beacon • type of emergency
determining the desired form of information, and ing expert elicitation. As over-generalizing and sum-
how that information was used (i.e., the higher-level marizing are well known shortcomings of the expert
SA information requirements), which could not be elicitation verbalization processes, the evaluation of
readily determined from available documentation. these scenarios was important for helping to ensure
Based on the information obtained from the task completeness in the task breakdowns developed.
awareness information requirements across subgoals Endsley, M. R. (1988). Design and evaluation for situ-
was compiled, and is presented in Table 2. This list ation awareness enhancement. Proceedings of the
includes the controllers' major SA information re- Human Factors Society 32nd Annual Meeting {$$.
97-101). Santa Monica, CA: Human Factors So-
quirements (for dynamic information), exclusive of
ciety.
static knowledge requirements, sources of the infor-
mation, or associated tasks. These requirements have Endsley, M. R (1993). A survey of situation awareness
requirements in air-to-air combat fighters. Inter-
been broken down into each of the three levels,
nationalJournal of Aviation Psychology, 2(2), 157-
perception of elements (level 1), comprehension of 168.
their meaning (level 2) and projection of the future
Human Technology, Inc. (1990). Cognitive task analysis
(level 3). of prioritization in air traffic control McLean, Vir-
This analysis should be useful for guiding the ginia. October 1990. Under Contract OPM-87-
design and development of future ATC systems. An 9041.
explicit consideration of controller SA information
Mogford, R. H., andTansley, B. W. (1991). The impor-
requirements, particularly at the higher levels, should tance of the air traffic controllers mental model
be beneficial for designing more efficient interfaces Paper presented at the Human Factors Society of
and suitable automated assistance to ease controller Canada Annual Meeting, Canada.
workload and enhance SA in the performance of their Monan, W. P. (1986). Human factors in aviation opera-
tasks. In addition, this list of SA information require- tions: The hearback problem (NASA Contractor
ments can be used to direct SA measurement efforts as Report 177398). Moffett Field, CA: NASA Ames
they pertain to ATC system design evaluation, train- Research Center.
ing technique evaluation, error investigation, or con- Rodgers, M. D., and Duke, D. A. (1993). SATORI:
struct exploration. Situation assessment through the re-creation of inci-
dents. Journal of Air Traffic Control, 22(4), 10-14.
REFERENCES Rodgers, M. D., and Nye, L. G. (1993). Factors associ-
ated with the severity of operational errors at Air
Dailey, J. T. (1984). Characteristics of the air traffic Route Traffic Control Centers. In M. D. Rodgers
controller. In S. B. Sells, J. T. Dailey, and E. (Ed.), An analysis of the operational error database
for Air Route Traffic Control Centers (DOT/FAA/
W. Pickerel (Eds.), Selection of air traffic controllers (pp. AM-93/22) Washington, DC: Federal Aviation
128-141). Washington, D. C: Federal Aviation Administration, Office of Aviation Medicine.
Administration, Office of Aviation Medicine.
Rodgers, M. D., and Drechsler, G. K. (1993). Conver-
Danaher, J. W. (1980). Human error in ATC system sion of the CTA, Inc., En Route operations concepts
operations. Human Factors, 22(5), 535-545. database into a formal sentence outline job task
Endsley, M. R. (1987). SAGAT: A methodology for the taxonomy (DOT/FAA/AM-93/1).Washington,
measurement of situation awareness (NOR DOC DC: Federal Aviation Administration, Office of
87-83). Hawthorne, CA: Northrop Corporation. Aviation Medicine.
Situation Awareness
APPENDIX A
GOAL HIERARCHY
1. Avoid conflictions
1.1. Separate aircraft
1.1.1 Assess aircraft separation
1.1.2 Resolve aircraft conflict
1.1.2.1 Determine required change
1.1.2.2 Assess aircraft conformance (1.3.1)
1.1.3 Issue traffic advisory
Al
Appendix A
Handle perturbations
3.1. Assess weather impact
3.1.1 Determine if action is needed
3.1.1.1 Weather impact
3.1.1.2 IFR/VFR conditions
3.1.1.3 Flight levels available
3.1.1.4 Airport conditions
3.1.2 Provide clearance (2.2)
A3
Situation Awareness
APPENDIX B
GOAL DIRECTED TASK ANALYSIS - EN ROUTE AIR TRAFFIC CONTROL
The goal directed task analysis lists each of the controller's main goals, associated subgoals and situation
awareness information requirements for meeting these subgoals. The format of the document is as follows:
There are few guidelines that should be kept in mind when reviewing this document.
• At any given time more than one goal or subgoal may be operating, although these will not always have
the same priority. The attached listing does not assume any prioritization among them, or that each
subgoal within a goal will always come up.
• These are goals or objectives, not tasks. The analysis is supposed to be as technology free as possible. How
the information is acquired is not addressed. In some cases it may be through the radar display, the flight
progress strips, communications, other controllers, or the controller may have to determine it on his or
her own or guess. Many of the higher level SA information requirements may fall into this category. This
analysis does not address how a controller would get the information or problems with information
overload.
• The analysis sought to define what controllers would ideally like to know to meet each goal. It is
recognized that they often must operate on the basis of incomplete information and that some desired
information may not be available at all with today's system.
• Static knowledge, such as procedures or rules for performing tasks, is also outside the bounds of this
analysis. The analysis primarily identifies dynamic situational information that affects what controllers
do.
Bl
Appendix B
1.2 Avoid airspace conflict (I A 6,8) (II C) (III C) (IV I,H) (VIH)
1.2.1 Assess aircraft/airspace separation
• potential airspace violation?
• airspace to be avoided?
• projected position of aircraft relative to airspace
• current position of aircraft relative to airspace
• aircraft ID
• projected aircraft route (current) (2.1.1)
• aircraft capabilities (2.1.2)
• airspace
• who's in control
• current status
• normal activation period
• boundaries
• altitude limits
• type
B3
Appendix B
I M "
B5
Appendix B
contact established?
• aircraft position
• aircraft ID
• communications present
• altimeter setting correct
• aircraft turning?
• time until aircraft reaches assigned route/heading
• amount of route deviation
• aircraft position (current)
• aircraft heading (current)
• route/heading (assigned)
• aircraft turn rate (current)
• aircraft heading (current)
• aircraft heading (past)
• aircraft turn capabilities
• aircraft type
• altitude
• aircraft groundspeed
• weather
• winds (direction, magnitude)
B7
Appendix B
16 >sWi6hs
• terrain
• minimum safe altitude
• minimum IFR altitude
• projected aircraft route (current) (2.1.1)
• aircraft capability (2.1.2)
• level of control
1.4.2 Change altitude
• change needed?
• provide clearance (2.2)
B9
Appendix B
I
V"
sector boundaries
Bll
Appendix B
• new airspeed
• new route
• special conditions
• pilot reports
• controller actions taken
B13
Appendix B
• equipment (unctions
• emergencies
• time in holding
• pilot requests
2.3.2.4 Provide clearance (2.2)
B15
Appendix B
impact on aircraft
• reason
• Assess weather impact (3.1)
• Respond to emergency (3.2)
B17
Appendix B
B19
Appendix B
i i^j^dii^(AukMQ.l.l]
• time on fuel remaining
• souls on board
• location of nearest airport with capabilities for aircraft type and type of emergency
• coordination required