Professional Documents
Culture Documents
Ares(2020)2543677 - 14/05/2020
EXPLORATORY RESEARCH
ENVISION D2.1
Operational and Safety
Requirements
Deliverable ID: D2.1
Dissemination Level: PU
Project Acronym: ENVISION
Grant: 783270
Call: H2020-SESAR-2016-2
Topic: SESAR-ER3-05-2016
Consortium Coordinator: ALTYS
Edition date: September 2019
Edition: 00.02.00
Template Edition: 02.00.01
1
Authoring & Approval
Approved for submission to the SJU By - Representatives of beneficiaries involved in the project
Name/Beneficiary Position/Title Date
Quentin Crombé / ALTYS Project Manager September 2019
Roger Lane / EUROCONTROL Project Member September 2019
Paul Fletcher / GRAFFICA Project Member September 2019
Mathieu Cousy / ENAC Project Member September 2019
Document History
Edition Date Status Author Justification
00.00.01 06 November 2018 Draft Stephane Dubuisson Initial version
00.00.02 30 November 2018 Draft Stephane Dubuisson Second version following
Draft partners first review and
comments
2
00.01.00 7 December 2018 Release Stephane Dubuisson Version 1.0 following F2F
discussion
00.02.00 September 2019 Release Stephane Dubuisson Version 2.0 following SJU
comments on V1.0 and
second project
experiment in
Carcassonne airport.
Copyright Statement © – 2018 – – ENVISION Consortium. All rights reserved. Licensed to the SJU
under conditions.
3
ENVISION
ENHANCED SITUATIONAL AWARENESS THROUGH VIDEO INTEGRATION WITH
ADS-B SURVEILLANCE INFRASTRUCTURE ON AIRPORTS
This document is part of a project that has received funding from the SESAR Joint Undertaking under
grant agreement No 783270 under European Union’s Horizon 2020 research and innovation
programme.
Abstract
This document provides the Operational and Safety requirements for using Envision Surveillance
means while identifying potential impact on standardisation. It also includes the Concept of Use of
Envision surveillance for ATC and A-CDM viewpoints.
4
Table of Contents
1 Introduction ............................................................................................................... 7
1.1 Disclaimer ..................................................................................................................... 7
1.2 ENVISION project overview ............................................................................................ 7
1.3 Document Scope ........................................................................................................... 7
2 Selection of Sensing Technologies............................................................................... 8
2.1 Introduction .................................................................................................................. 8
2.2 System Overview ........................................................................................................... 8
2.2.1 Sensors .............................................................................................................................................. 8
2.2.2 Data fusion ...................................................................................................................................... 12
4 References ............................................................................................................... 35
Appendix A ..................................................................................................................... 36
A.1 Acronyms .................................................................................................................... 36
Appendix B EUROCONTROL A-SMGCS Surveillance Service Requirements [12] ............ 38
List of Tables
Table 1: Flight List Columns ................................................................................................................... 24
List of Figures
5
Figure 1: System overview ...................................................................................................................... 8
Figure 3 : ALTYS SAGA tool - example of aircraft sending ADS-B data based on Inertial Systems
without correction................................................................................................................................. 10
6
1 Introduction
1.1 Disclaimer
The opinions expressed herein reflect the author’s view only. Under no circumstances shall the
SESAR Joint Undertaking be responsible for any use that may be made of the information contained
herein.
7
2 Selection of Sensing Technologies
2.1 Introduction
Based on the initial project investigation [6] and deliverable [1], the project has confirmed his choice
of selecting the sensing technologies described in the project proposal. These technologies are briefly
presented in the following sections.
2.2.1 Sensors
In order to provide regional and local airports with safe and affordable surface movement
surveillance capabilities for ATC and A-CDM services, there must first be a source, or sources, from
which to get information. The minimum information that a controller would need to perform his/her
task include aircraft or vehicle position and identity. The gathering of this information can generally
be referred to as remote sensing as it senses information in the environment. For ENVISION, the
selected technologies are the following:
ADS-B
Digital Video camera
LIDAR
8
2.2.1.1 ADS-B
ADS-B (Automatic Dependent Surveillance – Broadcast) is a system that uses transmissions from
aircraft to provide geographical position, pressure altitude data, positional integrity measures, flight
identity, 24-bits aircraft address, velocity and other data which have been determined by airborne
sensors.
Typically, the airborne position sensor is a GPS receiver, or the GPS output of a Multi-Mode Receiver
(MMR). This sensor must provide integrity data that indicates the containment bound on positional
errors1. The altitude sensor is typically the same barometric source / air data computer source used
for SSR (Secondary Surveillance Radar). Integrated GPS and inertial systems are also used. Currently
inertial only sensors do not provide the required integrity data although these are likely to be
provided in the future. , meanwhile the data fusion shall use filtering techniques and the additional
sensors (e.g. cameras) in order to correct theses positioning errors.
An ADS-B ground system uses a non-rotating antenna positioned within a coverage area, to receive
messages transmitted by aircraft. Typically, a simple pole (DME2 like) antenna can be used.
The ADS-B ground system does not necessarily transmit anything. ADS-B receiver ground stations are
the simplest and lowest cost installations of all options to provide air-ground surveillance, although
An ADS-B receiver is typically less than six inches high by nineteen inches wide and a duplicated site
consumes less than 200 watts of electricity. An ADS-B ground station can normally be installed in an
existing VHF (Very High Frequency) communications facility.
ADS-B is becoming a mandatory piece of equipment for new aircraft as part of Single European Sky
regulation [2]. It is being used in Canada as part of air traffic control in certain areas, giving those
flights a higher level of service. Its use is also mandatory in parts of Australia.
Safety Performance and Interoperability Requirements for ADS-B for Airport Surface Surveillance are
defined in EUROCAE ED-163 / DO-321, 2011.
2.2.1.3 Lidar
LIDAR is the measurement of distance by scanning an object, or area, with multiple lasers. It has been used to
profile clouds, measure winds, and study atmospheric contamination. In the context of ENVISION, the Lidar is
used as a complementary sensor which is by far more precise than the video processing for depth computation.
Although lidar positioning is more precise, it is too complex to classify detected objects, thus it will be used
together with video processing (which is worse at positioning but can classify the objects).
ADS-B receivers
The “Data fusion” module will collect and fuse information from available sensors in an optimal way.
The redundancy will be managed by considering the reliability and integrity of position data provided
by each source of information dynamically.
The output of the Data Fusion module [1] will feed the A-SMGS and A-CDM systems.
12
3 ENVISION Concept of Operation
3.1 ENVISION A-SMGCS Surveillance
3.1.1 Description
The ENVISION A-SMGCS prototype provides situational awareness of aerodrome traffic through the
identification, position and tracking of aircraft and vehicles on an aerodrome. As described in section
3.2, it is based on cooperative (ADS-B) and non-cooperative sensors (Digital Video Camera and Lidar)
to detect any mobile in particular intruders or aircraft with inoperable ADS-B equipment, as well as
persons or vehicles on the covered area.
The ENVISION A-SMGCS Surveillance provides a synthetic representation of the aerodrome traffic
situation based on the following features:
• Aerodrome Environment.
• Position of all cooperative and non-cooperative mobiles and obstacles on the movement
area.
• Identity of all cooperative mobiles on the movement area.
3.1.2 Actors
For the purpose of this document the term ‘Controller’ is used as a common reference for the
following actors:
• Tower Supervisor.
• Apron Manager.
• Approach Controller.
The background image is a map of the airport on top of which the detected objects are
displayed
In the top left corner, the controller can display a video feed coming from one of the cameras
used in ENVISION system
In the bottom right corner, a flights information zone represents a flight strip to display
information on the selected aircraft and an empty strip to be dragged when needed for a
new or uncorrelated aircraft.
14
Figure 6: a/c, vehicle and person icons
The ENVISION system provides information on position uncertainty using an ellipse on the radar
image, the larger the ellipse the less accurate the position of the target. The size of the ellipse is
determined by the accuracy of the position of the target in depth (which is the wider part of the
shape due to uncertain distance from the camera) versus lateral movement (the thinner part of the
shape) which is more accurately captured.
15
Figure 7: Video feed
16
Empty strip, drag to create a new
one
The second zone is an empty flight strip, the controller can drag a blank strip and the fill in the
information in case of an uncorrelated track. Once the strip is filled, it can be dragged over an
uncorrelated track to associate them. Afterwards this strip can be modified as any other by clicking
on the track and modify the information from the main zone.
• Verify Flight Crew/Vehicle Driver position reports with the information displayed on the HMI.
• Verify Flight Crew/Vehicle Driver position using live videos in case of conflicted HMI view.
Depending on the visibility condition, controllers are retrieving all necessary information from
outside view, the ENVISION HMI and by radio communicating with pilots.
In case of non-automatic correlation, controllers manually correlate aircraft via the HMI.
In case of failure or degraded equipment conditions, Controllers have to operate in the same manner
as they operate nowadays.
Note: The “defined level of safety” is a local aerodrome parameter defined by competent local
authorities. Guidelines can be found in “EUROCONTROL Preliminary Safety Case A-SMGCS Levels 1
and 2” [5].
ENVISION-A-SMGCS-Req-030:
ENVISION A-SMGCS shall provide a presentation enabling the controller to fulfil the
requirement in ICAO Doc 4444 [4], Chapter 7.1.1.2:
“Aerodrome controllers shall maintain a continuous watch on all flight operations on and in
the vicinity of an aerodrome as well as vehicles and personnel on the manoeuvring area.
Watch shall be maintained by visual observation, augmented in low visibility conditions by an
ATS surveillance system when available.”
ENVISION-A-SMGCS-Req-040:
ENVISION shall enable the controller to fulfil the objective of preventing collisions between
aircraft and obstructions on the manoeuvring area.
ENVISION-A-SMGCS-Req-050:
In case the ENVISION A-SMGCS surveillance is lost or working in degraded mode, relevant
fall-back procedures shall be applied.
Note: Fall back procedures shall be defined locally and will vary according to the element of
the A-SMGCS that is detected as non-working successfully. Ultimate fall-back procedure is to
come-back to “today” way of working i.e. without using the ENVISION A-SMGCS Surveillance.
- Generic Surveillance Safety & Performance Requirements Document (GEN-SUR-SPR) [7]: this
Safety and Performance Requirements (SPR) document determines the minimum
requirements for a Generic Surveillance (GEN-SUR) system supporting the Air Traffic Control
(ATC) service, in particular on the separation of aircraft. It links the ATC Surveillance Service,
environment types and ATC separation minima with the corresponding requirements on co-
operative ATC surveillance data provision to the air traffic controller.
- EUROCONTROL Specification for ATM Surveillance System Performance (ESASSP) [8]: this
document provides performance requirements for ATM surveillance system, ENVISION may
have an impact on the surveillance performance by using a new mean of surveillance.
- Minimum Aviation System Performance Specification for Remote Tower Optical Systems plus
target tracking (ED-240) [10]: this document contains the Minimum Aviation System
Performance Specification (MASPS) for remote tower optical systems including specification
of standard system characteristics. It is intended to be used by equipment designers,
regulators, manufacturers, installers, aerodrome ATS providers and operators.
6
http://www.eurocontrol.int/articles/airport-collaborative-decision-making-cdm
19
A core concept is the provision of a single, common set of information that is contributed to, and
shared by numerous partners.
In the first instance, the information is shared via a web interface. The following figure illustrates
some of the common data that is typically provided by partners.
Airport Operations
Stand and gate
Aircraft Operator/
allocation
Handling Agent
Environmental
Planning data
Information
Turn-around times
Special events
Flight plans
Reduction in capacity
Movement data
Airport slot data
Priority of flights
ADES
Aircraft registration
SOBT
and Type changes
TOBT
Movement messages
A-CDM
Air Traffic Control Information
ELDT
Service Providers
ALDT
De-icing companies
TSAT
MET office (forecast
Runway and Taxiway
and actual met. info.)
conditions
Others (fire, police,
Taxi times
customs, fuel etc.)
SID allocation
Runway capacity
A-SMGCS data/radar
information.
Network Operations
3.2.2 Actors
Actors contributing to and using the ENVISION A-CDM may vary according to airport but are typically:
Network Management,
Airport Operations,
7
Source: The Manual – Airport CDM Implementation [3]
20
Aircraft Operators and their handling staff,
The menu bar indicates the current airport code (or name), the current application mode
(Operational-ATC, Operational-Airport or Guest) and provide options to update the view. Where
appropriate, the user shall be able to change these display options. On the menu-bar, the current
user is displayed and a link to sign out.
The Flight List is composed of a table containing all information on arrival and departure flights. The
flight information is mostly extracted from the Network Manager system, using the NM B2B Web
services API.
The table below specifies the columns that shall be displayed in the arrival and departure lists, the
optional columns, and which users are able to update the column data
Movement times may be Scheduled, Estimated, Target or Actual – the following table defines
who/what may update each type.
May be updated by
Operational-Airport
The foreground colour of the time fields indicates whether the time is scheduled (black), estimated
(blue), target (blue) or actual (green).
The background colour of a table cell is updated to orange to indicate an alert condition. A tooltip is
displayed on cells with alerts active to state the reason for the alert.
Selecting a row in one flight list will also select the matching flight from the other table and update
the “Vertical Profile Display”. For example, selecting a flight in the arrival table will select the next
flight for that aircraft in the departure table.
24
Figure 12: Situation Display window
The position and orientation of mobiles are retrieved from the “Data Fusion” module outputs and
aircraft icons are placed on the map in the correct positions and rotated to the correct orientation.
The aircraft icons are updated in real-time whenever a new position is received from the “Data
Fusion” module.
25
Additionally, it is possible to view extra information on the aircraft such as the registration, speed,
orientation, and altitude by clicking on the aircraft icon. The extra information is shown on a popup
on the map.
A short history of mobile positions is stored in the A-CDM database and can be shown on the Air
Situation Display when the aircraft is clicked. The movement history is shown as a line following the
currently selected aircraft.
The vertical profile display shows the status of an arrival flight alongside its related departure
graphically. The display shows the flight numbers, aircraft type, stand number, LDT, IBT, OBT, and
TOT. As a flight progresses through the various A-CDM milestones, the vertical profile display is
updated, and an aircraft icon moves between the various positions on the diagram. For example, as
the selected flight state is set to IBK, the aircraft icon will be shown at the IBK position
The airport information window shows currently relevant information for the currently selected
airport. The information displayed in the window is configurable by users with sufficient privilege and
is a simple text area.
26
3.2.4 Alert Monitoring
Flight data is monitored for incoherency or inadequacy in time estimation, and/or associated flight
status. The specific alert conditions that are monitored are:
CDM02: SOBT vs EOBT discrepancy. This shall be triggered when the EOBT is greater than
SOBT by a given time (assumes both of those values are set). For example: EOBT > (SOBT + 5
mins).
CDM03: Aircraft Type Discrepancy. This alert will be based on Aircraft Type and triggered
when the aircraft type recorded in the APT Flight Data differs from the aircraft type in the
NM data.
CDM04: Aircraft Registration Discrepancy. This alert will be based on the aircraft registration
number and is triggered when the number recorded in the APT Flight Data differs from the
value in the NM data.
CDM07: EIBT + MTTT discrepancy with EOBT. Triggered when estimated in-block time plus
minimum turnaround time is beyond the estimated off-block time. For example: (EIBT +
MTTT) > (EOBT + 15 mins).
CDM08: EOBT Compliance Alert. Triggered when TOBT is outside EOBT ± 15 minutes.
Pre Conditions
The Operator is connected to the internet and has the authority to log on
Post Conditions
The Operator is logged on to the correct airport
Actor
Operator (Tower Controller, Airport Operations, any other partner with log on rights)
Main Flow
27
Failure Flow
6. The website doesn’t open. The operator checks the connection and if issue continues contacts
service support.
Pre Conditions
The Operator is logged onto the selected airport (UC1).
Post Conditions
The arrival aircraft has reached its parking position and has shut down
Actor
Operator (Tower Air Traffic Control, Airport Operations, any other partner with log on rights)
Main Flow
29
Event Event Data coming from … Actor responsible
number
11. ENVISION A-CDM
At Event 5: If there is a discrepancy
Application
between the Aircraft Registration in the
FUM and in the airport data then an
alert CDM04 will be triggered and
displayed in the INFO column. The
aircraft registration field will be
highlighted with an orange background.
12. The Aircraft Operator or Ground Handler Aircraft Operator or
responsible for the flight will confirm Ground Handler.
which registration is correct and get the
Airport Database updated through local
procedures.
13. The alert is cancelled when the Airport Operator
discrepancy is resolved.
14. The use case continues at Event 6.
Pre Conditions
The Operator is logged onto the selected airport (UC1).
30
Post Conditions
The departure aircraft is on its parking position.
Actor
Operator (Tower Controller, Airport Operations, any other partner with log on rights)
Main Flow
32
Operational – ATC (access write to some functionalities e.g. AOBT),
Operational – Airport / Aircraft Operator (access write to some functionalities e.g. TOBT
update, Stand),
Guest - Public (Passenger) read only mode.
ENVISION-A-CDM-Req-040: The ENVISION A-CDM Platform shall receive FPL and FUM information
from the Network Manager system, using the NM B2B Web services API.
ENVISION-A-CDM-Req-050: The ENVISION A-CDM Platform shall exchange as a minimum the A-DPI
and C-DPI message with the NM using B2B Web services API.
Note: Exchange of the other DPI messages (E-DPI & T-DPI) are a local agreement with NM.
ENVISION-A-CDM-Req-070: The foreground colour of the time fields shall indicate whether the time
is scheduled (e.g. black), estimated/target (e.g. blue), or actual (e.g. green).
ENVISION-A-CDM-Req-090: The Vertical profile window shall provide a timeline view with the
vertical profile of the flight, once selected the flight shows the known history of the flight (for a
turnaround, the arrival callsign till the On block then the departure callsign till the departure).
33
ENVISION-A-CDM-Req-100: The flight profile information shall be extracted from the Network
Manager system, using the NM B2B Web services API.
ENVISION-A-CDM-Req-110: The Airport information and weather window shall represent data
available at the airport like Temperature, ATIS, QNH and other any airport information defined locally
like work in progress.
34
4 References
[1] ENVISION System interfaces specification - D3.1 30 March 2018 v 1.0
[4] ICAO PANS ATM, Procedures for Air Navigation Services – Air Traffic Management, Doc4444, 15th
Edition, November 2007.
[5] EUROCONTROL Preliminary Safety Case A-SMGCS Levels 1 and 2, 30th June 2010, V2.1
[7] Generic Surveillance Safety and Performance Requirement, working version 0.5, August 2017
[8] EUROCONTROL Specification for ATM Surveillance System Performance, Edition 1.1, September
2015
[10] EUROCAE MINIMUM AVIATION SYSTEM PERFORMANCE SPECIFICATION FOR REMOTE TOWER
OPTICAL SYSTEMS, September 2016
[11] EUROCONTROL Advanced ATC TWR Implementation Guide, version 1.4, 1st August 2017
[12]EUROCONTROL Specification for Advanced-Surface Movement Guidance and Control System (A-
SMGCS) Services – V1.0 March 2018
35
Appendix A
A.1 Acronyms
Term Definition
APT Airport
36
ETA Estimated Time of Arrival
IBK In Block
NM Network Manager
Table 3: Acronyms
37
Appendix B EUROCONTROL A-SMGCS
Surveillance Service Requirements [12]
ASMGCS-[SURV]-[010] The Surveillance Service shall include at least one cooperative sensor and at
least one non-cooperative sensor.
ASMGCS-[SURV]-[020] The Surveillance Service shall provide the identification, position and tracking
of mobiles within a predefined Coverage Volume.
ASMGCS-[SURV]-[030] The Surveillance Service shall be designed to minimise the following effects:
Radio interference, including that produced by standard navigation, telecommunications and
radar facilities (including airborne equipment).
Signal reflections and shadowing caused by aircraft in flight, vehicles or aircraft on the
ground, buildings, snow banks or other raised obstacles (fixed or temporary) in or near the
aerodrome environment.
ASMGCS-[SURV]-[050] The Surveillance Service shall use transponder signals for the purpose of
determining the location and identity of cooperative aircraft.
Note: The transponder operating procedures for Flight Crew are normally published in the AIP.
ASMGCS-[SURV]-[060] The Surveillance Service shall use transmitter signals for the purpose of
determining the location and identity of cooperative vehicles.
ASMGCS-[SURV]-[070] The HMI shall display every mobile in the correct position with respect to the
aerodrome layout and other traffic.
ASMGCS-[SURV]-[080] The Surveillance Service shall calculate the current speed and heading of
mobiles within the Coverage Volume.
ASMGCS-[SURV]-[100] The HMI shall allow the manual assignment of an identification label to a non-
identified target.
38