CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van...
-
Upload
juan-martin -
Category
Documents
-
view
216 -
download
2
Transcript of CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van...
![Page 1: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/1.jpg)
CARE ASAS Validation Framework
![Page 2: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/2.jpg)
Partners
CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich
Borkenhagen
Consortium Partners Aena, Isdefe, NATS, NLR, QinetiQ
Currently 6 months into 12 month programme
![Page 3: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/3.jpg)
Validation of ASAS
Validation Does proposed operational concept provide anticipated
performance?
Operational concept
Performance Framework
![Page 4: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/4.jpg)
High Level Validation Process
![Page 5: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/5.jpg)
ASAS Framework Requirements
Operational Concept - Airborne Separation Assurance Systems
Performance Framework Reference Scenario High level objectives Metrics
Links to Previous work Support to Users
![Page 6: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/6.jpg)
Operational Concept
ASAS application categories, from PO-ASAS
Airborne Traffic Situation Awareness• Current ATC rules apply
Airborne Spacing • Aircrew given more tasks
Airborne Separation• Temporary delegation of separation to aircrew
Airborne Self-separation• Full delegation of separation
![Page 7: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/7.jpg)
Performance Framework
ATM 2000+ Strategy Objectives Safety Capacity etc
Framework Scenario Operationally realistic Scenario data repository
Metrics System Performance Metrics Human Performance Metrics
![Page 8: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/8.jpg)
Validation Exercises
Operations
Operationaltrial
Shadow-modetrial
Field test
Large-scalereal-time
simulation
Small-scalereal-time
simulation
Fast-timesimulation
Analyticmodelling
![Page 9: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/9.jpg)
Links to Previous Work
CARE Integra MAEVA EMERALD RTD Plan Other EUROCONTROL work
![Page 10: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/10.jpg)
Support to User
Guidelines - assistance to validation teams and managers
Case Studies (Worked examples) Scenario database Documentation Dissemination Forum
![Page 11: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/11.jpg)
Work Packages
S ce n ario D a ta R e po s ito ry
F ra m ew o rk S ce n a rioW P 1
Isd e fe , A e na & N LR
S ys te m P e rfo rm a n ce M e tricsW P 2
Q in e tiQ & A e na
H u m an P e rfo rm an ce M e tricsW P 3
N L R & N A TS
M e tric s
V a lid a tio n F ram e w o rk
A p p lica tio n G u ide lin esIsde fe
T w o De ta ile d C ase S tu d iesN A T S
E M E R A L D R T D P lanQ in e tiQ
F ra m e wo rk A pp lica tionW P 4
N A T S
O ve ra ll M a n ag e m e n t a n d C o ord ina tionW P 0
N A T S
![Page 12: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/12.jpg)
Scenario Framework
![Page 13: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/13.jpg)
• STANDARDIZE the validation scenarios for ASAS Applications
Scenario Framework based on Template
• Facilitate the TRACEABILITY of the scenarios
• SUPPORT DESIGNERS in the creation of validation scenarios for ASAS applications
• ENSURE THOROUGH AND CONSISTENT validation of ASAS applications
• Why is a scenario template needed ?
![Page 14: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/14.jpg)
• MAIN GOAL: Supporting the designer in the creation of a validation scenario
Objectives of Template
• Structure based on PO-ASAS categories and applications with EMERALD
• One template for each PO-ASAS category: Airborne Traffic Situational Awareness, Airborne Spacing, Airborne Separation, Airborne Self-Separation
• Items for scenario definition clustered in seven groups: Objectives, Airspace, Traffic, ATS Involved, Rules, Tasks, Actors (Performer & Supervisor), Technology
• USER SELECTS the ITEMS that will form the scenario but SOME of them are MANDATORY
• Based on the chosen items, designer develops the scenario
![Page 15: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/15.jpg)
• OBJECTIVES: to be grouped by types (Safety, Capacity…)
• AIRSPACE: Restrictions, Types, Areas, Elements, Geographical Scope
• TRAFFIC: Volume, Complexity, Flight Schedule, Timeframe, Aircraft Type, Equipment Type, Aircraft Performance
• ATS INVOLVED: ATC, FIS, TIS-B, APP, Alert Service, GNSS, ATFM, Performance Management, New Services
• RULES: Flight Rules, Longitudinal Separation, Lateral Separation, Phraseology, RVSM, Aircraft Sequencing, Conflict Resolution Strategy, Co-ordination and Transfer Procedures, Trained Flight Crews
• TASKS AND ACTORS - ‘Perform Separation Assurance’: Performer & Supervisor
• TECHNOLOGY:– GROUND: Communications, Surveillance, ATM– AIRBORNE: Redundancy, Communications, Surveillance, Navigation,
Display
Scenario Definition Groups
![Page 16: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/16.jpg)
Example: Technology GroupGROUND
Communications:VoiceData linkInter-sector information transferSurveillance:Radar coverageNo radar coverageTIS-BADS-BCWP HMI with aircraft equipment, ID and delegation statusController assistance toolSequencing toolSeparation monitoring toolATMPlanningAutomation
AIRBORNERedundancyCommunications:VoiceData linkSurveillance:Mode-STCAS II/ETCASAudio/visual alertsTraffic information processingSurveillance data processing Spacing function processingNavigation:GNSS with augmentationFMSAutomatic management of the separation (connection with FGCS)Display:CDTI/EFIS/MCDU HUD
![Page 17: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/17.jpg)
Enhanced Visual Adquisition, EMERALD
Longitudinal Station Keeping, EMERALD and NATS
Closely Space Parallel Approaches, EMERALD
Station Keeping Approach, EMERTA
Autonomous Aircraft, EMERALD
Baseline En-route Free Flight, NLR
TMA ASAS Autonomous Aircraft, NLR
FREER-EACAC, EEC
Multi agent optimal ASAS operations (COAST), Glasgow University
Optimal FFA/MAS Transition Methodology, Glasgow University
ASAS Crossing Procendure, CENA
Sector capacity assessment for ASAS, CENA
Applied on Historic Data
![Page 18: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/18.jpg)
Scenario Database
Gathered data from sources in CARE ASAS and the VF consortium
Uses EUROCONTROL Validation Data Repository
Agreed data structure for scenarios based on template
Obtained agreement for sharing of data
Access via EUROCONTROL
![Page 19: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/19.jpg)
System Performance Metrics
![Page 20: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/20.jpg)
System Performance Metrics
Aim was not to develop new metrics
Accessible advice to validators
High level objectives Hierarchy mapping objectives to metrics
• Many to many
Taxonomy Perspectives
![Page 21: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/21.jpg)
Objectives Objectives covered, based on ATM 2000+ Strategy
are: Safety Capacity Efficiency Environment Security & Defence
Security & Defence extended to include terrorist threat
Uniformity and Quality not considered further
![Page 22: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/22.jpg)
Hierarchy
OBJECTIVES
PERFORMANCE AREAS
( ASPECTS)
METRICS
![Page 23: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/23.jpg)
Hierarchy
PERFORMANCE AREAS broken down into ASPECTS where appropriate
Example: ACCESS (PERFORMANCE AREA)
• Airports• Sectors (ASPECTS)• Routes
Assists use with scenarios that look at specific airspace
![Page 24: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/24.jpg)
Taxonomy
METRICS INDICATORS CARE-ASAS PRC Validation C/AFT Framework TORCH
![Page 25: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/25.jpg)
Database tool For easy manipulation of data and linkages
![Page 26: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/26.jpg)
Database tool Enabling instant switch from top-down...
![Page 27: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/27.jpg)
Database tool … to bottom-up view
![Page 28: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/28.jpg)
Perspectives
Different views (perspectives) can be applied to the information stored:
Airline perspective as in C/AFT
ATM perspective as in PRC
Scenario
![Page 29: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/29.jpg)
Perspectives
Further perspectives under consideration are:
Study type (FTS, RTS, Analytic or Survey)
ASAS categories (Situational awareness…Self Separation)
Links Human Performance metrics
![Page 30: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/30.jpg)
Links to Previous and Parallel Work
![Page 31: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/31.jpg)
Potential Links
CARE Integra
MAEVA
EMERALD
Ongoing EUROCONTROL work
![Page 32: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/32.jpg)
CARE Integra
EUROCONTROL funded study
Metrics Capacity
Safety
Environment
Economics
QinetiQ involvement in Integra and VF
Use of Integra metrics
![Page 33: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/33.jpg)
MAEVA
A Master ATM European Validation Plan
Supporting EC in management of ATM projects Validation Guideline Handbook - exercise level Validation Master Plan - project validation plans Monitoring of projects
Final Consolidation of Results from Projects
NATS and Isdefe involvement in MAEVA & VF
Alignment of VF with MAEVA VGH
![Page 34: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/34.jpg)
MAEVA Five-Step Validation Methodology
Step 1: Aims
Step 5: Conclusions
Step 2: Preparation
Step 4: Analysis
Step 3: Execution
![Page 35: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/35.jpg)
Others
EMERALD RTD Plan
Plan for RTD for future technology for ATM systems
NATS and QinetiQ involvement in EMERALD & VF
Production of updated EMERALD RTD Plan
On-going EUROCONTROL work Validation Guideline VALSUP
Alignment of VF with VALSUP
![Page 36: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/36.jpg)
Support to the User
![Page 37: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/37.jpg)
Documentation
Final report incorporating work package reports Guidance Material for application of framework Case studies of two applications
In-descent spacing Fully autonomous aircraft
Detailed RTD Plan developed from EMERALD Plan
![Page 38: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/38.jpg)
Data and Tools
Scenario data repository Produced in WP1
Metrics database Produced in WP2 Not a deliverable under contract
![Page 39: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/39.jpg)
Dissemination Forum
Dissemination Forum 10th October at Bretigny
![Page 40: CARE ASAS Validation Framework. Partners CARE ASAS Board - Francis Casaux EURCONTROL - Mick van Gool, Ulrich Borkenhagen Consortium Partners Aena, Isdefe,](https://reader036.fdocuments.in/reader036/viewer/2022062511/55154e49550346c77d8b6481/html5/thumbnails/40.jpg)
Summary
Validation Framework still under development Exploiting existing work for ASAS validation
exercises Scenario template developed Scenario data collated for VDR Mapping of system performance metrics & human
performance metrics to objectives - in progress Support user - about to start