NtoM: a Concept of Operations for Pilots of Multiple Remotely Piloted Aircraft

Miguel Ángel Fas-Millán; Enric Pastor

doi:10.15866/irease.v12i1.16153

NtoM: a Concept of Operations for Pilots of Multiple Remotely Piloted Aircraft

Miguel Ángel Fas-Millán^(1*), Enric Pastor⁽²⁾

^(*) Corresponding author

Authors' affiliations

DOI: https://doi.org/10.15866/irease.v12i1.16153

Abstract

The concept of operations proposed here pursues the feasibility, from a human factors perspective, of having a single pilot/aircrew controlling several remotely piloted aircraft systems at once in non-segregated airspace. To meet such feasibility, this multitasking must be safe and not interfere with the job of the air traffic controllers due to delays or errors associated with parallel piloting. To that end, a set of measures at several levels is suggested, which includes workload prediction and balance, pilot activity monitoring, and a special emphasis on interface usability and the pilot’s situational awareness. The concept relies greatly on the exploitation of the potential of Controller-Pilot Data Link Communications, anticipating future widespread implementation and full use. Experiments comparing the performance of the same pseudo-pilots before and after the implementation of part of the measures showed a decrease in the number of errors, oversights and subjective stress.
Copyright © 2019 The Authors - Published by Praise Worthy Prize under the CC BY-NC-ND license.

Keywords

RPAS; UAS; CPDLC; Multi-RPAS; Multi-UAS

Full Text:

PDF

References

European RPAS Steering Group, European RPAS Roadmap, 2013,

http://ec.europa.eu/DocsRoom/documents/10484/attachments/1/translations/en/renditions/native.

Single European Sky. https://www.sesarju.eu/approach/objectives

M. L. Cummings et al, Task Versus Vehicle-Based Control Paradigms in Multiple Unmanned Vehicle Supervision by a Single Operator, IEEE Transactions on Human-Machine Systems, 2014.
https://doi.org/10.1109/thms.2014.2304962

A. Schulte, D. Donath, F. Honecker, Human-System Interaction Analysis for Military Pilot Activity and Mental Workload Determination, IEEE International Conference on Systems, Man, and Cybernetics, 2015.
https://doi.org/10.1109/smc.2015.244

C. C. Murray et al, Incorporating Human Factor Considerations in Unmanned Aerial Vehicle Routing, IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 43, No. 4, 2013.
https://doi.org/10.1109/tsmca.2012.2216871

A. E. Ortiz, C. Langbort, On Multi-UAV Scheduling for Human Operator Target Identification, American Control Conference, 2011.
https://doi.org/10.1109/acc.2011.5991585

K. D. Bilimoria, W. W. Johnson, P. C. Schutte, Conceptual Framework for Single Pilot Operations, International Conference on Human-Computer Interaction in Aerospace (HCI-Aero 2014)
https://doi.org/10.1145/2669592.2669647

Manual of Air Traffic Services Data Link Applications, First Edition, Doc 9694-AN/955, International Civil Aviation Organization (ICAO), 1999.

A. D. Churchman, W. F. Havens, C. A. Pell, S. C. Pilet, Controls Automation and Task Allocation Program, Proceedings of National Aerospace and Electronics Conference (NAECON '94).
https://doi.org/10.1109/naecon.1994.332852

T. Chen, Management of multiple heterogeneous unmanned aerial vehicules through transparency capability, doctoral thesis, Human-Computer Interaction [cs.HC]. Télécom Bretagne; Université de Bretagne Occidentale, 2017. https://hal.archives-ouvertes.fr/tel-01577924.

DARIUS (Deployable SAR Integrated Chain with Unmanned Systems) Project,
https://cordis.europa.eu/project/rcn/102362/factsheet/en http://www.spacetecpartners.eu/sites/default/files/attachments/08-day1-darius_project_overview.pdf

G. Calhoun, H. Ruff, C. Breeden, J. Hamell, M. Draper, and C. Miller, Multiple Remotely Piloted Aircraft Control: Visualization and Control of Future Path, Virtual, Augmented and Mixed Reality. Systems and Applications, Proceedings, Part II, 2013.
https://doi.org/10.1007/978-3-642-39420-1_25

doi: 10.1007/978-3-642-39420-1_25

A. Hobbs, B. Lyall, Human factors guidelines for remotely piloted aircraft system (RPAS) remote pilot stations (RPS), technical report for NASA UAS in the NAS Project, 2016.
doi: 10.13140/RG.2.2.12562.45768

M. L. Cummings, The Need for Command and Control Instant Message Adaptive Interfaces: Lessons Learned from Tactical Tomahawk Human-in-the-Loop Simulations, CyberPsychology and Behavior vol. 7, 2004.
https://doi.org/10.1089/cpb.2004.7.653

Control Six MQ-9 Reapers From Your Laptop With GA-ASI’s Heresy Software, Avionics International, October 2018, https://www.aviationtoday.com/2018/10/19/gaasimmc/.

Early Demonstration & Evaluation Platform (EDEP) http://www.eurocontrol.fr/projects/edep/

M. Pérez-Batlle, R. Cuadrado, C. Barrado, P. Royo, E. Pastor, Real-time Simulations to Evaluate RPAS Contingencies in Shared Airspace, Fifth SESAR Innovation Days, 2015.

RTI Connext DDS https://www.rti.com/products

J. S. McCarley, C. D. Wickens, Human Factors Implications of UAVs in the National Airspace, Technical Report AHFD-05–05/FAA-05–01, Atlantic City, NJ: Federal Aviation Administration, 2005.

M.-A. Fas-Millán et al., Controller-Pilot Data Link Communications Display oriented to multiple Remotely Piloted Aircraft Systems pilots, (2019) International Review of Aerospace Engineering (IREASE), Accepted for publication.

NtoM website: http://recerca.ac.upc.edu/ntom

A. P. Tvaryanas, Human Factors Considerations in Migration of Unmanned Aircraft Systems (UAS) Operator Control, Report No. HSW-PE-BR-TE-2006–0002, Brooks City, United States Air Force, Performance Enhancement Research Division, 2006.
http://recerca.ac.upc.edu/ntom/videos/NtoM_handover.mp4

S. S. Mulgund, G. L. Zacharias, A Situation-Driven Adaptive pilot/Vehicle Interface, Proceedings of the Third Annual Symposium on Human Interaction with Complex Systems - HICS '96, IEEE Computer Society Press.
https://doi.org/10.1109/huics.1996.549515

M. R. Endsley, C. Bolstad, Human Capabilities and Limitations in Situation Awareness, AGARD CP-520, Combat Automation for Airborne Weapons Systems: Man/Machine Interface Trends & Technologies, Neuilly Sur Seine, France.

Electronic Code of Federal Regulations, https://www.ecfr.gov

R. J. Shively, A. Hobbs, B. Lyall, C. Rorie, Human performance considerations for Remotely Piloted Aircraft Systems (RPAS), Remotely Piloted Aircraft Systems Panel Second Meeting (RPASP/2), Montreal, 2015.

M.-A. Fas-Millán et al., Dynamic Workload Management for Multi-RPAS Pilots, (2019) International Review of Aerospace Engineering (IREASE), Accepted for publication.

P. G. Raeth, J. M. Reising, A Model of Pilot Trust & Dynamic Workload Allocation, Proceedings of the IEEE 1997 National Aerospace and Electronics Conference. NAECON.
https://doi.org/10.1109/naecon.1997.617760

B. L. Hooey et al, The Underpinnings of Workload in Unmanned Vehicle Systems, IEEE Transactions on Human-Machine Systems Vol. 48, Issue: 5, Oct. 2018.
DOI: 10.1109/THMS.2017.2759758

C. F. Rusnock et al, Workload profiles: A continuous measure of mental workload, International Journal of Industrial Ergonomics, Vol. 63, January 2018.
https://doi.org/10.1016/j.ergon.2016.09.003

C. Bierbaum, S. Szabo, T. Aldrich, Task analysis of the UH-60 mission and decision rules for developing a UH-60 workload prediction model, Vol. I: Summary report, U.S. Army Res. Inst. Behav. Social Sci. Belvoir, VA, Tech. Rep. AD-A210763, 1989.
https://doi.org/10.21236/ada201317

F. M. Almirao, F. B. da Silva, S. D. Scott, M. L. Cummings, Designing Decision and Collaboration Support technology for Operators in Multi-UAV Operations Teams. MIT report, Humans and Automation Laboratory, HAL, 2007.

E. Pastor et al, In-Flight Contingency Management for Unmanned Aerial Vehicles, Journal of Aerospace Computing, Information, and Communication, Vol. 9, No. 4, 2012.
https://doi.org/10.2514/1.55109

L. A. M. Bush, Shared UAV Enterprise Operator Pooling Framework (SUAVE), 2015 IEEE International Inter-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).
https://doi.org/10.1109/cogsima.2015.7107970

http://recerca.ac.upc.edu/ntom/videos/NtoM_workload_demo_DirectTo.avi

H. Wang, D. Gong, R. Wen, Air traffic controllers workload forecasting method based on neural network, 27th Chinese Control and Decision Conference, 2015.
https://doi.org/10.1109/ccdc.2015.7162334

D. Richards, K. Izzetoglu, UAV Operator mental workload - A neurophysiological comparison of mental workload and vigilance, AIAA Modeling and Simulation Technologies Conference, 2017.
https://doi.org/10.2514/6.2017-3670

K. Cardosi, T. Lennertz, Flight Deck Human Factors Issues for National Airspace System (NAS) En Route Controller Pilot Data Link Communications (CPDLC), report for the Federal Aviation Administration Human Factors Division (ANG-C1), 2017.

IFALPA, Navigational errors on the North Atlantic, IFALPA Safety Bulletin 30 Sept 2011,
https://www.ifalpa.org/media/2214/12sab013-navigation-errors-on-the-north-atlantic.pdf.

T. Lennertz and K. Cardosi, Flightcrew Procedures for Controller Pilot Data Link Communications (CPDLC), report prepared for the Federal Aviation Administration, DOT/FAA/TC-15-12, 2015.
http://recerca.ac.upc.edu/ntom/videos/NtoM_monitoring_examples.mp4

V. N. Nguyen, H. Holone, N-best List Re-ranking Using Syntactic Score: A Solution for Improving Speech Recognition Accuracy in Air Traffic Control, 16th International Conference on Control, Automation and Systems (ICCAS), 2016.
https://doi.org/10.1109/iccas.2016.7832482

Lacko et al., Aircraft Systems and Methods for Detecting Non-Compliant Pilot Action, U.S. Patent No.: US 9,446, 852 B2, issued Sep. 20, 2016.

http://recerca.ac.upc.edu/ntom/videos/NtoM_workload_demo_speed_change.mp4

Othman, N., Romli, F., Mental Workload Evaluation of Pilots Using Pupil Dilation, (2016) International Review of Aerospace Engineering (IREASE), 9 (3), pp. 80-84.
https://doi.org/10.15866/irease.v9i3.9541

http://recerca.ac.upc.edu/ntom/videos/NtoM_reminders.mp4

D. D. Salvucci, P. Bogunovich, Multitasking and Monotasking: The Effects of Mental Workload on Deferred Task Interruptions, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2010.

C. D. Wickens et al, Compatibility and Resource Competition between Modalities of Input, Central Processing and Output, Human Factors, Vol. 25, No. 2, 1983.
doi: 10.1177/001872088302500209

S. Dixon and C. Wickens, Control of multiple-UAVs: A workload analysis, Proc. 12th Int. Symp. Aviation Psychol., 2003.

C. Wickens, S. Dixon, D. Chang, Using interference models to predict performance in multiple-task UAV environment–2 UAVs, technical report for Micro Analysis and Design, 2003.

M. Draper, G. Calhoun, H. Ruff, D. Williamson, T. Barry, Manual versus speech input for unmanned aerial vehicle control station operations. Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting, 109-113, 2003.
https://doi.org/10.1177/154193120304700123

W. Chappelle, A. Salinas, K. McDonald, Psychological Health Screening of Remotely Piloted Aircraft Operators and Supporting Units, Defense Technical Information Center, 2011, http://www.dtic.mil/dtic/tr/fulltext/u2/a582856.pdf.

Refbacks

There are currently no refbacks.

Username
Password
Remember me