Email this article 
Open Access
Subscription or Fee Access
Dynamic Workload Management for Multi-RPAS Pilots
(*) Corresponding author
DOI: https://doi.org/10.15866/irease.v12i2.15334
Abstract
This document describes a key aspect of NtoM, a concept of operations (ConOps) currently under development, which focuses on the awareness, productivity and safety of Remotely Piloted Aircraft System (RPAS) pilots controlling several flights at once in non-segregated airspace. An explanation will be given of how the ConOps suggests capturing, representing, managing and predicting the workload of the pilots. To illustrate some of the features of the concept, it was necessary to define a representation of the workload associated to the tasks. A synthetic task environment that used the NtoM prototype was built and used to evaluate the requirements of time and attention of pseudo-pilots based on their performance while executing the tasks and task overlaps, determine the top threshold of workload allowed for a pilot and detect incompatibilities among tasks. These values served as a reference to design demanding test scenarios, which helped to reveal weaknesses and inspire improvements that were addressed in the following stage of development.
Copyright © 2019 The Authors - Published by Praise Worthy Prize under the CC BY-NC-ND license.
Keywords
References
L. A. M. Bush, Shared UAV Enterprise Operator Pooling Framework (SUAVE), IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), 2015.
https://doi.org/10.1109/cogsima.2015.7107970
H. A. Ruff, G. L. Calhoun, M. H. Draper, J. V. Fontejon and B. J. Guilfoos, Exploring Automation Issues in Supervisory Control of Multiple UAVs, Human Performance, Situation Awareness, and Automation Technology Conference, pp. 218–222 (2004).
https://pdfs.semanticscholar.org/154f/e3bb05fc2f6d8b1bd7a1a4c5256e89e97ef1.pdf
M. L. Cummings et al, Task Versus Vehicle-Based Control Paradigms in Multiple Unmanned Vehicle Supervision by a Single Operator, IEEE Transactions on Human-Machine Systems. Vol. 44, 2014.
https://doi.org/10.1109/thms.2014.2304962
Fas-Millán, M., Pastor, E., NtoM: a Concept of Operations for Pilots of Multiple Remotely Piloted Aircraft, (2019) International Review of Aerospace Engineering (IREASE), 12 (1), pp. 12-25.
https://doi.org/10.15866/irease.v12i1.16153
S. R.Dixon, Control of Multiple-UAVs: A Workload Analysis, 12th International Symposium on Aviation Psychology, 2003, http://www.dtic.mil/dtic/tr/fulltext/u2/a446844.pdf
H. A. Ruff, G. L. Calhoun, M. H. Draper, J. V. Fontejon and B. J. Guilfoos, Exploring Automation Issues in Supervisory Control of Multiple UAVs, Proceedings of the Human Performance, Situation Awareness, and Automation Technology Conference, pp. 218-222, 2004.
https://pdfs.semanticscholar.org/154f/ e3bb05fc2f6d8b1bd7a1a4c5256e89e97ef1.pdf
C. C. Murray et al, Incorporating Human Factor Considerations in Unmanned Aerial Vehicle Routing, IEEE Transactions on Systems, Man, and Cybernetics: Systems. Vol. 43, No. 4.
https://doi.org/10.1109/tsmca.2012.2216871
A. P. Tvaryanas, Human factors considerations in migration of unmanned aircraft system (UAS) operator control, Human Systems Wing (311th) Brooks AFB TX, 2006.
https://doi.org/10.21236/ada444925
D. Kuhl, Mental Workload and ARL Workload Modeling Tools, Army Research Laboratory. 2000.
http://www.dtic.mil/dtic/tr/fulltext/u2/a377300.pdf.
A. Hobbs et al, Human factors guidelines for remotely piloted aircraft systems remote pilot stations, UAS in the NAS Project, NASA, 2016.
https://human-factors.arc.nasa.gov/publications/PS_02219_Human_Factors_Guidelines_web.pdf
A. Schulte, D. Donath and F. Honecker, Human-System Interaction Analysis for Military Pilot Activity and Mental Workload Determination, IEEE International Conference on Systems, Man, and Cybernetics, 2015.
https://doi.org/10.1109/smc.2015.244
C. F. Rusnocket al, Workload profiles: A continuous measure of mental workload, International Journal of Industrial Ergonomics, Vol. 63, January 2018.
DOI: 10.1016/j.ergon.2016.09.003
D. Richards, K. Izzetoglu, UAV Operator mental workload - A neurophysiological comparison of mental workload and vigilance, AIAA Modeling and Simulation Technologies Conference, 2017.
https://doi.org/10.2514/6.2017-3670
Othman, N., Romli, F., Mental Workload Evaluation of Pilots Using Pupil Dilation, (2016) International Review of Aerospace Engineering (IREASE), 9 (3), pp. 80-84.
https://doi.org/10.15866/irease.v9i3.9541
P. L. Lee, J. Mercer, N. Smith and E. Palmer, A Non-Linear Relationship between Controller Workload, Task Load, and Traffic Density: The Straw that Broke the Camel’s Back, 13th Intl. Symposium on Aviation Psychology, 2005.
https://pdfs.semanticscholar.org/ac67/447b44b3bd2b3f1954bd17a1d98ba9545602.pdf
ARL IMPRINT,
https://www.arl.army.mil/www/default.cfm?page=3200
C. Wickens, Processing Resources in Attention, Dual Task Performance, and Workload Assessment, Technical report No. EPL-81-3/ONR-81-3, University of Illinois at Urbana-Champaign Engineering-Psychology Research Laboratory, 1981.
http://www.dtic.mil/dtic/tr/fulltext/u2/a102719.pdf
C. A. Miller, R. P. Goldman, H. B. Funk, P. Wu and B. B. Pate, A Playbook Approach to Variable Autonomy Control: Application for Control of Multiple, Heterogeneous Unmanned Air Vehicles, American Helicopter Society 60th Annual Forum, Baltimore, MD, 2004.
https://pdfs.semanticscholar.org/7650/b5a006a156d6a46497d48c6d4def5e722b43.pdf
B. K. Siegel and K. J. Keller, Pilot Task Monitoring Using Neural Networks, Aerospace and Electronics Conference, 1992.
https://doi.org/10.1109/NAECON.1992.220517
J. Stemberger, Thermal imaging as a way to classify cognitive workload, Canadian Conference Computer and Robot Vision, 2010.
https://doi.org/10.1109/crv.2010.37
S. Hart, C. D. Wickens, Cognitive Workload in NASA Human Integration Design Handbook (NASA/SP-2010-3407), 2010,
https://ston.jsc.nasa.gov/collections/TRS/_techrep/SP-2010-3407.pdf
R. Grier, C. Wickens, D. Kaber, D. Strayer, D. Boehm-Davis, J. Gregory Trafton, M. S. John, The Red-Line of Workload: Theory, Research, and Design, Human Factors and Ergonomics Society Annual Meeting Proceedings, 2008.
https://doi.org/10.1177/154193120805201811
P. U. Lee, A Non-Linear Relationship between Controller Workload and Traffic Count, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol 49, 2005.
https://doi.org/10.1177/154193120504901206
S. S. Mulgund et al., A Situation-Driven Adaptive Pilot/Vehicle Interface, Third Annual Symposium on Human Interaction with Complex Systems (HICS), Dayton (Ohio), 1996.
https://doi.org/10.1109/huics.1996.549515
Y. Brand, A. Schulte, Model-based Prediction of Workload for Adaptive Associate Systems, IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2017.
https://doi.org/10.1109/smc.2017.8122864
R. Little et al, Crew reduction in armored vehicles ergonomic study (CRAVES), Report No. ARL-CR-80, Aberdeen Proving Ground, MD, U.S. Army Research Laboratory, 1993.
NtoMConOps, http://recerca.ac.upc.edu/ntom
V. N. Nguyen, H. Holone, N-best List Re-ranking Using Syntactic Score: A Solution for Improving Speech Recognition Accuracy in Air Traffic Control, 6th International Conference on Control, Automation and Systems (ICCAS), 2016.
https://doi.org/10.1109/iccas.2016.7832482
M. Pérez-Batlle, C. Tadeo, and E. Pastor, A methodology for measuring the impact on flight inefficiency of future RPAS operations, 34th Digital Avionics Systems Conference, Prague, 2015.
https://doi.org/10.1109/dasc.2015.7311426
Early Demonstration & Evaluation Platform (EDEP) http://www.eurocontrol.fr/projects/edep/
RTI Connext DDS, https://www.rti.com/products
Fas-Millán, M., Pastor Llorens, E., Controller-Pilot Data Link Communications Display oriented to multiple Remotely Piloted Aircraft Systems pilots, (2019) International Review of Aerospace Engineering (IREASE), 12 (1), pp. 1-11.
https://doi.org/10.15866/irease.v12i1.15535
C.D. Wickens, Multiple resources and performance prediction, Theoretical Issues in Ergonomics Science, vol. 2, no. 2, pp. 159-177, 2010.
https://doi.org/10.1080/14639220210123806
A. T. Welford, Single channel operation in the brain, Acta Psychologica, 27, 5-21, 1967.
https://doi.org/10.1016/0001-6918(67)90040-6
D. Kahneman, Attention and effort, Englewood Cliffs, NJ: Prentice Hall, 1973.
https://www.princeton.edu/~kahneman/docs/ attention_and_effort/Attention_hi_quality.pdf
R. J. Shively, A. Hobbs and B. Lyall, Human performance considerations for Remotely Piloted Aircraft Systems, Remotely Piloted Aircraft Systems Panel Second Meeting, 2015.
https://doi.org/10.1002/9781118965900.ch1
K. L. Vu, G. Morales, D. Chiappe, T. Z. Strybel, V. Battiste, J. Shively and T. J. Buker, Influence of UAS Pilot Communication and Execution Delay on Controller’s Acceptability Ratings of UAS-ATC Interactions, IEEE/AIAA 32nd Digital Avionics Systems Conference (DASC), 2013.
https://doi.org/10.1109/dasc.2013.6712624
K. M. Cardosi, Time Required for Transmission of Time-Critical Air Traffic Control Messages in an En Route Environment, The International Journal of Aviation Psychology, 3(4), 303–314, 1993.
https://doi.org/10.1207/s15327108ijap0304_4
Global Operational Data Link Document (GOLD) 2nd Ed., International Civil Aviation Organization, 2013.
https://icao.int/APAC/Documents/edocs/GOLD_2Edition.pdf
A. Schulte et al, Measuring self-adaptive UAV operators’ load-shedding strategies under high workload, International Conference on Engineering Psychology and Cognitive Ergonomics, 2011.
https://doi.org/10.1007/978-3-642-21741-8_37
J. C. Sperandio, Variation of Operator's Strategies and Regulating Effects on Workload, Ergonomics, 14:5, 571-577, 2007.
https://doi.org/10.1080/00140137108931277
S. G. Hart, Crew workload management strategies: a critical factor in system performance, Fifth International Symposium on Aviation Psychology, Columbus, OH,1989.
Refbacks
- There are currently no refbacks.
Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize
