Table of Contents
Fetching ...

Human-Computer Interaction and Human-AI Collaboration in Advanced Air Mobility: A Comprehensive Review

Fatma Yamac Sagirli, Xiaopeng Zhao, Zhenbo Wang

TL;DR

This comprehensive review investigates the human-centric dimensions of Advanced Air Mobility (AAM), focusing on human–computer interaction (HCI), interface design, and human–AI collaboration. It employs a systematic literature strategy to map how HCI and AI-driven decision-making integrate with AAM concepts such as UAM, RAM, AAM corridors, and UTM, across autonomy levels. The paper highlights three core contributions: prioritizing HCI and interface design, exploring human–AI collaboration, and examining trust and user experience in AAM contexts. It emphasizes immersive technologies (AR/MR/VR) and digital twins as key enablers for training, planning, and safe operations, while outlining challenges in immersive integration, explainable AI, and urban airspace design, and proposing future directions for standardization, safety, and public acceptance.

Abstract

The increasing rates of global urbanization and vehicle usage are leading to a shift of mobility to the third dimension-through Advanced Air Mobility (AAM)-offering a promising solution for faster, safer, cleaner, and more efficient transportation. As air transportation continues to evolve with more automated and autonomous systems, advancements in AAM require a deep understanding of human-computer interaction and human-AI collaboration to ensure safe and effective operations in complex urban and regional environments. There has been a significant increase in publications regarding these emerging applications; thus, there is a need to review developments in this area. This paper comprehensively reviews the current state of research on human-computer interaction and human-AI collaboration in AAM. Specifically, we focus on AAM applications related to the design of human-machine interfaces for various uses, including pilot training, air traffic management, and the integration of AI-assisted decision-making systems with immersive technologies such as extended, virtual, mixed, and augmented reality devices. Additionally, we provide a comprehensive analysis of the challenges AAM encounters in integrating human-computer frameworks, including unique challenges associated with these interactions, such as trust in AI systems and safety concerns. Finally, we highlight emerging opportunities and propose future research directions to bridge the gap between human factors and technological advancements in AAM.

Human-Computer Interaction and Human-AI Collaboration in Advanced Air Mobility: A Comprehensive Review

TL;DR

This comprehensive review investigates the human-centric dimensions of Advanced Air Mobility (AAM), focusing on human–computer interaction (HCI), interface design, and human–AI collaboration. It employs a systematic literature strategy to map how HCI and AI-driven decision-making integrate with AAM concepts such as UAM, RAM, AAM corridors, and UTM, across autonomy levels. The paper highlights three core contributions: prioritizing HCI and interface design, exploring human–AI collaboration, and examining trust and user experience in AAM contexts. It emphasizes immersive technologies (AR/MR/VR) and digital twins as key enablers for training, planning, and safe operations, while outlining challenges in immersive integration, explainable AI, and urban airspace design, and proposing future directions for standardization, safety, and public acceptance.

Abstract

The increasing rates of global urbanization and vehicle usage are leading to a shift of mobility to the third dimension-through Advanced Air Mobility (AAM)-offering a promising solution for faster, safer, cleaner, and more efficient transportation. As air transportation continues to evolve with more automated and autonomous systems, advancements in AAM require a deep understanding of human-computer interaction and human-AI collaboration to ensure safe and effective operations in complex urban and regional environments. There has been a significant increase in publications regarding these emerging applications; thus, there is a need to review developments in this area. This paper comprehensively reviews the current state of research on human-computer interaction and human-AI collaboration in AAM. Specifically, we focus on AAM applications related to the design of human-machine interfaces for various uses, including pilot training, air traffic management, and the integration of AI-assisted decision-making systems with immersive technologies such as extended, virtual, mixed, and augmented reality devices. Additionally, we provide a comprehensive analysis of the challenges AAM encounters in integrating human-computer frameworks, including unique challenges associated with these interactions, such as trust in AI systems and safety concerns. Finally, we highlight emerging opportunities and propose future research directions to bridge the gap between human factors and technological advancements in AAM.

Paper Structure

This paper contains 19 sections, 5 figures, 1 table.

Figures (5)

  • Figure 1: Concept of AAM, UAM and RAM (Redrawn based onfaa2020urban)
  • Figure 2: eVTOL autonomy and HCI Integration Levels for AAM (Redrawn based on wei2024autonomous)
  • Figure 3: Concept of the MR-based tangible airport digital tower system by chen2024tangible
  • Figure 4: Overview of an eVTOL MR simulator setup by kimura2024simulator
  • Figure 5: Cognitive assistant architecture by evtol_atc2023