Research and Implications on Multi-modal Pilot-computer Interaction

This paper provides a comprehensive review of multi-modal pilot-computer interaction and proposes future development directions. This paper begins with an introduction to the application background of multi-modal human-computer interaction technology for pilots. Then, the current research status of pilot-computer interaction is systematically reviewed from the perspectives of speech interaction, gesture interaction, display manipulation interaction, eye-tracking interaction, and brain-computer interaction. In addition, the main application directions and pros and cons of multi-modal human-computer interaction technology for pilots are summarized. It is concluded that multi-modal human-computer interaction technology has the potential to reduce cognitive load and improve interaction efficiency, with promising application prospects. Lastly, the challenges in the practical application of multimodal interaction technology are addressed, and the potential application prospects of new technologies in multimodal interaction are discussed. Valuable insights and inspirations are provided for the development of multimodal human-computer interaction technology for pilots.