Abstract:The exciting new technology known as mid-air haptics has been adopted by several industries including Automotive and Entertainment, however it has yet to emerge in simulated pilot training or in real-life flight decks. Full-flight simulators are expensive to manufacture, maintain and operate. Not only that, each simulator is limited to one aircraft type, which is inefficient for the majority of airlines that have several in service. With the growing trend in touchscreen instrumentation, cockpit displays require the pilot's attention to be drawn away from their view out of the window. But by using gesture recognition interfaces combined with mid-air haptic feedback, we can mitigate this shortcoming while also adding another dimension to the existing technology for pilots already familiar with using legacy cockpits, complete with traditional instrumentation. Meanwhile, simulation environments using augmented and virtual reality technology offers quality immersive training to the extent that pilots can go from hundreds of hours of simulated training to being responsible for hundreds of lives on their very first flight. The software re-programmability and dynamic richness afforded by mid-air haptic technologies combined with a basic full-motion platform could allow for an interchange of instrumentation layouts thus enhancing simulation immersiveness and environments. Finally, by borrowing and exploring concepts within the automotive sector, this concept paper presents how flight deck design could evolve by adopting this technology. If pilot testimony suggests that they can adapt to virtual objects, can this replace physical controls?

Feeling the Grass Grow: Making Midair Haptic Parameters Visible, Touchable and Controllable

An Interactive Tool for Simulating Mid-Air Ultrasound Tactons on the Skin

It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour

AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound Tactons

Sonovortex: Aerial Haptic Layer Rendering by Aerodynamic Vortex and Focused Ultrasound

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

TangibleData: Interactive Data Visualization with Mid-Air Haptics

Touch-enabled haptic modeling of deformable multi-resolution surfaces

Bimanual Ultrasound Mid-Air Haptics for Virtual Reality Manipulation

Mid-Air Haptics in Aviation -- creating the sensation of touch where there is nothing but thin air

A human-in-the-loop haptic interaction with subjective evaluation

Audio-based Roughness Sensing and Tactile Feedback for Haptic Perception in Telepresence

A Skin-Integrated Multimodal Haptic Interface for Immersive Tactile Feedback

Surface haptic rendering of virtual shapes through change in surface temperature

Mapping Mid-air Haptics with a Low-cost Tactile Robot

Improving the Perception of Mid-Air Tactile Shapes With Spatio-Temporally-Modulated Tactile Pointers

Interactive Soft-Touch Dynamic Deformations

Grasp Identification and Multi-Finger Haptic Feedback for Virtual Assembly

Can we Effectively Combine Tangibles and Ultrasound Mid-Air Haptics? A Study of Acoustically Transparent Tangible Surfaces

Passive Touch Experience with Virtual Doctor Fish Using Ultrasound Haptics

Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable Robot