Aerial Push-Button with Two-Stage Tactile Feedback using Reflected Airborne Ultrasound Focus

Hiroya Sugawara,Masaya Takasaki,Keisuke Hasegawa

2024-07-01

Abstract:We developed a new aerial push-button with tactile feedback using focused airborne ultrasound. This study has two significant novelties compared to past related studies: 1) ultrasound emitters are equipped behind the user's finger and reflected ultrasound emission that is focused just above the solid plane placed under the finger presents tactile feedback to a finger pad, and 2) tactile feedback is presented at two stages during pressing motion; at the time of pushing the button and withdrawing the finger from it. The former has a significant advantage in apparatus implementation in that the input surface of the device can be composed of a generic thin plane including touch panels, potentially capable of presenting input touch feedback only when the user touches objects on the screen. We experimentally found that the two-stage tactile presentation is much more effective in strengthening perceived tactile stimulation and feeling of input completion when compared with a conventional single-stage method. This study proposes a composition of an aerial push-button in much more practical use than ever. The proposed system composition is expected to be one of the simplest frameworks in the airborne ultrasound tactile interface.

Human-Computer Interaction,Emerging Technologies

What problem does this paper attempt to address?

This paper attempts to solve the following two main problems:

1. **Achieving an input surface without the need for specific devices**:
- In traditional methods, ultrasonic transducers occupy most of the working space, limiting the placement of other devices, and require a large depth space to form a focal point. This makes ultrasonic haptic rendering difficult to be applied in real - life scenarios.
- The paper proposes a new method. By setting the virtual input surface above the ultrasonic reflection plane and using an ultrasonic transducer array located behind the user's finger to emit focused ultrasonic waves from below, this problem is solved. This method does not require any electronic devices to be placed under the user's hand, and the reflector can also be used for other purposes when the air - borne button is not activated.

2. **Providing a more realistic sense of input completion**:
- Although current air - borne haptic interfaces allow users to distinguish whether the input process is completed through haptic sense, there is still room for improvement in simulating the behavior of physical buttons or levers. In particular, existing research has failed to fully imitate the suddenly changing reaction force of actual mechanical buttons during the pressing process.
- The paper proposes a two - stage haptic feedback mechanism, which provides instantaneous haptic stimulation when the user's finger presses and leaves the virtual button respectively, in order to imitate the clicking feeling of an actual button. This method aims to enhance the user's sense of input completion and the realism of the haptic experience.

### Specific innovation points

- **Innovation in device structure**: By placing the ultrasonic transducer array behind the user's finger and using the reflector to form a virtual focus, haptic feedback can be provided without touching any physical device.
- **Two - stage haptic feedback**: Haptic stimulation is provided when the user's finger presses and leaves the virtual button respectively, enhancing the user's sense of input completion.
- **Natural visual - haptic feedback**: The reflector can be replaced with a visual display (such as an LCD), thus realizing a visible push button, and providing three - dimensional haptic feedback only when the user's finger interacts with the screen.

### Experimental verification

To verify the effectiveness of this method, researchers conducted psychophysical experiments to evaluate the intensity of haptic stimulation and the sense of input completion under different conditions. The experimental results show that the two - stage haptic feedback significantly enhances the user's haptic perception and sense of input completion, especially when the haptic feedback provided when the user's finger leaves the virtual button is more intense.

### Summary

This paper proposes a new type of air - borne button design. By reflecting ultrasonic waves and two - stage haptic feedback, it solves the deficiencies of existing air - borne haptic interfaces in device structure and user experience, and provides a more practical and realistic solution for future air - borne haptic interfaces.