Abstract:Wearable human-machine interfaces (HMI) have made remarkable advancements in communication, education, and healthcare, primarily driven by the rapid growth of the Internet of Things (IoT) and 5 G technology. Among the various applications of wearable HMIs, there is a critical need for technologies that aid communication for blind individuals, enabling them to access information independently. However, progress in investigating blind communication has been impeded by challenges related to signal capture limitations and power supply issues. To address these challenges, this paper proposes a groundbreaking smart finger braille typing system based on the emerging triboelectric nanogenerator (TENG). The objective of this system is to assist the blind in typing without external aid. To build an effective tactile sensing system, two essential components are required: a high-sensitivity tactile sensor and a weak current signal processing circuit. In this study, we employed electrostatic spinning to produce degradable friction nanofiber films, which significantly enhanced the sensitivity of the sensor and improved the overall device conversion efficiency. One notable advantage of utilizing TENG as a sensor is that it eliminates the need for an external power supply, ensuring self-sufficiency in the system's operation. Furthermore, we developed a specialized weak current signal processing circuit based on the unique properties of TENG, such as its high impedance and weak current characteristics. The braille code's six dots will be represented by six self-power tactile (SPT) sensors strategically placed on both hands. By employing various tapping combinations, users can create words, which are then transmitted to mobile devices using Bluetooth technology. By introducing this innovative Braille typing system, we aim to contribute to the global mission of improving information accessibility for blind and partially sighted individuals. This system has the potential to significantly enhance their braille literacy abilities, bridging the gap between them and the online world.

The Statistical Model for Ticker, an Adaptive Single-Switch Text-Entry Method for Visually Impaired Users

Text entry via character stroke disambiguation for an adolescent with severe motor impairment and cortical visual impairment

Modelling Noise-Resilient Single-Switch Scanning Systems

An Efficient Text Entry Model for Scanning Ambiguous Keyboard

The Accessible Interactive Mode of Traditional Printing Based on Two-Dimensional Code

Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models

A Performance Evaluation of Nomon: A Flexible Interface for Noisy Single-Switch Users

"They Aren't Built For Me": A Replication Study of Visual Graphical Perception with Tactile Representations of Data for Visually Impaired Users

SwingBoard: introducing swipe based virtual keyboard for visually impaired and blind users

Design and evaluation of a time adaptive multimodal virtual keyboard

TOAST: Ten-Finger Eyes-Free Typing on Touchable Surfaces.

Accessible Point-and-Tap Interaction for Acquiring Detailed Information about Tactile Graphics and 3D Models

Simultaneous Multimodal PC Access for People With Disabilities by Integrating Head Tracking, Speech Recognition, and Tongue Motion

Enhancing Blind-Dumb Assistance through a Self-Powered Tactile Sensor-Based Braille Typing System

A multimodal virtual keyboard using eye-tracking and hand gesture detection

Exploring the Impact of Word Prediction Assistive Features on Smartphone Keyboards for Blind Users

SSVEP BCI and Eye Tracking Use by Individuals With Late-Stage ALS and Visual Impairments

Information accessibility oriented self-powered and ripple-inspired fingertip interactors with auditory feedback

Gesture Recognition Algorithm for Visually Blind Touch Interaction Optimization Using Crow Search Method

Efficient human-machine control with asymmetric marginal reliability input devices

Virtual keyboard with the prediction of words for children with cerebral palsy