Abstract:Wearable human-machine interfaces (HMI) have made remarkable advancements in communication, education, and healthcare, primarily driven by the rapid growth of the Internet of Things (IoT) and 5 G technology. Among the various applications of wearable HMIs, there is a critical need for technologies that aid communication for blind individuals, enabling them to access information independently. However, progress in investigating blind communication has been impeded by challenges related to signal capture limitations and power supply issues. To address these challenges, this paper proposes a groundbreaking smart finger braille typing system based on the emerging triboelectric nanogenerator (TENG). The objective of this system is to assist the blind in typing without external aid. To build an effective tactile sensing system, two essential components are required: a high-sensitivity tactile sensor and a weak current signal processing circuit. In this study, we employed electrostatic spinning to produce degradable friction nanofiber films, which significantly enhanced the sensitivity of the sensor and improved the overall device conversion efficiency. One notable advantage of utilizing TENG as a sensor is that it eliminates the need for an external power supply, ensuring self-sufficiency in the system's operation. Furthermore, we developed a specialized weak current signal processing circuit based on the unique properties of TENG, such as its high impedance and weak current characteristics. The braille code's six dots will be represented by six self-power tactile (SPT) sensors strategically placed on both hands. By employing various tapping combinations, users can create words, which are then transmitted to mobile devices using Bluetooth technology. By introducing this innovative Braille typing system, we aim to contribute to the global mission of improving information accessibility for blind and partially sighted individuals. This system has the potential to significantly enhance their braille literacy abilities, bridging the gap between them and the online world.

Human computer interface and optimized electro-mechanical design for Chinese Braille display

Development of an Eog (Electro-Oculography) Based Human-Computer Interface

Braille-to-Chinese Translation System Based on Optical Braille Recognition

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Integration of eye tracking and lip motion for hands-free computer access

Development and Evaluation of Refreshable Braille Display and Active Touch-Reading System for Digital Reading of the Visually Impaired

A Virtual Chinese Keyboard BCI System Based on P300 Potentials

A Human Computer Interface Using Ssvep-Based Bci Technology

ASAB: a Chinese screen reader

Digital library access for Chinese visually impaired.

A Novel Hybrid BCI Web Browser Based on SSVEP and Eye-Tracking.

Enhancing Blind-Dumb Assistance through a Self-Powered Tactile Sensor-Based Braille Typing System

A Software Approach Of Human-Machine Interface Ergonomics Evaluation

Innovative Design of Intelligent Health Equipment for Helping the Blind in Smart City

Human-computer Interaction Design Based on Electronic Paper Display Controller S1D13521

Human-machine Interface for a Master-Slave Hydraulic Manipulator with Vision Enhancement and Auditory Feedback

An Electro-oculography Based Human-computer Interaction System

Graphical Tactile Display Application: Design of Digital Braille Textbook and Initial Findings

Right mix of speech and non-speech: hybrid auditory feedback in mobility assistance of the visually impaired

Eye Tracking Based Control System for Natural Human-Computer Interaction

Development of A Human Computer Interaction System Based on Multi-Modal Gaze Tracking Methods