Abstract:Background and objectives: In order to improve assistive technologies for people with reduced mobility, this paper develops a new intelligent real-time emotion detection system to control equipment, such as electric wheelchairs (EWC) or robotic assistance vehicles. Every year, degenerative diseases and traumas prohibit thousands of people to easily control the joystick of their wheelchairs with their hands. Most current technologies are considered invasive and uncomfortable such as those requiring the user to wear some body sensor to control the wheelchair. Methods: In this work, the proposed Human Machine Interface (HMI) provides an efficient hands-free option that does not require sensors or objects attached to the user's body. It allows the user to drive the wheelchair using its facial expressions which can be flexibly updated. This intelligent solution is based on a combination of neural networks (NN) and specific image preprocessing steps. First, the Viola-Jones combination is used to detect the face of the disability from a video. Subsequently, a neural network is used to classify the emotions displayed on the face. This solution called "The Mathematics Behind Emotion" is capable of classifying many facial expressions in real time, such as smiles and raised eyebrows, which are translated into signals for wheelchair control. On the hardware side, this solution only requires a smartphone and a Raspberry Pi card that can be easily mounted on the wheelchair. Results: Many experiments have been conducted to evaluate the efficiency of the control acquisition process and the user experience in driving a wheelchair through facial expressions. The classification accuracy can expect 98.6% and it can offer an average recall rate of 97.1%. Thus, all these experiments have proven that the proposed system is able of accurately recognizing user commands in real time. Indeed, the obtained results indicate that the suggested system is more comfortable and better adapted to severely disabled people in their daily lives, than conventional methods. Among the advantages of this system, we cite its real time ability to identify facial emotions from different angles. Conclusions: The proposed system takes into account the patient's pathology. It is intuitive, modern, doesn't require physical effort and can be integrated into a smartphone or tablet. The results obtained highlight the efficiency and reliability of this system, which ensures safe navigation for the disabled patient.

Design of a surface EMG based human-machine interface for an intelligent wheelchair

Human brain control of electric wheelchair with eye-blink electrooculogram signal

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

The Human–Machine Interface Design Based on sEMG and Motor Imagery EEG for Lower Limb Exoskeleton Assistance System

EEG and EMG-based human-machine interface for navigation of mobility-related assistive wheelchair (MRA-W)

A facial expression controlled wheelchair for people with disabilities

Intelligent Human-Computer Interaction Based on Surface EMG Gesture Recognition

Electric powered wheelchair control using user-independent classification methods based on surface electromyography signals

Classification of Human Hand Movements Using Surface EMG for Myoelectric Control.

An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System

Combined control of rehabilitation wheelchair using periocular electromyography and electroencephalography

Hardware and Software Design and Implementation of Surface-EMG-Based Gesture Recognition and Control System

Design and Evaluation of a Surface Electromyography-Controlled Steering Assistance Interface

A noise-suppressing neural network approach for upper limb human-machine interactive control based on sEMG signals

An EOG-based wheelchair robotic arm system for assisting patients with severe spinal cord injuries

Brain Interface Based Wheel Chair Control System for Handicap -- An advance and viable approach

Eye-Gaze Controlled Wheelchair Based on Deep Learning

Data-driven approach to designing a BCI-integrated smart wheelchair through cost–benefit analysis

Surface Electromyography-Based Action Recognition and Manipulator Control

Empowering Mobility: Brain-Computer Interface for Enhancing Wheelchair Control for Individuals with Physical Disabilities

High‐Performance Hydrogel Sensors Enabled Multimodal And Accurate Human–Machine Interaction System for Active Rehabilitation