Abstract:Throughout the last decade, many assistive robots for people with disabilities have been developed; however, researchers have not fully utilized these robotic technologies to entirely create independent living conditions for people with disabilities, particularly in relation to activities of daily living (ADLs). An assistive system can help satisfy the demands of regular ADLs for people with disabilities. With an increasing shortage of caregivers and a growing number of individuals with impairments and the elderly, assistive robots can help meet future healthcare demands. One of the critical aspects of designing these assistive devices is to improve functional independence while providing an excellent human-machine interface. People with limited upper limb function due to stroke, spinal cord injury, cerebral palsy, amyotrophic lateral sclerosis, and other conditions find the controls of assistive devices such as power wheelchairs difficult to use. Thus, the objective of this research was to design a multimodal control method for robotic self-assistance that could assist individuals with disabilities in performing self-care tasks on a daily basis. In this research, a control framework for two interchangeable operating modes with a finger joystick and a chin joystick is developed where joysticks seamlessly control a wheelchair and a wheelchair-mounted robotic arm. Custom circuitry was developed to complete the control architecture. A user study was conducted to test the robotic system. Ten healthy individuals agreed to perform three tasks using both (chin and finger) joysticks for a total of six tasks with 10 repetitions each. The control method has been tested rigorously, maneuvering the robot at different velocities and under varying payload (1-3.5 lb) conditions. The absolute position accuracy was experimentally found to be approximately 5 mm. The round-trip delay we observed between the commands while controlling the xArm was 4 ms. Tests performed showed that the proposed control system allowed individuals to perform some ADLs such as picking up and placing items with a completion time of less than 1 min for each task and 100% success.

An Egocentric Computer Vision Based Co-Robot Wheelchair

Usability Studies of an Egocentric Vision-Based Robotic Wheelchair

Egocentric Computer Vision for Hands-Free Robotic Wheelchair Navigation

Attention-driven egocentric computer vision for robotic wheelchair navigation

An egocentric vision based assistive co-robot.

An IoT-Enabled Telerobotic-Assisted Healthcare System Based on Inertial Motion Capture.

Vision-Based Robotic Manipulation of Intelligent Wheelchair with Human-Computer Shared Control

Video Demo: An Egocentric Vision Based Assistive Co-robot

Smart Wheelchair Controlled Through a Vision-Based Autonomous System

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Web-based Customization and Motion Simulation of the Omni-directional Wheelchair.

An Intelligent and Low-cost Eye-tracking System for Motorized Wheelchair Control

Research on Intelligent Wheelchair Multimode Human–Computer Interaction and Assisted Driving Technology

Electric Wheelchair Hybrid Operating System Coordinated with Working Range of a Robotic Arm

A Novel Eye-Gaze-Controlled Wheelchair System for Navigating Unknown Environments: Case Study With a Person With ALS

Intelligent Control Wheelchair Using a New Visual Joystick

Evaluation of 2D-/3D-Feet-Detection Methods for Semi-Autonomous Powered Wheelchair Navigation

Control of a Wheelchair-Mounted 6DOF Assistive Robot With Chin and Finger Joysticks

An EOG-based wheelchair robotic arm system for assisting patients with severe spinal cord injuries

Design and Experiment of Multi-Modal Intelligent Elderly Assisted Wheelchair Robot

Eye-gaze control of a wheelchair mounted 6DOF assistive robot for activities of daily living