Abstract:Objective Existing artificial vision devices can be divided into two types:implanted devices and extracorporeal devices,both of which have some disadvantages.The former requires surgical implantation,which may lead to irreversible trauma,while the latter has some defects such as relatively simple instructions,limited application scenarios and relying too much on the judgment of artificial intelligence(AI)to provide enough security.Here we propose a system that has voice interaction and can convert surrounding environment information into tactile commands on head and neck.Compared with existing extracorporeal devices,our device can provide a larger capacity of information and has advantages such as lower cost,lower risk,suitable for a variety of life and work scenarios.Methods With the latest remote wireless communication and chip technologies,microelectronic devices,cameras and sensors worn by the user,as well as the huge database and computing power in the cloud,the backend staff can get a full insight into the scenario,environmental parameters and status of the user remotely(for example,across the city)in real time.In the meanwhile,by comparing the cloud database and in-memory database and with the help of AI-assisted recognition and manual analysis,they can quickly develop the most reasonable action plan and send instructions to the user.In addition,the backend staff can provide humanistic care and emotional sustenance through voice dialogs.Results This study originally proposes the concept of"remote virtual companion"and demonstrates the related hardware and software as well as test results.The system can not only achieve basic guide functions,for example,helping a person with visual impairment to shop in supermarkets,find seats at cafes,walk on the streets,construct complex puzzles,and play cards,but also can meet the demand for fast-paced daily tasks such as cycling.Conclusion Experimental results show that this"remote virtual companion"is applicable for various scenarios and demands.It can help blind people with their travels,shopping and entertainment,or accompany the elderlies with their trips,wilderness explorations,and travels.

“Avatar to Person” (ATP) Virtual Human Social Ability Enhanced System for Disabled People

Facilitating the implementation of AI-based assistive technologies for persons with disabilities in vocational rehabilitation: A practical design thinking approach

Amplifying robotics capacities with a human touch: An immersive low-latency panoramic remote system

AVATAR: Realistic customized virtual agents as emotional tutors for children with ASD

Remote Virtual Companion Via Tactile Codes and Voices for the People with Visual Impairment

Avatar-Based Picture Exchange Communication System Enhancing Joint Attention Training for Children with Autism

An AI Guide to Enhance Accessibility of Social Virtual Reality for Blind People

FaceMe: an Augmented Reality Social Agent Game for Facilitating Children's Learning about Emotional Expressions

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Toon-chat

"It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality

Implementation of the Interactive Gestures of Virtual Avatar Based on a Multi-user Virtual Learning Environment

Let's Keep in Touch Online: a Facebook Aware Virtual Human Interface

Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders

Avatar Work: Telework for Disabled People Unable to Go Outside by Using Avatar Robots "OriHime-D" and Its Verification

AEGIS: A real-time multimodal augmented reality computer vision based system to assist facial expression recognition for individuals with autism spectrum disorder

Anywhere Is Possible: An Avatar Platform for Social Telepresence With Full Perception of Physical Interaction

Assistive VR Gym: Interactions with Real People to Improve Virtual Assistive Robots

Improving Social Communication Disorders Through Human-Avatar Interaction

Immersive Commodity Telepresence with the AVATRINA Robot Avatar

Social Robots for People with Developmental Disabilities: A User Study on Design Features of a Graphical User Interface