Abstract:Assistive technologies aim at enhancing personal mobility of individuals with disabilities to improve their independence and access to social life. For the visually impaired, perception during navigation comprises a major ingredient of independent living. With the development of computer vision, it is possible to meet the richer needs of visually impaired people. However, research on navigation assistance for the visually impaired is still relatively unexplored when compared with the active progress in autonomous driving which is already in full swing. In respond to this issue, we aim to leverage the study of the Stixel-World for automotive systems and transfer it to develop assistive technology for visually impaired people. The impressive research results of deep learning also suppose benefits for vision-based technology. Precisely, semantic segmentation is a task that enables identification of different objects uniformly. Inspired by these observations, we design a set of wearable visual aids, while the core algorithm is based on the stixel representations for three-dimensional world combined with pixel-wise semantic segmentation. Predetermined conditions for stixels in automotive research, such as camera angles, position fixes, and unsuitable assumptions made about the real world are optimized to fit the needs of navigation assistance in our algorithm, along with the incorporation of traversability-related semantic information. We also propose a sound mapping scheme, so that the environmental awareness about geographic and semantic information are conveyed to the visually impaired through acoustic feedback.

An Environmental Perception and Navigational Assistance System for Visually Impaired Persons Based on Semantic Stixels and Sound Interaction

Semantic perception of curbs beyond traversability for real-world navigation assistance systems

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Robustifying Semantic Cognition of Traversability Across Wearable RGB-depth Cameras

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Intersection Navigation For People With Visual Impairment

Unifying Visual Localization and Scene Recognition for People with Visual Impairment

Assisting the Visually Impaired: Multitarget Warning Through Millimeter Wave Radar and RGB-depth Sensors.

Unifying Terrain Awareness for the Visually Impaired through Real-Time Semantic Segmentation

Can We Unify Perception and Localization in Assisted Navigation? An Indoor Semantic Visual Positioning System for Visually Impaired People

A Wearable Navigation Device for Visually Impaired People Based on the Real-Time Semantic Visual SLAM System

HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor

Intersection Perception Through Real-Time Semantic Segmentation to Assist Navigation of Visually Impaired Pedestrians

Outdoor Navigation Assistive System Based on Robust and Real-Time Visual-Auditory Substitution Approach

Intuitive Environmental Perception Assistance for Blind Amputees Using Spatial Audio Rendering

Sensing and Navigation of Wearable Assistance Cognitive Systems for the Visually Impaired

SoundView: an Auditory Guidance System Based on Environment Understanding for the Visually Impaired People

Stereo Vision Based Sensory Substitution for the Visually Impaired

Panoptic Lintention Network: Towards Efficient Navigational Perception for the Visually Impaired