Abstract:Assistive technologies aim at enhancing personal mobility of individuals with disabilities to improve their independence and access to social life. For the visually impaired, perception during navigation comprises a major ingredient of independent living. With the development of computer vision, it is possible to meet the richer needs of visually impaired people. However, research on navigation assistance for the visually impaired is still relatively unexplored when compared with the active progress in autonomous driving which is already in full swing. In respond to this issue, we aim to leverage the study of the Stixel-World for automotive systems and transfer it to develop assistive technology for visually impaired people. The impressive research results of deep learning also suppose benefits for vision-based technology. Precisely, semantic segmentation is a task that enables identification of different objects uniformly. Inspired by these observations, we design a set of wearable visual aids, while the core algorithm is based on the stixel representations for three-dimensional world combined with pixel-wise semantic segmentation. Predetermined conditions for stixels in automotive research, such as camera angles, position fixes, and unsuitable assumptions made about the real world are optimized to fit the needs of navigation assistance in our algorithm, along with the incorporation of traversability-related semantic information. We also propose a sound mapping scheme, so that the environmental awareness about geographic and semantic information are conveyed to the visually impaired through acoustic feedback.

Detecting Traversable Area and Water Hazards for the Visually Impaired with a Prgb-D Sensor.

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

Perception Framework of Water Hazards Beyond Traversability for Real-World Navigation Assistance Systems

Expanding the Detection of Traversable Area with RealSense for the Visually Impaired

Assisting the Visually Impaired: Multitarget Warning Through Millimeter Wave Radar and RGB-depth Sensors.

Glass Detection and Recognition Based on the Fusion of Ultrasonic Sensor and RGB-D Sensor for the Visually Impaired

Polarization-based Water Hazards Detection for Autonomous Off-Road Navigation

IR Stereo RealSense: Decreasing Minimum Range of Navigational Assistance for Visually Impaired Individuals.

Intersection Navigation For People With Visual Impairment

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Robustifying Semantic Cognition of Traversability Across Wearable RGB-depth Cameras

Improving RealSense by Fusing Color Stereo Vision and Infrared Stereo Vision for the Visually Impaired

Polarization-based Water Obstacle Detection Method

An Environmental Perception and Navigational Assistance System for Visually Impaired Persons Based on Semantic Stixels and Sound Interaction

Polarimetric Target Depth Sensing in Ambient Illumination Based on Polarization-Coded Structured Light.

Crosswalk navigation for people with visual impairments on a wearable device.

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Robust Water Hazard Detection for Autonomous Off-Road Navigation

Reducing the minimum range of a RGB-depth sensor to aid navigation in visually impaired individuals

Fusion of millimeter wave radar and RGB-depth sensors for assisted navigation of the visually impaired