Abstract:Active research on computer vision accelerates the progress in autonomous driving. Following this trend, we aim to leverage the recently emerged methods for Intelligent Vehicles (IV), and transfer them to develop navigation assistive technologies for the Visually Impaired (VI). This topic grows notoriously challenging as it requires to detect a variety of scenes towards higher level of assistance. Computer vision based techniques with monocular detectors or depth sensors sprung up within years of research. These separate approaches achieved remarkable results with relatively low processing time, and improved the mobility of visually impaired people to a large extent. However, running all detectors jointly increases the latency and burdens the computational resources. In this paper, we put forward to seize pixel-wise semantic segmentation to cover the perception needs of navigational assistance in a unified way. This is critical not only for the terrain awareness regarding traversable areas, sidewalks, stairs and water hazards, but also for the avoidance of short-range obstacles, fast-approaching pedestrians and vehicles. At the heart of our proposal is a combination of efficient residual factorized network (ERFNet), pyramid scene parsing network (PSPNet) and 3D point cloud based segmentation. This approach proves to be with qualified accuracy and speed for real-world applications by a comprehensive set of experiments on a wearable navigation system.

Perception-Guided Simplification for Real Time Navigation of Very Large-Scale Terrain Environments

High Performance Navigation of Very Large-Scale Terrain Environment

Efficient screen space approach for high complex dynamic scenes in real-time rendering

Walking Through a Very Large Virtual Environment in Real-time.

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Partition Based Real-Time Rendering Method for Large-Area Terrain Data

Accelerated Walkthroughs Of Complex Scenes Based On Visibility Culling And Image-Based Rendering

GPU Accelerated Real-Time Traversability Mapping.

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Accelerated Walkthroughs Of Virtual Environments Based On Visibility Preprocessing And Simplification

Multi-screen Tiled Displayed, Parallel Rendering System for a Large Terrain Dataset

A Fast Algorithm For Large Scale Terrain Walkthrough

Combination Of Hierarchical Visibility With Clod Terrain

View-dependent and Multi-Resolution Simplification Algorithm of a Terrain Model

Multi-resolution Terrain Rendering Using Summed-Area Tables .

Huge texture mapping for real-time visualization of large-scale terrain

Perception-motivated Visualization for 3D City Scenes.

Rendering of Virtual Environments Based on Polygonal & Point-Based Models

Virtual Real-Time Walkthrough of Multi-Spectral Scene

Feature-Based Visibility-Driven CLOD for Terrain

Combination of Hierarchical Visibility with Level of Detail Terrain Model