Abstract:Curbs -- the edge of a raised sidewalk at the point where it meets a street -- crucial in urban environments where they help delineate safe pedestrian zones, from dangerous vehicular lanes. However, curbs themselves are significant navigation hazards, particularly for people who are blind or have low vision (pBLV). The challenges faced by pBLV in detecting and properly orientating themselves for these abrupt elevation changes can lead to falls and serious injuries. Despite recent advancements in assistive technologies, the detection and early warning of curbs remains a largely unsolved challenge. This paper aims to tackle this gap by introducing a novel, multi-faceted sensory substitution approach hosted on a smart wearable; the platform leverages an RGB camera and an embedded system to capture and segment curbs in real time and provide early warning and orientation information. The system utilizes YOLO (You Only Look Once) v8 segmentation model, trained on our custom curb dataset for the camera input. The output of the system consists of adaptive auditory beeps, abstract sonification, and speech, conveying information about the relative distance and orientation of curbs. Through human-subjects experimentation, we demonstrate the effectiveness of the system as compared to the white cane. Results show that our system can provide advanced warning through a larger safety window than the cane, while offering nearly identical curb orientation information.

Detecting and Tracing Algorithm of Blind Sidewalk Based on Color Information

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Crosswalk navigation for people with visual impairments on a wearable device.

Intersection Navigation For People With Visual Impairment

Detecting Traversable Area and Water Hazards for the Visually Impaired with a Prgb-D Sensor.

A ground and obstacle detection algorithm for the visually impaired

Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

Glass Detection and Recognition Based on the Fusion of Ultrasonic Sensor and RGB-D Sensor for the Visually Impaired

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

A Flexible Assistant Tool with Dynamic Scanning to Enhance the Ability of Color Discrimination

Illumination Invariance Adaptive Sidewalk Detection Based on Unsupervised Feature Learning

An Efficient Walking Safety Service for Distracted Mobile Users

Towards Street Camera-based Outdoor Navigation for Blind Pedestrians

Traffic Pedestrian Detection Based on Codebook Model in HSV Color Space

Implementation of a Blind navigation method in outdoors/indoors areas

Research on Pedestrian Detection Algorithm Based on Deep Learning

Virtual-Blind-Road Following Based Wearable Navigation Device for Blind People

Multi-faceted Sensory Substitution for Curb Alerting: A Pilot Investigation in Persons with Blindness and Low Vision

Pedestrian re-recognition method and system based on color area features

Rapid Detection of Blind Roads and Crosswalks by Using a Lightweight Semantic Segmentation Network