Abstract:In this work, we propose an efficient convolutional neural network (CNN) and a binocular vision-based target detection and ranging framework for intelligent railway systems to localize and detect the trackside equipment, where the location, classification, and boundary violation of the target are jointly addressed. First, we develop an effective enhanced YOLOX-tiny model with the aid of coordinate attention (CA), CIoU, and focal-loss to improve the detection performance, by ensuring the detection speed. Our model improves mAP by 3.25% compared with the original YOLOX-tiny model. Then, we develop a CNN and binocular vision-based target detection and ranging system by integrating the YOLOX target detection algorithm, binocular ranging algorithm, and OCR character recognition algorithm, and proposing the RGB-d-OCR Matching (RDOM) algorithm to match the results of the three algorithms. Moreover, we deployed the proposed algorithm on edge terminals and built a track inspection vehicle to carry the system. As the vehicle travels on the track, our algorithm can automatically position the trackside equipment on both sides and measure the distance to determine whether the equipment has a boundary violation. The experimental results show that the proposed system can achieve an equipment recognition rate of 91.8%, an ID recognition rate of 88%, and a ranging error within 2%. In particular, RDOM successfully matched the results of the three algorithms, ensuring that the detected trackside equipment corresponds to the correct distance and ID. Our work is a revolutionary method that integrates target recognition, OCR recognition, and binocular ranging while considering detection accuracy and efficiency.

Binocular Vision-Based Human Ranging Algorithm Based on Human Faces Recognition

Human-Computer Interaction System Based on Binocular Stereo Vision

Video Based Head Detection and Tracking Surveillance System

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

Unconstrained Face Detection and Recognition Based on Rgb-D Camera for the Visually Impaired

Design and Implementation of an Intelligent Passenger Counting System Based on the Kinect Sensor

Recognition and Distance Estimation of an Irregular Object in Package Sorting Line Based on Monocular Vision

Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision

Face Detection and Recognition from Distance Based on Deep Learning

Stereo Vision for Visual Object Tracking and Distance Measurement Assessment

Binocular Omni-Stereo Based Human Tracking System In Indoor Environments For Intelligent Surveillance

Research on Robot Binocular Ranging Based on SIFT Feature Extraction Algorithm

Distance measurement system based on binocular stereo vision

A Scheme for Face Recognition in Complex Environments

Simplified Binocular Stereo Distance-Measurement Algorithm and a System Based on Competition

CNN and Binocular Vision-Based Target Detection and Ranging Framework of Intelligent Railway System

Research on Recognition of Painted Faces

3D Face Recognition from Range Data.

A Traffic Avoidance System Based on Binocular Ranging

The distance measurement method of binocular vision applications ranging principle parallax

Gesture recognition based on binocular vision