Abstract:Understanding road conditions is essential for implementing effective road safety measures and driving solutions. Road situations encompass the day-to-day conditions of roads, including the presence of vehicles and pedestrians. Surveillance cameras strategically placed along streets have been instrumental in monitoring road situations and providing valuable information on pedestrians, moving vehicles, and objects within road environments. However, these video data and information are stored in large volumes, making analysis tedious and time-consuming. Deep learning models are increasingly utilized to monitor vehicles and identify and evaluate road and driving comfort situations. However, the current neural network model requires the recognition of situations using time-series video data. In this paper, we introduced a multi-directional detection model for road situations to uphold high accuracy. Deep learning methods often integrate long short-term memory (LSTM) into long-term recurrent network architectures. This approach effectively combines recurrent neural networks to capture temporal dependencies and convolutional neural networks (CNNs) to extract features from extensive video data. In our proposed method, we form a multi-directional long-term recurrent convolutional network approach with two groups equipped with CNN and two layers of LSTM. Additionally, we compare road situation recognition using convolutional neural networks, long short-term networks, and long-term recurrent convolutional networks. The paper presents a method for detecting and recognizing multi-directional road contexts using a modified LRCN. After balancing the dataset through data augmentation, the number of video files increased, resulting in our model achieving 91% accuracy, a significant improvement from the original dataset.

Combining Rotation-Invariance Images and Neural Networks for Road Scene Understanding

Better Road Following By Integrating Omni-View Images And Neural Nets

Omnidirectional Vision for Road Understanding *

Fast Road Classification and Orientation Estimation Using Omni-View Images and Neural Networks.

Road-aware Monocular Structure from Motion and Homography Estimation

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Learning single-shot vehicle orientation estimation from large-scale street panoramas.

Low-Visibility Vehicle-Road Environment Perception Based on the Multi-Modal Visual Features Fusion of Polarization and Infrared

Flexible Neural Network for Fast and Accurate Road Scene Perception.

A system of vision sensor based deep neural networks for complex driving scene analysis in support of crash risk assessment and prevention

Learning from Maps: Visual Common Sense for Autonomous Driving

Translating Images to Road Network: A Sequence-to-Sequence Perspective

RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsing

RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion

Multi-Directional Long-Term Recurrent Convolutional Network for Road Situation Recognition

Translating Images to Road Network: A Non-Autoregressive Sequence-to-Sequence Approach.

Multiscale Global Attention Network With Edge Perceptron for Automatic Road Extraction From Remote Sensing Imagery

Learning to Look around Objects for Top-View Representations of Outdoor Scenes

Road Network Mapping from Multispectral Satellite Imagery: Leveraging Deep Learning and Spectral Bands

Automatic Detection and Recognition of Traffic Signs in Stereo Images Based on Features and Probabilistic Neural Networks

RoadCT: A Hybrid CNN-Transformer Network for Road Extraction From Satellite Imagery