Abstract:When it comes to poor lighting conditions such as night, backlight, haze, etc., the detection method of unstructured roads based on visible light cameras often fails. Therefore, this paper aims to improve the detection performance of unstructured roads based on thermal infrared images for autonomous robot systems. For this purpose, we propose a real-time network for unstructured road segmentation at night based on thermal infrared images (URTSegNet) in this paper. Like BiSeNet V2, we adopt a two-branch structure, including Detail Branch and Semantic Branch, to extract spatial detail and contextual features. The Detail Branch maintains a small receptive field and high capacity and adjusts the computational cost by employing depth-wise separable convolutions. In the Semantic Branch, we modify Stem Block to obtain more information because of the characteristics of infrared images. Dilated convolution expands the receptive field while keeping the number of parameters unchanged. Finally, we design a more concise and efficient Aggregation Block using a gate mechanism. An infrared unstructured road dataset, including total darkness at night, low light, backlight, haze, and other scenes, is collected to get the real-world dataset and effectively evaluate performance. We got 97.5% Intersection over Union (IoU) and reached an inference speed of 129 FPS on a single NVIDIA GTX 1660S card on our dataset. In addition, extensive evaluation experiments are conducted on two public datasets to verify the generalization ability of the model and the role of each module. This research addresses the problem of road detection for unmanned platforms in unstructured environments at night or under poor lighting conditions. The algorithm has high accuracy and a fast inference speed so that it can be implemented on various embedded devices.

An Improved U-Net Model for Infrared Image Segmentation of Wind Turbine Blade

Semantic segmentation network of uav image based on improved U-net

An Enhanced U-Net Approach for Segmentation of Aeroengine Hollow Turbine Blade

An Infrared Image Stitching Method for Wind Turbine Blade Using UAV Flight Data and U-Net

Infrared Image Segmentation for Photovoltaic Panels Based on Res-UNet

Robust Wind Turbine Blade Segmentation from RGB Images in the Wild

An Improved U-Net Infrared Small Target Detection Algorithm Based on Multi-Scale Feature Decomposition and Fusion and Attention Mechanism

Defect detection of large wind turbine blades based on image stitching and improved Unet network

An improved method for retinal vessel segmentation in U-Net

An improved U-Net method for the semantic segmentation of remote sensing images

Research on Improved U-net Based Remote Sensing Image Segmentation Algorithm

Semantic Segmentation of High-Resolution Remote Sensing Images with Improved U-Net Based on Transfer Learning

Retinal Blood Vessels Segmentation With Improved SE‐UNet Model

Fault identification of fan blade based on improved ResNet-18

Sharp U-Net: Depthwise convolutional network for biomedical image segmentation

A Multilevel Convolutional Recurrent Neural Network for Blade Icing Detection of Wind Turbine

CTMU-Net: an Improved U-Net for Semantic Segmentation of Remote-Sensing Images Based on the Combined Attention Mechanism

An Attention-Based Improved U-Net Neural Network Model for Semantic Segmentation of Moving Objects

U-Net for Satellite Image Segmentation: Improving the Weather Forecasting

Boundary Aware U-Net for Retinal Layers Segmentation in Optical Coherence Tomography Images

URTSegNet: A real-time segmentation network of unstructured road at night based on thermal infrared images for autonomous robot system