MSFFA-YOLO Network: Multiclass Object Detection for Traffic Investigations in Foggy Weather

Qiang Zhang,Xiaojian Hu
DOI: https://doi.org/10.1109/tim.2023.3318671
IF: 5.6
2023-10-13
IEEE Transactions on Instrumentation and Measurement
Abstract:Despite significant progress in vision-based detection methods, the task of detecting traffic objects in foggy weather remains challenging. The presence of fog reduces visibility, which in turn affects the information of traffic objects in videos. However, accurate information regarding the localization and classification of traffic objects is crucial for certain traffic investigations. In this article, we focus on presenting a multiclass object detection method, namely, multiscale feature fusion attention-you only look once (MSFFA-YOLO) network, that can be trained and jointly achieve three tasks: visibility enhancement, object classification, and object localization. In the network, we employ the enhanced YOLOv7 as a detection subnet, which is responsible for learning to locate and classify objects. In the restoration subnet, the MSFFA structure is presented for visibility enhancement. The experimental results on the synthetic foggy datasets show that the presented MSFFA-YOLO can achieve 64.6% accuracy on the FC005 dataset, 67.3% accuracy on the FC01 dataset, and 65.7% accuracy on the FC02 dataset. When evaluated on the natural foggy datasets, the presented MSFFA-YOLO can achieve 84.7% accuracy on the RTTS dataset and 84.1% accuracy on the RW dataset, indicating its ability to accurately detect multiclass traffic objects in real and foggy weather. And, the experimental results show that the presented MSFFA-YOLO can achieve the efficiency of 37 frames per second (FPS). Finally, the experimental results demonstrate the excellent performance of our presented method for object localization and classification in foggy weather. And, when detecting concealed traffic objects in foggy weather, our presented method exhibits superior accuracy. These results substantiate the applicability of our presented method for traffic investigations in foggy weather.
engineering, electrical & electronic,instruments & instrumentation
What problem does this paper attempt to address?