Abstract:Modern detectors are mostly trained under single and limited conditions. However, object detection faces various complex and open situations in autonomous driving, especially in urban street scenes with dense objects and complex backgrounds. Due to the shift in data distribution, modern detectors can not perform well in actual urban environments. Using domain adaptation to improve detection performance is one of the key methods to extend object detection from limited situations to open situations. To this end, this article proposes a Domain Adaptation of Anchor-Free object detection (DAAF) for urban traffic. DAAF is a cross-domain object detection method that performs feature alignment including two aspects. On the one hand, we designed a fully convolutional adversarial training method for global feature alignment at the image level. Meanwhile, images can generally be decomposed into structural information and texture information. In urban street scenes, the structural information of images is generally similar. The main difference between the source domain and the target domain is texture information. Therefore, during global feature alignment, this paper proposes a method called texture information limitation (TIL). On the other hand, in order to solve the problem of variable aspect ratios of objects in urban street scenes, this article uses an anchor-free detector as the baseline detector. Since the anchor-free object detector can obtain neither explicit nor implicit instance-level features, we adopt Pixel-Level Adaptation (PLA) to align local features instead of instance-level alignment for local features. The size of the object has the greatest impact on the final detection effect, and the object scale in urban scenes is relatively rich. Guided by the differentiation of attention mechanisms, a multi-level adversarial network is designed to perform feature alignment of the output space at different feature levels called Scale Information Limitation (SIL). We conducted cross-domain detection experiments by using various urban streetscape autonomous driving object detection datasets, including adverse weather conditions, synthetic data to real data, and cross-camera adaptation. The experimental results indicate that the method proposed in this article is effective.

A Hybrid Transfer Learning Mechanism for Object Classification across View

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

A Visual Analytical Approach for Transfer Learning in Classification.

Moving vehicle tracking and scene understanding: A hybrid approach

Efficient Online Transfer Learning for 3D Object Classification in Autonomous Driving

High Efficient Moving Object Extraction and Classification in Traffic Video Surveillance

Multi-source unsupervised domain adaptation for object detection

A New Belief-Based Bidirectional Transfer Classification Method

Target Optimization Direction Guided Transfer Learning for Image Classification.

Multilevel Knowledge Transfer for Cross-Domain Object Detection

Cross-Modality Bridging and Knowledge Transferring for Image Understanding

Efficient Transferability Assessment for Selection of Pre-trained Detectors

Hybrid Classification-Regression Adaptive Loss for Dense Object Detection

Real-time Object Classification in Video Surveillance Based on Appearance Learning

Multi-component transfer metric learning for handling unrelated source domain samples

Transfer Learning-Based Hyperspectral Image Classification Using Residual Dense Connection Networks

Active Learning with Cross-Class Knowledge Transfer.

Robust Domain Generalization for Multi-modal Object Recognition

Domain adaptation of anchor-free object detection for urban traffic

Transfer Learning by Ranking for Weakly Supervised Object Annotation