Automatic Labelling Framework for Optical Remote Sensing Object Detection Samples in a Wide Area Using Deep Learning

Ning Li,Liang Cheng,Lei Wang,Hui Chen,Yalu Zhang,Yunchang Yao,Jian Cheng,Manchun Li
DOI: https://doi.org/10.1016/j.eswa.2024.124827
IF: 8.5
2024-01-01
Expert Systems with Applications
Abstract:The continuous development of optical remote sensing images has provided a valuable data source for object detection samples. Labelling these samples for deep learning research in optical remote sensing is crucial yet time-consuming. Traditional manual labelling methods are known to be costly and inefficient, necessitating an automated solution. This work presents an innovative framework for automatically labelling remote sensing object detection samples. The framework comprises four main steps: dual student models, spatial computing, decision boundary teacher, and image and label generation. The dual student models are trained on public datasets and utilized for object detection and analysis through spatial computing techniques. A decision boundary teacher is employed to construct a sample classification surface to differentiate between positive and negative targets. The training process’s performance is further enhanced by applying a multi-loss joint optimization function. Experimental evaluations were conducted using high-resolution remote sensing images from Google, covering Japan. The results demonstrate a 58.9% increase in automatic labelling instances for the four target classes. Compared to the most advanced wide-area object detection frameworks, our proposed framework achieved an improved F1 metric by 2.88%. Additionally, the joint function outperformed other advanced loss functions, leading to accuracy improvements of 0.64% for airports, 2.45% for golf courses, and 2.35% for stadiums. This framework represents a pioneering automated approach for wide-area optical remote sensing sample labelling, demonstrating its effectiveness and transferability across different target classes.
What problem does this paper attempt to address?