Prime Label Learning From Multilabel Aerial Image: A Novel Weakly Supervised Task

Kun Zhao,Shiwen Zeng,Lijian Zhou,Tingyuan Nie,Siyuan Hao
DOI: https://doi.org/10.1109/lgrs.2024.3401088
IF: 5.343
2024-05-30
IEEE Geoscience and Remote Sensing Letters
Abstract:In the task of multilabel aerial image classification, various objects and land cover in an image are usually represented by multiple labels which are treated equally. However, from a semantic point of view, the importance of multiple labels is different in a specific scene. There is often a prime label in the image that plays a "leading" role. Obtaining the most important label from candidate multiple labels is crucial, because it best represents the semantics of the entire image. In this letter, we attempt to automatically obtain the prime label of each image from several existing multilabel aerial image datasets without additional supervision cost. In other words, the prime labels are only used to evaluate the performance of models during testing and do not participate in the training process. Therefore, it is essentially a weakly supervised learning task. For this novel aerial image classification task, the corresponding datasets are provided in this letter first, including overhead images with multilabels for training and prime labels for testing. Then the baselines on the above datasets are provided. Finally, a new prime label learning method is proposed, which improves the baseline accuracy (ACC) by about 14% and reaches the state-of-the-art on current datasets.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?