MetaUSACC: Unlabeled scene adaptation for crowd counting via meta-auxiliary learning

Chaoqun Ma,Jia Zeng,Penghui Shao,Anyong Qing,Yang Wang
DOI: https://doi.org/10.1016/j.eswa.2024.123228
IF: 8.5
2024-02-01
Expert Systems with Applications
Abstract:We tackle the problem of unlabeled scene adaptation for crowd counting (USACC), whose objective is to enable the crowd counting model to specifically adapt to a new target scene employing a few unlabeled images from the target scene. The solution to this challenging issue can bring the crowd counting task closer to real-world applications when we deploy the model to a new scene. Herein, we propose a novel meta-auxiliary learning approach, denoted as MetaUSACC, which combines a self-supervised auxiliary task with meta-learning paradigm. This approach can facilitate the model to adapt to new scenes. In one training iteration, the model's scene-specific parameters are learned from a batch of different scenes by minimizing the self-supervised loss. The parameters of the meta-model are then updated based on the primary crowd counting task to boost the performance of crowd counting. During the test, the model can effectively adapt to the new target scene using only one or more unlabeled images by minimizing the self-supervised loss. Moreover, the reconstruction task serves as the auxiliary task, positioned side-by-side with the output layer of the main crowd counting task, thereby creating a two-branch network. Therefore, our approach is flexible and applicable to existing crowd counting models. The results of substantial experiments show that our approach significantly outperforms our baselines and exceeds the prior method.
computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
What problem does this paper attempt to address?