CityUPlaces: a new dataset for efficient vision-based recognition
Haowei Wu,Gengshen Wu,Jinming Hu,Shuaixin Xu,Songhao Zhang,Yi Liu,Wu, Haowei,Wu, Gengshen,Hu, Jinming,Xu, Shuaixin,Zhang, Songhao,Liu, Yi
DOI: https://doi.org/10.1007/s11554-023-01369-6
IF: 2.293
2023-10-08
Journal of Real-Time Image Processing
Abstract:In this paper, we present a new dataset named CityUPlaces, comprising 17,771 images from various campus buildings, which contains 9 major categories and further derives 18 minor categories based on the internal and external scenes of these identities. Each category is not balanced ranging from 344 to 1539 with diverse variations in angle, attractions, views, illumination, etc. Compared to existing large-scale datasets, the proposed dataset shows its strengths in two aspects: (1) it contains a moderate number of both indoor and outdoor images under different conditions for each identity, which enables diverse real-time recognition tasks by featuring hierarchical categorization with reasonable dataset size; (2) the issue of label noise is significantly alleviated for each identity in the dedicated annotation and filtering stages to facilitate the subsequent tasks. This provides great flexibility to perform these vision-based tasks with different learning objectives in a real-time mode. Moreover, we propose a novel lightweight classification framework that outperforms state-of-the-art baselines on the dataset with the relatively low computational complexity of fewer training parameters and floating-point operations per second, by taking advantage of the involved coarse-to-fined learning strategy in a self-transfer manner. This laterally confirms the applicability of the new dataset. We also conduct experiments on the MIT Indoors and Paris datasets, where the proposed method still achieves superior performance that validates its efficacy. The dataset and code will be publicly available in the future.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology