Abstract:Crowd counting has received extensive attention in the field of computer vision, and methods based on deep convolutional neural networks (CNNs) have made great progress in this task. However, challenges such as scale variation, nonuniform distribution, complex background, and occlusion in crowded scenes hinder the performance of these networks in crowd counting. In order to overcome these challenges, this article proposes a multiscale spatial guidance perception aggregation network (MGANet) to achieve efficient and accurate crowd counting. MGANet consists of three parts: multiscale feature extraction network (MFEN), spatial guidance network (SGN), and attention fusion network (AFN). Specifically, to alleviate the scale variation problem in crowded scenes, MFEN is introduced to enhance the scale adaptability and effectively capture multiscale features in scenes with drastic scale variation. To address the challenges of nonuniform distribution and complex background in population, an SGN is proposed. The SGN includes two parts: the spatial context network (SCN) and the guidance perception network (GPN). SCN is used to capture the detailed semantic information between the multiscale feature positions extracted by MFEN, and improve the ability of deep structured information exploration. At the same time, the dependence relationship between the spatial remote context is established to enhance the receptive field. GPN is used to enhance the information exchange between channels and guide the network to select appropriate multiscale features and spatial context semantic features. AFN is used to adaptively measure the importance of the above different features, and obtain accurate and effective feature representations from them. In addition, this article proposes a novel region-adaptive loss function, which optimizes the regions with large recognition errors in the image, and alleviates the inconsistency between the training target and the evaluation metric. In order to evaluate the performance of the proposed method, extensive experiments were carried out on challenging benchmarks including ShanghaiTech Part A and Part B, UCF-CC-50, UCF-QNRF, and JHU-CROWD ++ . Experimental results show that the proposed method has good performance on all four datasets. Especially on ShanghaiTech Part A and Part B, CUCF-QNRF, and JHU-CROWD ++ datasets, compared with the state-of-the-art methods, our proposed method achieves superior recognition performance and better robustness.

MPASNET: Motion Prior-Aware Siamese Network for Unsupervised Deep Crowd Segmentation in Video Scenes

Multi-branch Progressive Embedding Network for Crowd Counting

A Multi-Scale Recurrent Framework for Motion Segmentation With Event Camera

MSGNet: Multi-Source Guidance Network for Fish Segmentation in Underwater Videos

TSMSAN: A Three-Stream Multi-Scale Attentive Network for Video Saliency Detection.

Learning Motion-Appearance Co-Attention for Zero-Shot Video Object Segmentation.

MGPSN: Motion-Guided Pseudo Siamese Network for Indoor Video Head Detection.

MSANet: Multiscale Self-Attention Aggregation Network for Few-Shot Aerial Imagery Segmentation

Enhanced Memory Network for Video Segmentation

MPSN: Motion-aware Pseudo-Siamese Network for indoor video head detection in buildings

MEDANet: More Efficient Dual Attention Network for Scene Segmentation

MANet: Multi-Scale Aware-Relation Network for Semantic Segmentation in Aerial Scenes

MoNet: Deep Motion Exploitation for Video Object Segmentation

See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks

Crowd Counting Using Deep Recurrent Spatial-Aware Network.

Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation

Crowd Counting Based on Multiscale Spatial Guided Perception Aggregation Network

Parallel Dense Merging Network with Dilated Convolutions for Semantic Segmentation of Sports Movement Scene.

Multilateral Cascading Network for Semantic Segmentation of Large-Scale Outdoor Point Clouds

MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds

MFCP-Net: Multiscale Feature Correlation Perception Network for Image Segmentation Based on Background Prior