Abstract:Efficient feature representation is the key to improving crowd counting performance. CNN and Transformer are the two commonly used feature extraction frameworks in the field of crowd counting. CNN excels at hierarchically extracting local features to obtain a multi-scale feature representation of the image, but it struggles with capturing global features. Transformer, on the other hand, could capture global feature representation by utilizing cascaded self-attention to capture remote dependency relationships, but it often overlooks local detail information. Therefore, relying solely on CNN or Transformer for crowd counting has certain limitations. In this paper, we propose the TCHNet crowd counting model by combining the CNN and Transformer frameworks. The model employs the CMT (CNNs Meet Vision Transformers) backbone network as the Feature Extraction Module (FEM) to hierarchically extract local and global features of the crowd using a combination of convolution and self-attention mechanisms. To obtain more comprehensive spatial local information, an improved Progressive Multi-scale Learning Process (PMLP) is introduced into the FEM, guiding the network to learn at different granularity levels. The features from these three different granularity levels are then fed into the Multi-scale Feature Aggregation Module (MFAM) for fusion. Finally, a Multi-Scale Regression Module (MSRM) is designed to handle the multi-scale fused features, resulting in crowd features rich in high-level semantics and low-level detail. Experimental results on five benchmark datasets demonstrate that TCHNet achieves highly competitive performance compared to some popular crowd counting methods.

An interactive network based on transformer for multimodal crowd counting

Multi-branch Progressive Embedding Network for Crowd Counting

RGB-T Multi-Modal Crowd Counting Based on Transformer

Real-time Crowd Counting Via Mobile-Friendly Vision Transformer Network

Multimodal Crowd Counting with Mutual Attention Transformers

Transformer-CNN Hybrid Network for Crowd Counting

Audio-Visual Transformer Based Crowd Counting

Global Vision, Local Focus: The Semantic Enhancement Transformer Network for Crowd Counting

JMFEEL-Net: a Joint Multi-Scale Feature Enhancement and Lightweight Transformer Network for Crowd Counting

LEVERAGE MULTI-SCALE DILATED CONVOLUTIONAL NEURAL NETWORK WITH GLOBAL ATTENTION FEATURE FUSION FOR CROWD COUNTING

Graph Enhancement and Transformer Aggregation Network for RGB-Thermal Crowd Counting

Multi-feature Counting of Dense Crowd Image Based on Multi-column Convolutional Neural Network

Dilated High-Resolution Network Driven RGB-T Multi-Modal Crowd Counting

Crowd Transformer Network

CCTrans: Simplifying and Improving Crowd Counting with Transformer

CrowdTrans: Learning top-down visual perception for crowd counting by transformer

Gramformer: Learning Crowd Counting via Graph-Modulated Transformer

Deep Crowd Counting In Congested Scenes Through Refine Modules

Attention-Guided Collaborative Counting

Multi-modal Crowd Counting via Modal Emulation

MLANet: multi-level attention network with multi-scale feature fusion for crowd counting