Two-branch fusion network with attention map for crowd counting

Yongjie Wang,Wei Zhang,Yanyan Liu,Jianghua Zhu
DOI: https://doi.org/10.1016/j.neucom.2020.06.034
IF: 6
2020-10-01
Neurocomputing
Abstract:<p>Predicting the number and distribution of people in a crowded image is challenging work, due to the scale variations and complex background. In this work, we propose a two-branch fusion model with attention map to deal with the above two problems. Compared with previous works, our method designs a network focusing on fusing density maps which generated from different branches, instead of fusing features which captured from different scales. Two paralleled branches are followed with first ten layers of VGG16 model to extract different scales features from input image. And a dynamic weighting strategy is used to fuse the density maps generated from the different branches to get the final high quality density map. In addition, our model adopts attention mechanism to modify the density map of each branch. Our method has been evaluated on different datasets (ShanghaiTech, WorldExpo'10, UCF-QRNF and UCF_CC_50). The results present that our model has lower error than many other methods on these four datasets. The source code is available at https://github.com/jiezishu737/two_branches_code.</p>
computer science, artificial intelligence
What problem does this paper attempt to address?