Multi-patch localization Spiking Neural Network for Object Detection

Xiangcheng Liu,Shuo Feng,Xiaoxin Cui,Ling Zhang,Yuan Wang,Jian Cao,Feng Ling,Jinming Che,Juntong Yan,Guang Chen
DOI: https://doi.org/10.1109/ICSICT55466.2022.9963459
2022-10-25
Abstract:As the third generation of neural network after Artificial Neural Network, Spiking Neural Network (SNN) has the advantages of low energy consumption and high computing efficiency. However, due to the complex neurons and non-differentiable characteristics of SNN, the current results mostly stay in the software simulation stage, focusing on tasks with relatively simple processes such as image classification, and less achievements in Object Detection (OD) tasks with more application value. At present, the OD based on SNN mostly uses frequency coding, but the regression problem requires high precision and requires a large number of timesteps, resulting in a long time-consuming inference of a picture and a large overall power consumption. In this regard, based on Two-stage OD network, this paper decouples its detection process classification and localization, and proposes a multi-patch classification with localization network, which is completed by using a classification SNN. And take the drone shot by the infrared camera as the dataset, the OD as the application scene. The OD network is deployed on the neuromorphic chip PAICORE1.0 of Peking University, which proves the feasibility of applying our method to real-world neuromorphic chip and facilitates the development of SNN OD and its neuromorphic chip deployment.
Computer Science
What problem does this paper attempt to address?