Deep Transfer Learning Based Intelligent Gunshot Detection and Firearm Recognition Using Tri-Axial Acceleration

Zhicong Chen,Haoxin Zheng,Lijun Wu,Jingcang Huang,Yang
DOI: https://doi.org/10.1109/jiot.2024.3489963
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:Reliable identification of gunshot events is crucial for reducing gun violence and enhancing public safety. However, current gunshot detection and recognition methods are still affected by complex shooting scenarios, various non-gunshot events, diverse firearm types and scarce gunshot datasets. To address these issues, based on tri-axial acceleration of guns, a novel general deep transfer learning approach is proposed for gunshot detection and recognition, which combines a temporal deep learning model with transfer learning and automated machine learning to improve the accuracy, reliability and generalization performance. Firstly, a new gunshot recognition model named as MobileNetTime is proposed for the 2-class gunshot event detection, 3-class coarse firearm recognition and 15-class fine firearm recognition, which utilizes one-dimensional convolution and inverted residual modules to autonomously extract higher-level features from the time series acceleration data. Secondly, considering the impact of non-gunshot events, the automated machine learning is employed for model fine-tuning, to transfer the pre-trained MobileNetTime from the handgun to various firearm types. In addition, we propose a low-power versatile gunshot recognition system framework employing a tri-axial accelerometer for both of wrist-worn and gun-embedded scenarios, which adopts a two-stage wake-up mechanism that selectively monitors gunshot events using temporal and spectral energy features. The experimental results on the two gunshot datasets DGUWA and GRD show that the proposed model can achieve up to 100% accuracy on DGUWA dataset and 98.98% accuracy on GRD dataset for the 2-class gunshot detection. Moreover, the proposed deep transfer learning approach achieves a 98.98% accuracy for 16-class firearm classification, which is 6.21% higher than the model without transfer learning.
What problem does this paper attempt to address?