Millimeter-Wave Radar-Based Identity Recognition Algorithm Built on Multimodal Fusion

Jian Guo,Jingpeng Wei,Yashan Xiang,Chong Han

DOI: https://doi.org/10.3390/s24134051

IF: 3.9

2024-06-22

Sensors

Abstract:Millimeter-wave radar-based identification technology has a wide range of applications in persistent identity verification, covering areas such as security production, healthcare, and personalized smart consumption systems. It has received extensive attention from the academic community due to its advantages of being non-invasive, environmentally insensitive and privacy-preserving. Existing identification algorithms mainly rely on a single signal, such as breathing or heartbeat. The reliability and accuracy of these algorithms are limited due to the high similarity of breathing patterns and the low signal-to-noise ratio of heartbeat signals. To address the above issues, this paper proposes an algorithm for multimodal fusion for identity recognition. This algorithm extracts and fuses features derived from phase signals, respiratory signals, and heartbeat signals for identity recognition purposes. The spatial features of signals with different modes are first extracted by the residual network (ResNet), after which these features are fused with a spatial-channel attention fusion module. On this basis, the temporal features are further extracted with a time series-based self-attention mechanism. Finally, the feature vectors of the user's vital sign modality are obtained to perform identity recognition. This method makes full use of the correlation and complementarity between different modal signals to improve the accuracy and reliability of identification. Simulation experiments show that the algorithm identity recognition proposed in this paper achieves an accuracy of 94.26% on a 20-subject self-test dataset, which is much higher than that of the traditional algorithm, which is about 85%.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **Existing vital sign recognition algorithms based on millimeter - wave radar have deficiencies in terms of accuracy and reliability. Especially when facing single - modal signals (such as respiration or heartbeat signals), due to problems such as high signal similarity and low signal - to - noise ratio, the recognition performance is limited**.

To solve these problems, the paper proposes an identity recognition algorithm based on multi - modal fusion. Specifically, the goals of the paper include:

1. **Improve the accuracy and reliability of recognition**: By fusing features from phase signals, respiration signals, and heartbeat signals, and using the correlation and complementarity between different modal signals, the recognition effect is enhanced.
2. **Overcome the limitations of single - modal signals**: Traditional recognition algorithms usually rely on a single signal (such as respiration or heartbeat) and are easily affected by signal similarity or noise. The multi - modal fusion method proposed in the paper can effectively alleviate these problems.
3. **Deal with environmental noise and signal interference**: Millimeter - wave radar signals are easily affected by non - linear noise, respiration harmonics, and harmonic interference. The algorithm designed in the paper can better handle these complex signals.

### Core problems of the paper
The paper has conducted research and improvement on the following problems:
- **Limitations of single - modal signals**: Traditional algorithms rely on a single signal (such as respiration or heartbeat), but these signals may have high similarity. Especially in multi - person scenarios, the recognition accuracy will decrease significantly.
- **Signal quality and noise problems**: The signal - to - noise ratio of the heartbeat signal is low, and the respiration signal is easily affected by environmental noise, which limits the recognition performance.
- **Complexity of feature extraction**: Traditional methods require manual design of complex feature extraction algorithms, which are inefficient and difficult to comprehensively capture the patterns of vital sign signals.

### Solutions
The paper proposes an identity recognition algorithm based on multi - modal fusion. The main innovation points include:
1. **Multi - modal feature extraction and fusion**: Extract features from phase signals, respiration signals, and heartbeat signals, perform spatial feature extraction through the Residual Network (ResNet), and then use the Spatial - Channel Attention Fusion Module to achieve feature fusion.
2. **Time - series self - attention mechanism**: Further extract time features to improve the ability to model dynamic signals.
3. **Experimental verification**: Use the IWR1642 radar system to build a vital sign data collection system, generate a data set containing 20 volunteers, and verify the effectiveness and superiority of the algorithm.

Through the above methods, the paper has achieved a recognition accuracy of 94.26%, which is significantly higher than that of traditional algorithms (about 85%). This shows that the multi - modal fusion method has obvious advantages in improving recognition accuracy and robustness.