Homogeneous Low-Resolution Face Recognition Method based Correlation Features

Xuan Zhao

DOI: https://doi.org/10.48550/arXiv.2111.13175

2021-11-26

Abstract:Face recognition technology has been widely adopted in many mission-critical scenarios like means of human identification, controlled admission, and mobile device access, etc. Security surveillance is a typical scenario of face recognition technology. Because the low-resolution feature of surveillance video and images makes it difficult for high-resolution face recognition algorithms to extract effective feature information, Algorithms applied to high-resolution face recognition are difficult to migrate directly to low-resolution situations. As face recognition in security surveillance becomes more important in the era of dense urbanization, it is essential to develop algorithms that are able to provide satisfactory performance in processing the video frames generated by low-resolution surveillance cameras. This paper study on the Correlation Features-based Face Recognition (CoFFaR) method which using for homogeneous low-resolution surveillance videos, the theory, experimental details, and experimental results are elaborated in detail. The experimental results validate the effectiveness of the correlation features method that improves the accuracy of homogeneous face recognition in surveillance security scenarios.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems Addressed by the Paper

This paper aims to address the problem of face recognition in low-resolution surveillance videos. Specifically, due to the low-resolution nature of surveillance videos and images, high-resolution face recognition algorithms find it difficult to extract effective feature information, making these algorithms inapplicable to low-resolution scenarios. With the acceleration of urbanization, the application of surveillance systems in public safety is becoming increasingly widespread, making it particularly important to develop face recognition algorithms that can provide satisfactory performance in low-resolution surveillance videos.

### Background and Motivation

1. **Application Scenarios**:
- Face recognition technology has been widely applied in many critical scenarios, such as identity verification, access control, and mobile device access.
- Security surveillance is a typical application scenario for face recognition technology.

2. **Challenges**:
- The low-resolution nature of surveillance videos and images makes it difficult for high-resolution face recognition algorithms to extract effective feature information.
- High-resolution face recognition algorithms are hard to directly transfer to low-resolution scenarios.

3. **Research Significance**:
- Against the backdrop of accelerated urbanization, the application of surveillance systems in public safety is becoming increasingly widespread, making it significant to develop face recognition algorithms suitable for low-resolution surveillance videos.

### Solution

This paper proposes a low-resolution face recognition method based on correlation features (Correlation Features-based Face Recognition, CoFFaR). The main contributions include:

1. **Proposing the CoFFaR Method**:
- Based on correlation feature extraction, the effectiveness of this method is mathematically proven.

2. **Data Preprocessing Methods**:
- Two different data generation methods are proposed: Symmetric Generating Method and Exhaustively Arranged Method, which significantly increase the amount of learning data and improve the specificity of correlation features.

3. **Experimental Validation**:
- The effectiveness of the CoFFaR method is validated through multiple comparative experiments and comprehensively compared with other models.

### Experimental Results

- **Dataset**:
- The QMUL-SurvFace dataset was used, containing 15,573 unique identities and 463,507 facial images, which come from real surveillance videos rather than artificially downsampled high-resolution images.

- **Performance Metrics**:
- Various performance metrics were used for evaluation, including True Acceptance Rate (TAR), False Acceptance Rate (FAR), TAR@FAR, Accuracy, etc.

- **Experimental Results**:
- The CoFFaR method achieved an average accuracy of 82.56% on the low-resolution image dataset, outperforming other methods.

### Conclusion and Future Work

- **Conclusion**:
- This paper significantly increases the amount of learning data and improves the specificity of correlation features through further research on the low-resolution face recognition method based on correlation features (CoFFaR). Experimental results show that the CoFFaR method performs excellently in the task of face recognition in low-resolution surveillance videos.

- **Future Work**:
- Explore the application effect of the correlation feature method in heterogeneous face recognition scenarios.
- Study the performance evaluation and application of the algorithm in embedded systems.

### Summary

This paper addresses the problem of face recognition in low-resolution surveillance videos by proposing a correlation feature-based method (CoFFaR) and validating its effectiveness through experiments. Future research directions will include exploring the application of this method in heterogeneous face recognition scenarios and performance evaluation in embedded systems.