Abstract:3D biometric techniques on finger traits have become a new trend and have demonstrated a powerful ability for recognition and anti-counterfeiting. Existing methods follow an explicit 3D pipeline that reconstructs the models first and then extracts features from 3D models. However, these explicit 3D methods suffer from the following problems: 1) Inevitable information dropping during 3D reconstruction; 2) Tight coupling between specific hardware and algorithm for 3D reconstruction. It leads us to a question: Is it indispensable to reconstruct 3D information explicitly in recognition tasks? Hence, we consider this problem in an implicit manner, leaving the nerve-wracking 3D reconstruction problem for learnable neural networks with the help of neural radiance fields (NeRFs). We propose FingerNeRF, a novel generalizable NeRF for 3D finger biometrics. To handle the shape-radiance ambiguity problem that may result in incorrect 3D geometry, we aim to involve extra geometric priors based on the correspondence of binary finger traits like fingerprints or finger veins. First, we propose a novel Trait Guided Transformer (TGT) module to enhance the feature correspondence with the guidance of finger traits. Second, we involve extra geometric constraints on the volume rendering loss with the proposed Depth Distillation Loss and Trait Guided Rendering Loss. To evaluate the performance of the proposed method on different modalities, we collect two new datasets: SCUT-Finger-3D with finger images and SCUT-FingerVein-3D with finger vein images. Moreover, we also utilize the UNSW-3D dataset with fingerprint images for evaluation. In experiments, our FingerNeRF can achieve 4.37% EER on SCUT-Finger-3D dataset, 8.12% EER on SCUT-FingerVein-3D dataset, and 2.90% EER on UNSW-3D dataset, showing the superiority of the proposed implicit method in 3D finger biometrics.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **How to avoid the limitations of explicit 3D reconstruction in 3D finger feature recognition tasks, thereby improving recognition performance and generalization ability**. Specifically, existing 3D finger feature recognition methods usually rely on an explicit 3D reconstruction process, that is, first reconstruct 3D models and then extract features from these 3D models. However, this method has the following problems: 1. **Information loss**: During the explicit 3D reconstruction process, some information will inevitably be lost, which will affect the performance of the final recognition task. 2. **Tight coupling between hardware and algorithms**: Explicit 3D reconstruction methods usually rely on specific hardware devices and algorithms and are difficult to transfer to other modalities or devices. To solve these problems, the author proposes an implicit method based on Neural Radiance Field (NeRF), called **FingerNeRF**. This method implicitly models 3D space through a neural network instead of performing 3D reconstruction explicitly. To deal with the shape - radiance ambiguity problem, the author introduces additional geometric prior information and proposes two key technical modules: 1. **Trait Guided Transformer (TGT)**: Enhance the cross - view feature map through the self - attention mechanism, and use finger features (such as fingerprints or finger veins) to guide the construction of the cost volume. 2. **Depth Distillation Loss and Trait Guided Rendering Loss**: Add additional depth constraints in neural rendering training to ensure that the generated depth map is reasonable. In addition, the author also collected two new datasets (SCUT - Finger - 3D and SCUT - FingerVein - 3D) and used the existing UNSW - 3D dataset to evaluate the performance of FingerNeRF. The experimental results show that FingerNeRF performs better than existing methods in different modalities, verifying the effectiveness and superiority of this method. ### Summary The core problem of the paper is to explore a 3D finger feature recognition method that does not rely on explicit 3D reconstruction to overcome the information loss and hardware - dependence problems in existing methods. By introducing the implicit neural radiance field and additional geometric constraints, FingerNeRF provides a more robust and more general solution.

Improving 3D Finger Traits Recognition via Generalizable Neural Rendering

MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images

3D palmprint recognition using shape index representation and fragile bits

Suspecting Less and Doing Better: New Insights on Palmprint Identification for Faster and More Accurate Matching

Contactless 3D Fingerprint Identification Without 3D Reconstruction.

Study of 3D Finger Vein Biometrics on Imaging Device Design and Multi-View Verification

3D Visibility-aware Generalizable Neural Radiance Fields for Interacting Hands

Curvature gray feature decomposition based finger vein recognition with an improved convolutional neural network

From Noise to Feature: Exploiting Intensity Distribution as a Novel Soft Biometric Trait for Finger Vein Recognition

HandNeRF: Neural Radiance Fields for Animatable Interacting Hands

An Efficient Joint Bayesian Model with Soft Biometric Traits for Finger Vein Recognition

An optimized deep learning based depthwise separable MobileNetV3 approach for automatic finger vein recognition system

MMRAN: A novel model for finger vein recognition based on a residual attention mechanism

Robust and Sparse Least Square Regression for Finger Vein and Finger Knuckle Print Recognition

The Biometric Recognition System Based on Near-Infrared Finger Vein Image

A Novel ROI Extraction Method Based on the Characteristics of the Original Finger Vein Image

A Novel 2D Contactless Fingerprint Matching Method

Visual Feature-Guided Diamond Convolutional Network for Finger Vein Recognition

Joint Identity Verification and Pose Alignment for Partial Fingerprints

A Novel Finger Vein Recognition Method Based on Aggregation of Radon-Like Features

Toward Cross-Dataset Finger Vein Recognition With Single-Source Data