$\textit{sweet}$- An Open Source Modular Platform for Contactless Hand Vascular Biometric Experiments

David Geissbühler,Sushil Bhattacharjee,Ketan Kotwal,Guillaume Clivaz,Sébastien Marcel
2024-09-11
Abstract:Current finger-vein or palm-vein recognition systems usually require direct contact of the subject with the apparatus. This can be problematic in environments where hygiene is of primary importance. In this work we present a contactless vascular biometrics sensor platform named \sweet which can be used for hand vascular biometrics studies (wrist, palm, and finger-vein) and surface features such as palmprint. It supports several acquisition modalities such as multi-spectral Near-Infrared (NIR), RGB-color, Stereo Vision (SV) and Photometric Stereo (PS). Using this platform we collect a dataset consisting of the fingers, palm and wrist vascular data of 120 subjects and develop a powerful 3D pipeline for the pre-processing of this data. We then present biometric experimental results, focusing on Finger-Vein Recognition (FVR). Finally, we discuss fusion of multiple modalities, such palm-vein combined with palm-print biometrics. The acquisition software, parts of the hardware design, the new FV dataset, as well as source-code for our experiments are publicly available for research purposes.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is that existing finger - vein or palm - vein recognition systems usually require direct contact between the user and the device, which may pose a risk of pathogen transmission in environments with strict hygiene requirements (such as hospitals). In addition, existing contact - based systems can usually only capture the vein image of a single finger at a time, limiting the recognition accuracy and user experience. ### Specific Problems and Solutions 1. **Hygiene Problem**: - **Problem**: Direct contact with biometric devices may lead to pathogen transmission, especially in medical environments. - **Solution**: A non - contact vascular biometric platform, named sweet, has been developed, which can collect hand vascular features (wrist, palm and finger veins) without contact. 2. **Multi - modal Data Collection**: - **Problem**: Existing finger - vein recognition systems usually collect data of a single modality, limiting the recognition performance. - **Solution**: The sweet platform supports multiple collection modes, including multispectral near - infrared (NIR), RGB color, stereo vision (SV) and photometric stereo (PS), so that data of multiple modalities can be fused to improve recognition accuracy. 3. **Data Set and Processing Pipeline**: - **Problem**: Existing finger - vein data sets are usually single - finger samples and cannot fully utilize multi - finger information. - **Solution**: A new data set containing finger, palm and wrist vascular data of 120 subjects has been collected using the sweet platform, and a powerful 3D processing pipeline has been developed for pre - processing these data. 4. **Recognition Accuracy**: - **Problem**: The recognition accuracy of existing finger - vein recognition systems is limited. - **Solution**: By fusing the vein image information of multiple fingers, the accuracy of finger - vein recognition (FVR) has been significantly improved, reducing the HTER (Half Total Error Rate) to 0.057%. ### Summary This paper solves the problems of existing finger - vein recognition systems in terms of hygiene, multi - modal data collection, data set and recognition accuracy by developing the sweet platform. The sweet platform can not only achieve non - contact high - precision finger - vein recognition, but also provide valuable data and technical support for future biometric research.