Abstract:Tissue Oxygenation is an important indicator of blood perfusion and oxygenation in tissues and blood. It is of great significance in clinical diagnosis and daily monitoring. Hyperspectral imaging is a new method to evaluate StO(2) because of its non-contact and abundant spectral information. However, hyperspectral imaging equipment is expensive and complex to operate. These disadvantages limit its use environment and development. Traditional industrial cameras have a high spatial resolution of RGB images of skin tissue, but their spectral resolution is low. If the spectral resolution can be improved, it is possible to measure physiological parameters with high precision. This paper proposes a new method for estimating StO(2) based on hyperspectral reconstruction of RGB images. Based on the depth learning method, the reconstruction model from RGB image to the hyperspectral image of skin tissue is constructed, and the hyperspectral image of skin tissue with high reliability is obtained. Then, the spatial two-dimensional distribution of StO(2) is obtained using the improved Beer Lambert law formulations. This paper collected RGB images and hyperspectral images of hands of 49 subjects under different blood perfusion conditions using a common visible light camera and a hyperspectral camera as data sets. Based on the dimensionality reduction and denoising of hyperspectral images, the 450 similar to 600 nm (including 31 spectral channels) bands were selected as the reconstructed spectral bands according to the characteristic spectra of oxyhemoglobin and deoxyhemoglobin. The convolutional neural networks for spectral reconstruction of skin tissue based on depth learning is constructed. The experimental results show that the skin reflectance spectra obtained by the reconstructed model are in good agreement with those obtained by the hyperspectral camera, and the mean absolute error (MAE) between the two in the test set is 0.00938, the root mean square error (RMSE) was 0.01481. Then the similarity between the StO(2) measurements from the reconstructed model and those from the hyperspectral camera was quantitatively evaluated. We used the samples in the test set to generate the StO(2) spatial distribution maps by two methods respectively, and the two-dimensional correlation coefficients between them were in the reliable range (greater than 94%). These results show that the proposed method based on hyperspectral reconstruction of visible light images is reliable. This study provided a simple and low-cost method of StO(2) monitoring for clinical diagnosis and monitoring of various diseases.

Facial StO2: A New Promising Biometric Identity.

Baseline-independent Stress Classification Based on Facial StO2

Evolution of Facial Tissue Oxygen Saturation and Detection of Human Physical Stress

Human Stress And Sto2: Database, Features, And Classification Of Emotional And Physical Stress

Stress recognition based on graph structure representation of facial StO2.

A Fusion Shallow and Deep Features Network for Facial StO2 Stress Classification

Joint Global and Local Feature Learning Based on Facial StO2 for Stress Recognition.

A Stimulus-Response Based EEG Biometric Using Mallows Distance

Hyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment

Non-invasive Blood Oxygen Saturation Detection with Video Image

A Handheld Technology for Optical Monitoring of Transcutaneous Blood Oxygen Saturation

Non-Contact Psychological Stress Detection Combining Heart Rate Variability and Facial Expressions

A Non-Contact Oxygen Saturation Detection Method Based on Dynamic Spectrum

StO2 Stress Detection Based on Fewer Wavelengths Through Linear Prediction Algorithm

CCSpO2Net: Camera-Based Contactless Oxygen Saturation Measurement Foundation Model in Clinical Settings

Wavelength Selection for Real-Time Detection of Human Stress Based on StO2

Automatic Segmentation of Facial Regions of Interest and Stress Detection Using Machine Learning

Using Contactless Facial Image Recognition Technology to Detect Blood Oxygen Saturation

Leveraging 3D convolutional neural network and 3D visible-near-infrared multimodal imaging for enhanced contactless oximetry

Mental Stress Recognition based on Non-invasive and Non-contact Measurement from Stereo Thermal and Visible Sensors

A Novel Earprint: Stimulus-Frequency Otoacoustic Emission for Biometric Recognition