Hyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment

Wang Yu-chen,Kong Ling-qin,Zhao Yue-jin,Dong Li-quan,Liu Ming,Hui Mei
DOI: https://doi.org/10.3964/j.issn.1000-0593(2023)10-3193-09
2023-01-01
Spectroscopy and spectral analysis
Abstract:Tissue Oxygenation is an important indicator of blood perfusion and oxygenation in tissues and blood. It is of great significance in clinical diagnosis and daily monitoring. Hyperspectral imaging is a new method to evaluate StO(2) because of its non-contact and abundant spectral information. However, hyperspectral imaging equipment is expensive and complex to operate. These disadvantages limit its use environment and development. Traditional industrial cameras have a high spatial resolution of RGB images of skin tissue, but their spectral resolution is low. If the spectral resolution can be improved, it is possible to measure physiological parameters with high precision. This paper proposes a new method for estimating StO(2) based on hyperspectral reconstruction of RGB images. Based on the depth learning method, the reconstruction model from RGB image to the hyperspectral image of skin tissue is constructed, and the hyperspectral image of skin tissue with high reliability is obtained. Then, the spatial two-dimensional distribution of StO(2) is obtained using the improved Beer Lambert law formulations. This paper collected RGB images and hyperspectral images of hands of 49 subjects under different blood perfusion conditions using a common visible light camera and a hyperspectral camera as data sets. Based on the dimensionality reduction and denoising of hyperspectral images, the 450 similar to 600 nm (including 31 spectral channels) bands were selected as the reconstructed spectral bands according to the characteristic spectra of oxyhemoglobin and deoxyhemoglobin. The convolutional neural networks for spectral reconstruction of skin tissue based on depth learning is constructed. The experimental results show that the skin reflectance spectra obtained by the reconstructed model are in good agreement with those obtained by the hyperspectral camera, and the mean absolute error (MAE) between the two in the test set is 0.00938, the root mean square error (RMSE) was 0.01481. Then the similarity between the StO(2) measurements from the reconstructed model and those from the hyperspectral camera was quantitatively evaluated. We used the samples in the test set to generate the StO(2) spatial distribution maps by two methods respectively, and the two-dimensional correlation coefficients between them were in the reliable range (greater than 94%). These results show that the proposed method based on hyperspectral reconstruction of visible light images is reliable. This study provided a simple and low-cost method of StO(2) monitoring for clinical diagnosis and monitoring of various diseases.
What problem does this paper attempt to address?