RGB图像高光谱重建的组织血氧饱和度评估

Translated title of the contribution: Hyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment

Yu Chen Wang, Ling Qin Kong*, Yue Jin Zhao, Li Quan Dong*, Ming Liu, Mei Hui

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Tissue Oxygenation is an important indicator of blood perfusion and oxygenation in tissues and blood. It is of great significance in clinical diagnosis and daily monitoring. Hyperspectral imaging is a new method to evaluate St02 because of its non-contact and abundant spectral information. However, hyperspectral imaging equipment is expensive and complex to operate. These disadvantages limit its use environment and development. Traditional industrial cameras have a high spatial resolution of RGB images of skin tissue, but their spectral resolution is low. If the spectral resolution can be improved, it is possible to measure physiological parameters with high precision. This paper proposes a new method for estimating St02 based on hyperspectral reconstruction of RGB images. Based on the depth learning method, the reconstruction model from RGB image to the hyperspectral image of skin tissue is constructed, and the hyperspectral image of skin tissue with high reliability is obtained. Then, the spatial two-dimensional distribution of St02 is obtained using the improved Beer Lambert law formulations. This paper collected RGB images and hyperspectral images of hands of 49 subjects under different blood perfusion conditions using a common visible light camera and a hyperspectral camera as data sets. Based on the dimensionality reduction and denoising of hyperspectral images, the 450~600 nm (including 31 spectral channels) bands were selected as the reconstructed spectral bands according to the characteristic spectra of oxyhemoglobin and deoxyhemoglobin. The convolutional neural networks for spectral reconstruction of skin tissue based on depth learning is constructed. The experimental results show that the skin reflectance spectra obtained by the reconstructed model are in good agreement with those obtained by the hyperspectral camera, and the mean absolute error (MAE) between the two in the test set is 0. 009 38, the root mean square error (RMSE) was 0. 014 81. Then the similarity between the St02 measurements from the reconstructed model and those from the hyperspectral camera was quantitatively evaluated. We used the samples in the test set to generate the St02 spatial distribution maps by two methods respectively, and the two-dimensional correlation coefficients between them were in the reliable range (greater than 94%). These results show that the proposed method based on hyperspectral reconstruction of visible light images is reliable. This study provided a simple and low-cost method of St02 monitoring for clinical diagnosis and monitoring of various diseases.

Translated title of the contributionHyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment
Original languageChinese (Traditional)
Pages (from-to)3193-3201
Number of pages9
JournalGuang Pu Xue Yu Guang Pu Fen Xi/Spectroscopy and Spectral Analysis
Volume43
Issue number10
DOIs
Publication statusPublished - 2023

Fingerprint

Dive into the research topics of 'Hyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment'. Together they form a unique fingerprint.

Cite this