TY - JOUR
T1 - Structured Illumination Microscopy With Uncertainty-Guided Deep Learning
AU - Chang, Xuyang
AU - Zhu, Xiaoqin
AU - Feng, Yibo
AU - Chen, Zhenyue
AU - Bian, Liheng
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2025
Y1 - 2025
N2 - Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.
AB - Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.
KW - bayesian neural network
KW - Structured illumination microscopy
KW - uncertainty quantification
KW - uncertainty-guided attention mechanism
UR - http://www.scopus.com/inward/record.url?scp=105003209167&partnerID=8YFLogxK
U2 - 10.1109/TCI.2025.3550715
DO - 10.1109/TCI.2025.3550715
M3 - Article
AN - SCOPUS:105003209167
SN - 2333-9403
VL - 11
SP - 389
EP - 398
JO - IEEE Transactions on Computational Imaging
JF - IEEE Transactions on Computational Imaging
ER -