TY - JOUR
T1 - High-Accuracy Image Formation Model for Coded Aperture Snapshot Spectral Imaging
AU - Song, Lingfei
AU - Wang, Lizhi
AU - H. Kim, Min
AU - Huang, Hua
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2022
Y1 - 2022
N2 - Coded aperture snapshot spectral imaging (CASSI) is based on the binary modulation of the spatial-spectral scene, which allows for hyperspectral image reconstruction from 2D compressive measurement. However, the actual optical modulation does not match the current image formation model due to the extra optical phenomena, such as diffraction, distortion, optical misalignment, and dispersion, inside the system. It is a long-lasting problem that the gap between the simplified image formation model and the actual optical modulation degrades the reconstruction quality. In this paper, we propose a high-accuracy image formation model to reduce this gap in CASSI. Specifically, we first reformulate the spectral modulation as channel-wise convolution, in which the convolution kernel represents the point-spread-function (PSF) of each spectral channel. Then, according to our key observation that the calibration images are the blurred versions of the coded aperture, we propose to estimate the PSF by exploring the relationship between these blurred and non-blurred pairs. In addition, we also provide a theoretical analysis of the PSF's influences on the reconstruction quality, which can serve as a guide for CASSI system implementation. Our simulations and real system experiments demonstrate the effectiveness of the proposed model.
AB - Coded aperture snapshot spectral imaging (CASSI) is based on the binary modulation of the spatial-spectral scene, which allows for hyperspectral image reconstruction from 2D compressive measurement. However, the actual optical modulation does not match the current image formation model due to the extra optical phenomena, such as diffraction, distortion, optical misalignment, and dispersion, inside the system. It is a long-lasting problem that the gap between the simplified image formation model and the actual optical modulation degrades the reconstruction quality. In this paper, we propose a high-accuracy image formation model to reduce this gap in CASSI. Specifically, we first reformulate the spectral modulation as channel-wise convolution, in which the convolution kernel represents the point-spread-function (PSF) of each spectral channel. Then, according to our key observation that the calibration images are the blurred versions of the coded aperture, we propose to estimate the PSF by exploring the relationship between these blurred and non-blurred pairs. In addition, we also provide a theoretical analysis of the PSF's influences on the reconstruction quality, which can serve as a guide for CASSI system implementation. Our simulations and real system experiments demonstrate the effectiveness of the proposed model.
KW - Hyperspectral image reconstruction
KW - coded aperture snapshot spectral imaging
KW - compressive sensing
KW - image formation model
KW - point spread function
UR - http://www.scopus.com/inward/record.url?scp=85126267887&partnerID=8YFLogxK
U2 - 10.1109/TCI.2022.3153227
DO - 10.1109/TCI.2022.3153227
M3 - Article
AN - SCOPUS:85126267887
SN - 2333-9403
VL - 8
SP - 188
EP - 200
JO - IEEE Transactions on Computational Imaging
JF - IEEE Transactions on Computational Imaging
ER -