Compact colorful compressive spectral imager based on deep learning reconstruction

  • Jinshan Li
  • , Xu Ma*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Leveraging the spatio-spectral modulation and sophisticated reconstruction algorithms, the colorful compressive spectral imaging (CCSI) method can reconstruct a three-dimensional spectral image from a single compressive measurement.Primary CCSI systems enhance the modulation freedom through the combination of colorful coding mask (CCM) and dispersive element, but this kind of system has complex structure that limits the miniaturization of system.Furthermore, the reconstruction quality of CCSI systems can be further improved by using deep learning algorithms.This paper proposes a compact CCSI method based on deep learning reconstruction, which tries to reduce the volume of system by attaching the CCM to the detector.The combination of CCM and RGB detector enhances the modulation freedom.Additionally, a Transformer-based deep learning algorithm is used to obtain promising reconstruction results of the target spectral images.Results of both simulations and experiments demonstrate the effectiveness of the proposed compact CSSI method.

Original languageEnglish
Title of host publicationInternational Conference on Image, Signal Processing, and Pattern Recognition, ISPP 2024
EditorsRam Bilas Pachori, Lei Chen
PublisherSPIE
ISBN (Electronic)9781510680425
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event2024 International Conference on Image, Signal Processing, and Pattern Recognition, ISPP 2024 - Guangzhou, China
Duration: 8 Mar 202410 Mar 2024

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume13180
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2024 International Conference on Image, Signal Processing, and Pattern Recognition, ISPP 2024
Country/TerritoryChina
CityGuangzhou
Period8/03/2410/03/24

Keywords

  • compressive sensing
  • compressive spectral imaging
  • Computational imaging
  • deep learning

Fingerprint

Dive into the research topics of 'Compact colorful compressive spectral imager based on deep learning reconstruction'. Together they form a unique fingerprint.

Cite this