A mosaic method for multichannel sequence starry images via multiscale edge-preserving spatio-temporal context filtering

Zhijia Yang, Xiaozheng Liu, Yuxuan Mao, Tinghua Zhang, Kun Gao*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Astronomical observation and spatial target surveillance applications often require mosaic processing of starry images acquired by multiple image sensors to expand the Fields of View (FOV) or improve the resolutions. Due to the low SNR (Signal-to-Noise Ratio), lack of star point texture information and vulnerability of atmospheric turbulence of the starry image properties, traditional mosaic methods are prone to failures during feature point extraction. In this paper, Spatio-Temporal Context (STC) filtering is introduced as the preprocessing procedure to suppress the background interferences. We have improved the classical STC filtering and expands it into multi-scale space combining with Rolling-Guidance Filtering Algorithm (RGFA). Making full use of the fine edge-preserving feature of RGFA, the time-variant or spatial variant interference and noise in the background, such as glimmer stars, night clouds, sensor response noise, etc, are suppressed while the profiles of the target star points are enhanced and easy to extract their centroids. Then, we produced the feature description of the star-point sets via threshold segmentation and morphological algorithms based on geometric invariant cost function for the input image pairs to be stitched. After Random Sample Consensus (RANSAC) processing, the mismatched feature point pairs in the star-point sets are excluded. The subsequent procedures of the registration parameter calculation, image fusion and parallax correction processing are adopted to complete the mosaic processing. The results of digital simulation and practical processing show that the proposed method for the multichannel sequence starry images with the low SNR and complex backgrounds can extract feature points more precisely and more robustly comparing with the traditional methods. So, it is suitable for the large FOV spatial observation or surveillance applications.

Original languageEnglish
Title of host publication2019 International Conference on Optical Instruments and Technology
Subtitle of host publicationOptoelectronic Imaging/Spectroscopy and Signal Processing Technology
EditorsGuohai Situ, Xun Cao, Wolfgang Osten
PublisherSPIE
ISBN (Electronic)9781510636545
DOIs
Publication statusPublished - 2020
Event2019 International Conference on Optical Instruments and Technology: Optoelectronic Imaging/Spectroscopy and Signal Processing Technology - Beijing, China
Duration: 26 Oct 201928 Oct 2019

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11438
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2019 International Conference on Optical Instruments and Technology: Optoelectronic Imaging/Spectroscopy and Signal Processing Technology
Country/TerritoryChina
CityBeijing
Period26/10/1928/10/19

Keywords

  • Edge-Preserving Filter
  • Geometric Invariant Features
  • Image Sequence Mosaic
  • Spatio-Temporal Context
  • Star Background

Fingerprint

Dive into the research topics of 'A mosaic method for multichannel sequence starry images via multiscale edge-preserving spatio-temporal context filtering'. Together they form a unique fingerprint.

Cite this

Yang, Z., Liu, X., Mao, Y., Zhang, T., & Gao, K. (2020). A mosaic method for multichannel sequence starry images via multiscale edge-preserving spatio-temporal context filtering. In G. Situ, X. Cao, & W. Osten (Eds.), 2019 International Conference on Optical Instruments and Technology: Optoelectronic Imaging/Spectroscopy and Signal Processing Technology Article 114380Z (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11438). SPIE. https://doi.org/10.1117/12.2550260