Calibration-Free Raw Image Denoising via Fine-Grained Noise Estimation

Yunhao Zou, Ying Fu*, Yulun Zhang, Tao Zhang, Chenggang Yan, Radu Timofte

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Image denoising has progressed significantly due to the development of effective deep denoisers. To improve the performance in real-world scenarios, recent trends prefer to formulate superior noise models to generate realistic training data, or estimate noise levels to steer non-blind denoisers. In this paper, we bridge both strategies by presenting an innovative noise estimation and realistic noise synthesis pipeline. Specifically, we integrates a fine-grained statistical noise model and contrastive learning strategy, with a unique data augmentation to enhance learning ability. Then, we use this model to estimate noise parameters on evaluation dataset, which are subsequently used to craft camera-specific noise distribution and synthesize realistic noise. One distinguishing feature of our methodology is its adaptability: our pre-trained model can directly estimate unknown cameras, making it possible to unfamiliar sensor noise modeling using only testing images, without calibration frames or paired training data. Another highlight is our attempt in estimating parameters for fine-grained noise models, which extends the applicability to even more challenging low-light conditions. Through empirical testing, our calibration-free pipeline demonstrates effectiveness in both normal and low-light scenarios, further solidifying its utility in real-world noise synthesis and denoising tasks.

Original languageEnglish
Pages (from-to)5368-5384
Number of pages17
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume47
Issue number7
DOIs
Publication statusPublished - 2025

Keywords

  • Contrastive learning
  • image denoising
  • low-light imaging
  • noise modeling
  • noise synthesis

Fingerprint

Dive into the research topics of 'Calibration-Free Raw Image Denoising via Fine-Grained Noise Estimation'. Together they form a unique fingerprint.

Cite this