跳到主要导航 跳到搜索 跳到主要内容

Binarized High-Efficiency RAW Video Restoration and Beyond

  • Tianyu Zhu
  • , Ying Fu*
  • , Hesong Li
  • , Gengchen Zhang
  • , Xin Yuan
  • , Yulun Zhang
  • *此作品的通讯作者
  • Beijing Institute of Technology
  • Chinese Aeronautical Establishment
  • Westlake University
  • Shanghai Jiao Tong University

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

RAW video restoration is fundamental to high-quality low-level perception and serves as the basis for a wide range of downstream vision applications. While binary neural networks (BNNs) enable efficient lightweight deployment for image enhancement, their deficiencies in modeling temporal coherence and activation value distributions hinder their effectiveness when applied to video scenarios. In this paper, we propose BinRVR, a binarized RAW video restoration framework that reduces computation and parameters by approximately 96% while incurring only about 4% performance degradation. Specifically, we present a Binarized Information Interaction Module (BIIM) to jointly model spatial and temporal information in an efficient and unified manner. Moreover, we develop a Distribution-Aware Binarized Convolution (DAB-Conv) that leverages the statistics of full-precision activations to mitigate quantization errors. The proposed framework further supports multi-bit quantization, enabling flexible accuracy-efficiency trade-offs across different hardware constraints. Extensive experiments demonstrate that our BinRVR achieves competitive performance compared with state-of-the-art binarized methods on RAW video restoration tasks, including low-light enhancement, denoising, deblurring, and super-resolution. We further explore the potential of our method on downstream video applications, including object detection and monocular depth estimation.

源语言英语
期刊IEEE Transactions on Pattern Analysis and Machine Intelligence
DOI
出版状态已接受/待刊 - 2026
已对外发布是

学术指纹

探究 'Binarized High-Efficiency RAW Video Restoration and Beyond' 的科研主题。它们共同构成独一无二的学术指纹。

引用此