Image-free classification via few-shot learning

Songbo Wan, Xuyang Chang, Liheng Bian*

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In recent years, deep learning has exhibited remarkable performance in image classification. Nevertheless, traditional deep-learning-based techniques heavily depend on the availability of high-quality images for conveying information. This reliance results in the inefficient utilization of hardware and software resources across various stages, including image acquisition, storage, and processing. Additionally, these techniques often necessitate substantial amounts of data to effectively learn the underlying mapping, posing challenges in practical scenarios where acquiring a sufficient volume of paired data proves difficult. In this paper, we introduce a novel approach for image-free few-shot recognition by using a single-pixel detector. Our method comprises two fundamental stages. First, we design a neural network that integrates encoding and decoding modules, which can learn optimized encoding masks based on the statistical priors. Second, we employ these optimized masks to generate compressed 1D measurements. Subsequently, these measurements are fed into the classification network, preceded by the decoding module trained during the initial stage. The parameters of this decoding module serve as the initialization parameters for the subsequent stage of training. Furthermore, we incorporate a meta-training strategy, commonly used in few-shot classification, to mitigate dataset requirements during the second stage of training. Simulation results illustrate the effectiveness of our approach in image-free classification directly from 1D measurements, bypassing the time-consuming image reconstruction process. Our technique achieves a substantial reduction in data volume by two orders of magnitude while relying on only a limited number of paired data samples.

源语言英语
主期刊名Optoelectronic Imaging and Multimedia Technology X
编辑Qionghai Dai, Tsutomu Shimura, Zhenrong Zheng
出版商SPIE
ISBN(电子版)9781510667839
DOI
出版状态已出版 - 2023
活动Optoelectronic Imaging and Multimedia Technology X 2023 - Beijing, 中国
期限: 15 10月 202316 10月 2023

出版系列

姓名Proceedings of SPIE - The International Society for Optical Engineering
12767
ISSN(印刷版)0277-786X
ISSN(电子版)1996-756X

会议

会议Optoelectronic Imaging and Multimedia Technology X 2023
国家/地区中国
Beijing
时期15/10/2316/10/23

指纹

探究 'Image-free classification via few-shot learning' 的科研主题。它们共同构成独一无二的指纹。

引用此