Generative Adversarial Networks method of polarization 3D reconstruction based on meta-transfer learning

Yuxuan Mao*, Kun Gao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper makes a first attempt to combines meta-transfer learning and generative adversarial networks (GAN) technology to solve the Shape from Polarization (SfP) problem. To solve this physics-based ill-posed problem, some researchers choose to blend these physical models as priors into a neural network architecture however cannot meet the requirements of cross-domain and few-shot polarization data. This proposed approach put forward two innovative points. First, we design the meta-transfer method so adapt GAN for few-shot learning tasks. Second, we introduce physical priors between monocular polarization sequence and 3D normal vector into the generative loss term. We report to exceed the previous state-of-the-art on deepsfp dataset, showing the potential of meta-transfer learning in few-shot generative tasks.

Original languageEnglish
Title of host publicationNinth Symposium on Novel Photoelectronic Detection Technology and Applications
EditorsJunhao Chu, Wenqing Liu, Hongxing Xu
PublisherSPIE
ISBN (Electronic)9781510664432
DOIs
Publication statusPublished - 2023
Event9th Symposium on Novel Photoelectronic Detection Technology and Applications - Hefei, China
Duration: 21 Apr 202323 Apr 2023

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12617
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference9th Symposium on Novel Photoelectronic Detection Technology and Applications
Country/TerritoryChina
CityHefei
Period21/04/2323/04/23

Keywords

  • Shape from Polarization
  • generative adversarial networks
  • meta-transfer learning

Fingerprint

Dive into the research topics of 'Generative Adversarial Networks method of polarization 3D reconstruction based on meta-transfer learning'. Together they form a unique fingerprint.

Cite this