Skip to main navigation Skip to search Skip to main content

Hysat++: Hybrid Spectral-Wise Attention Transformer for Skin Spectral Reconstruction

  • Yuchen Wang
  • , Hongyuan Wang
  • , Jiang Xu
  • , Chang Chen
  • , Xue Hu
  • , Fenglong Song
  • , Lizhi Wang*
  • *Corresponding author for this work
  • Beijing Institute of Technology
  • Huawei Technologies Co., Ltd.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Hyperspectral imaging captures detailed spatial-spectral information across a wide range of wavelengths, offering a comprehensive and non-invasive method for skin analysis. In this paper, we propose a novel Hybrid Spectral-wise Attention Transformer (HySAT++) for facial skin scenarios, aimed at reconstructing skin hyperspectral images in the visible and near-infrared spectrum from facial skin multispectral data. HySAT++ simultaneously model spectral-wise similarity and particularity, and incorporates the Spectral Angle Mapper (SAM) loss as a part of the loss function. This work ranked first in the ICASSP 2024 SP Grand Challenge on Hyperspec-tral Skin Vision.

Original languageEnglish
Title of host publication2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops, ICASSPW 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages87-88
Number of pages2
ISBN (Electronic)9798350374513
DOIs
Publication statusPublished - 2024
Event2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops, ICASSPW 2024 - Seoul, Korea, Republic of
Duration: 14 Apr 2024 → 19 Apr 2024

Publication series

Name2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops, ICASSPW 2024 - Proceedings

Conference

Conference2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops, ICASSPW 2024
Country/TerritoryKorea, Republic of
CitySeoul
Period14/04/24 → 19/04/24

Keywords

  • facial skin
  • Hyperspectral imaging
  • spectral reconstruction
  • transformer

Fingerprint

Dive into the research topics of 'Hysat++: Hybrid Spectral-Wise Attention Transformer for Skin Spectral Reconstruction'. Together they form a unique fingerprint.

Cite this