Data-Driven Band Optimization and Frequency-Aware Modeling in Medical Hyperspectral Image Segmentation

Hyperspectral imaging delivers high-resolution spectral-spatial information to support molecular tissue characterization, but its clinical utility is far from being fully realized. Existing segmentation techniques are constrained by fixed or suboptimal band selection strategies and insufficient frequency-domain modeling, which limit their ability to fully exploit discriminative spectral cues and subtle tissue structures. To address these challenges, we propose AMBS-SF²Net, a unified framework that enhances spectral representation and hierarchical frequency modeling for accurate and efficient segmentation. Specifically, the Adaptive Mask-based Band Selection (AMBS) module dynamically identifies informative spectral channels, the Adaptive Spectral-Frequency Integration (ASFI) module fuses multi-scale spatial edges and frequency-aware spectral features, and the Multi-Axis Frequency Enhanced (MAFE) module captures complementary spectral and spatial frequency patterns along different tensor dimensions. To rigorously evaluate the method’s generalizability, we conduct extensive experiments on datasets spanning distinct imaging scales, comprising a microscopic cholangiocarcinoma pathology dataset and two macroscopic tissue datasets of pig abdominal organs and human placenta. Results demonstrate that AMBS-SF²Net significantly outperforms state-of-the-art methods, exhibiting superior robustness across varying spectral resolutions and spatial modalities, thereby validating its strong potential for diverse clinical applications.