TY - JOUR
T1 - Fine-Grained Ship Recognition With Spatial-Aligned Feature Pyramid Network and Adaptive Prototypical Contrastive Learning
AU - Li, Yangfan
AU - Chen, Liang
AU - Li, Wei
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2025
Y1 - 2025
N2 - Fine-grained ship recognition endeavors to accurately locate ship targets and recognize their respective fine-grained categories. Current ship recognition methods primarily rely on the feature pyramid network (FPN) for extracting multiscale features. However, FPN exhibits a spatial misalignment issue when fusing features from adjacent-scale feature maps, leading to an inability to extract fine-grained features. Consequently, this limitation constrains the fine-grained recognition capabilities of these recognition methods. Moreover, ship targets possess a high level of intraclass diversity and interclass similarity, yet existing recognition models struggle to extract features with strong category separability, resulting in weakened fine-grained ship recognition performance. In order to solve the spatial misalignment problem that occurs in FPN, a spatial-aligned FPN (SAFPN) is investigated. SAFPN employs a spatial-aware alignment fusion module (SAFM) to effectively extract rich fine-grained features between adjacent-scale feature maps. Moreover, in response to the challenge posed by low category separability in features due to the intraclass diversity and interclass similarity among ship targets, an adaptive prototypical contrastive learning (APCL) method is further proposed. By introducing prototypical contrastive loss, APCL effectively enhances the category separability of ship features, thereby improving the performance of fine-grained ship recognition. Numerous experiments are validated on two fine-grained ship recognition datasets: FGSD and ShipRSImageNet. The experimental results demonstrate that the proposed SAFPN and APCL facilitate the model in extracting fine-grained features with strong category separability, effectively enhancing the performance of fine-grained ship recognition. Our code will be public and available at https://github.com/liyangfan0/Fine-Grained-Ship-Recognition.
AB - Fine-grained ship recognition endeavors to accurately locate ship targets and recognize their respective fine-grained categories. Current ship recognition methods primarily rely on the feature pyramid network (FPN) for extracting multiscale features. However, FPN exhibits a spatial misalignment issue when fusing features from adjacent-scale feature maps, leading to an inability to extract fine-grained features. Consequently, this limitation constrains the fine-grained recognition capabilities of these recognition methods. Moreover, ship targets possess a high level of intraclass diversity and interclass similarity, yet existing recognition models struggle to extract features with strong category separability, resulting in weakened fine-grained ship recognition performance. In order to solve the spatial misalignment problem that occurs in FPN, a spatial-aligned FPN (SAFPN) is investigated. SAFPN employs a spatial-aware alignment fusion module (SAFM) to effectively extract rich fine-grained features between adjacent-scale feature maps. Moreover, in response to the challenge posed by low category separability in features due to the intraclass diversity and interclass similarity among ship targets, an adaptive prototypical contrastive learning (APCL) method is further proposed. By introducing prototypical contrastive loss, APCL effectively enhances the category separability of ship features, thereby improving the performance of fine-grained ship recognition. Numerous experiments are validated on two fine-grained ship recognition datasets: FGSD and ShipRSImageNet. The experimental results demonstrate that the proposed SAFPN and APCL facilitate the model in extracting fine-grained features with strong category separability, effectively enhancing the performance of fine-grained ship recognition. Our code will be public and available at https://github.com/liyangfan0/Fine-Grained-Ship-Recognition.
KW - Contrastive learning
KW - feature pyramid network (FPN)
KW - fine-grained ship recognition
KW - remote sensing images
KW - spatial aligned
UR - http://www.scopus.com/inward/record.url?scp=85214314026&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2024.3524621
DO - 10.1109/TGRS.2024.3524621
M3 - Article
AN - SCOPUS:85214314026
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5604313
ER -