A Deep Learning-Based Image Segmentation Model for Extracting Migratory Birds and Insects Echoes Using Polarimetric Weather Radar Data

Zhuoran Sun, Kai Cui*, Rui Wang, Zujing Yan, Mingming Ding, Dongli Wu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Weather radars are essential for monitoring airborne animals, including birds and insects. Despite the potential of dual-polarization radar moments for echo classification, extracting migration echoes from birds and insects at pixel-level remains challenging. In this study, six radar moments were rendered into two RGB images, and a deep learning-based image segmentation model was developed to extract bird and insect echoes at the pixel level. The model uses the typical encoder-decoder architecture. The ResNet-50 model was used to extract the features on different spatial scales, which was modified to accept six input channels, matching the six radar moments of polarimetric weather radar data during the encoding stages. The U-Net model was employed for multiscale feature fusion during the decoding stages. Training and validation on a manually labeled dataset demonstrated that the proposed method performs exceptionally well, achieving a mean intersection over union of 98%. The model's performance was further evaluated using two representative cases.

Original languageEnglish
Title of host publicationIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331515669
DOIs
Publication statusPublished - 2024
Event2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024 - Zhuhai, China
Duration: 22 Nov 202424 Nov 2024

Publication series

NameIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024

Conference

Conference2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Country/TerritoryChina
CityZhuhai
Period22/11/2424/11/24

Keywords

  • Birds
  • Deep learning
  • Image segmentation
  • Insects
  • Polarimetric weather radar

Cite this