TY - JOUR
T1 - Interactive image segmentation based field boundary perception method and software for autonomous agricultural machinery path planning
AU - Wang, Hao
AU - Ma, Zhifeng
AU - Ren, Yaxin
AU - Du, Siqi
AU - Lu, Hao
AU - Shang, Yehua
AU - Hu, Shupeng
AU - Zhang, Guangqiang
AU - Meng, Zhijun
AU - Wen, Changkai
AU - Fu, Weiqiang
N1 - Publisher Copyright:
© 2023 Elsevier B.V.
PY - 2024/2
Y1 - 2024/2
N2 - Autonomous agricultural machinery path planning requires high-precision field boundary information. To address the challenge of rapidly acquiring accurate information about different types of land objects in complex field scenarios, this study introduces an interactive segmentation-based method and software for agricultural field boundary perception, specifically designed for high-resolution orthophotos. The method aims to accurately delineate various agricultural objects in the image, such as crops, soil, roads, edges, exits to fields, and obstacles. Compared to previous research on agricultural object detection and segmentation, this study proposes an interactive deep image segmentation model for perceiving multiple types of agricultural features. During the image segmentation process, manually adding positive and negative points provides supervised information for the segmentation of agricultural images. In addition, this research uses the PaddlePaddle deep learning framework to implement the proposed method and extends the open-source software EISeg to develop a dedicated tool for agricultural image segmentation. Through 3 to 4 interactive iterations, the method achieves an impressive mean Intersection over Union (mIoU) segmentation accuracy of about 90%. The model's average inference time on the training server was 0.197 s, meeting the real-time requirements of the interactive segmentation method. By accurately segmenting agricultural land features from high-resolution orthoimagery, the proposed method can provide valuable support for the construction of high-precision navigation maps for autonomous agricultural machinery.
AB - Autonomous agricultural machinery path planning requires high-precision field boundary information. To address the challenge of rapidly acquiring accurate information about different types of land objects in complex field scenarios, this study introduces an interactive segmentation-based method and software for agricultural field boundary perception, specifically designed for high-resolution orthophotos. The method aims to accurately delineate various agricultural objects in the image, such as crops, soil, roads, edges, exits to fields, and obstacles. Compared to previous research on agricultural object detection and segmentation, this study proposes an interactive deep image segmentation model for perceiving multiple types of agricultural features. During the image segmentation process, manually adding positive and negative points provides supervised information for the segmentation of agricultural images. In addition, this research uses the PaddlePaddle deep learning framework to implement the proposed method and extends the open-source software EISeg to develop a dedicated tool for agricultural image segmentation. Through 3 to 4 interactive iterations, the method achieves an impressive mean Intersection over Union (mIoU) segmentation accuracy of about 90%. The model's average inference time on the training server was 0.197 s, meeting the real-time requirements of the interactive segmentation method. By accurately segmenting agricultural land features from high-resolution orthoimagery, the proposed method can provide valuable support for the construction of high-precision navigation maps for autonomous agricultural machinery.
KW - Instance and semantic segmentation
KW - Orthoimagery
KW - Semi-supervised learning
KW - UAV
KW - Weakly supervised deep learning
UR - http://www.scopus.com/inward/record.url?scp=85181036300&partnerID=8YFLogxK
U2 - 10.1016/j.compag.2023.108568
DO - 10.1016/j.compag.2023.108568
M3 - Article
AN - SCOPUS:85181036300
SN - 0168-1699
VL - 217
JO - Computers and Electronics in Agriculture
JF - Computers and Electronics in Agriculture
M1 - 108568
ER -