FSNet: Pose estimation of endoscopic surgical tools using feature stacked network

Yakui Chu, Xilin Yang, Yuan Ding, Danni Ai, Jingfan Fan, Xu Li, Yongtian Wang, Jian Yang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Identification of surgical instruments is important to understand surgical scenarios and provide assistant processing in endoscopic image-guided surgery. In this paper, we propose a novel feature stacked network (FSNet) for the recognition of surgical tools in endoscopic images. With a lateral connection and concatenation operation on the different layers of the feature pyramid network, high-level semantic information is fused to low-level features, and the bounding boxes are regressed for the tool instance proposals. Then, low-level semantic information is propagated to a high-level network through the bottom-up feature concatenating path. The keypoints of tools are detected in each proposed boundary box. Two state-of-the-art end-to-end tool keypoint recognition networks and three backbones are implemented for comparison. The AP and AR of the our FSNet based on ResNeXt101 are 46.1% and 36.5%, respectively, which surpass the results of other methods.

Original languageEnglish
Title of host publicationProceedings of 2019 the 9th International Workshop on Computer Science and Engineering, WCSE 2019
PublisherInternational Workshop on Computer Science and Engineering (WCSE)
Pages427-431
Number of pages5
ISBN (Electronic)9789811416842
Publication statusPublished - 2020
Event2019 9th International Workshop on Computer Science and Engineering, WCSE 2019 - Hong Kong, Hong Kong
Duration: 15 Jun 201917 Jun 2019

Publication series

NameProceedings of 2019 the 9th International Workshop on Computer Science and Engineering, WCSE 2019

Conference

Conference2019 9th International Workshop on Computer Science and Engineering, WCSE 2019
Country/TerritoryHong Kong
CityHong Kong
Period15/06/1917/06/19

Keywords

  • Convolutional neural networks
  • Endoscopic image
  • Image-guided surgery
  • Pose estimation

Fingerprint

Dive into the research topics of 'FSNet: Pose estimation of endoscopic surgical tools using feature stacked network'. Together they form a unique fingerprint.

Cite this