TIODT: Touch-free Intuitive Operation Digital Twin Platform for Minimally Invasive Surgical Robot

Dongsheng Xie, Jinpeng Diao, Fengxinyun Fang, Yang Wang, Changsheng Li*, Xingguang Duan*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Precise and intuitive control interfaces are vital in the field of surgical robotics to enhance surgical outcomes. This study introduces a novel approach to touch-free control of a surgical robot using a digital twin framework. The system leverages advanced hand tracking, gesture recognition, and real-time gesture mapping techniques to enable accurate and intuitive control. The comprehensive visual feedback enhances the surgeon's understanding and decision-making during procedures. Detailed characterization and capture experiments were conducted to verify the proposed system and the results show that the digital twin platform allows surgeons to visualize the surgical site from different perspectives and overlay additional information for improved situational awareness.

Original languageEnglish
Title of host publication2024 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages50-55
Number of pages6
ISBN (Electronic)9798350372601
DOIs
Publication statusPublished - 2024
Event2024 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2024 - Alesund, Norway
Duration: 24 Jun 202428 Jun 2024

Publication series

Name2024 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2024

Conference

Conference2024 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2024
Country/TerritoryNorway
CityAlesund
Period24/06/2428/06/24

Keywords

  • Digital twin
  • gesture recognition
  • hand tracking
  • surgical robotics

Fingerprint

Dive into the research topics of 'TIODT: Touch-free Intuitive Operation Digital Twin Platform for Minimally Invasive Surgical Robot'. Together they form a unique fingerprint.

Cite this