TY - JOUR
T1 - Cutting Skill Assessment by Motion Analysis Using Deep Learning and Spatial Marker Tracking
AU - Su, Bai Quan
AU - Ma, Xu Dong
AU - Li, Weihan
AU - Kuang, Zi Ao
AU - Gong, Yi
AU - Wang, Gang
AU - Zhang, Qingqian
AU - Liu, Wenyong
AU - Li, Changsheng
AU - Gao, Li
AU - Wang, Junchen
N1 - Publisher Copyright:
© 1964-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - The assessment of surgical skill is crucial for indicating a surgeon's proficiency. While motion analysis of surgical tools is widely used in endoscopic surgery, it is not commonly applied to open surgery. Instead, open surgery skill assessment relies on observing the trajectory of surgical tools on tissue. This observation-based method often lacks clear standards, leading to inaccurate assessments. This paper presents a method for evaluating cutting skill in open surgery through scalpel motion analysis. A 3D multiple-facet ArUco code cube is designed, and a dataset of tip coordinate system poses for various scalpels in the ArUco code coordinate system (ACS) is established using the pivot calibration method. The YOLOv8 model and an image dataset of different scalpels are used to identify the scalpel type and select its tip position. The tip position is then transformed from ACS to a binocular camera coordinate system (BCS), representing the incision curve made by the scalpel. Five assessment metrics are proposed to quantify the surgeon's cutting skill: average incision curvature deviation, incision length difference, incision endpoint deviation, average incision deviation, and average cutting jerk. Experiments involving twenty expert and novice surgeons performing four common incisions (straight line, polyline, semicircle, and cross line) demonstrate the metrics' effectiveness. The metrics provide a clear, objective display of individual cutting skills, and a combined ranking reveals comparative skill levels. This study offers a precise method for evaluating surgeons' cutting skills with a scalpel in open surgery.
AB - The assessment of surgical skill is crucial for indicating a surgeon's proficiency. While motion analysis of surgical tools is widely used in endoscopic surgery, it is not commonly applied to open surgery. Instead, open surgery skill assessment relies on observing the trajectory of surgical tools on tissue. This observation-based method often lacks clear standards, leading to inaccurate assessments. This paper presents a method for evaluating cutting skill in open surgery through scalpel motion analysis. A 3D multiple-facet ArUco code cube is designed, and a dataset of tip coordinate system poses for various scalpels in the ArUco code coordinate system (ACS) is established using the pivot calibration method. The YOLOv8 model and an image dataset of different scalpels are used to identify the scalpel type and select its tip position. The tip position is then transformed from ACS to a binocular camera coordinate system (BCS), representing the incision curve made by the scalpel. Five assessment metrics are proposed to quantify the surgeon's cutting skill: average incision curvature deviation, incision length difference, incision endpoint deviation, average incision deviation, and average cutting jerk. Experiments involving twenty expert and novice surgeons performing four common incisions (straight line, polyline, semicircle, and cross line) demonstrate the metrics' effectiveness. The metrics provide a clear, objective display of individual cutting skills, and a combined ranking reveals comparative skill levels. This study offers a precise method for evaluating surgeons' cutting skills with a scalpel in open surgery.
KW - Skill assessment
KW - deep learning
KW - motion analysis
KW - scalpel
KW - spatial marker tracking
UR - http://www.scopus.com/inward/record.url?scp=85215384014&partnerID=8YFLogxK
U2 - 10.1109/TBME.2025.3529500
DO - 10.1109/TBME.2025.3529500
M3 - Article
AN - SCOPUS:85215384014
SN - 0018-9294
JO - IEEE Transactions on Biomedical Engineering
JF - IEEE Transactions on Biomedical Engineering
ER -