TY - JOUR
T1 - Simulation of Postoperative Facial Appearances via Geometric Deep Learning for Efficient Orthognathic Surgical Planning
AU - Ma, Lei
AU - Xiao, Deqiang
AU - Kim, Daeseung
AU - Lian, Chunfeng
AU - Kuang, Tianshu
AU - Liu, Qin
AU - Deng, Hannah
AU - Yang, Erkun
AU - Liebschner, Michael A.K.
AU - Gateno, Jaime
AU - Xia, James J.
AU - Yap, Pew Thian
N1 - Publisher Copyright:
© 1982-2012 IEEE.
PY - 2023/2/1
Y1 - 2023/2/1
N2 - Orthognathic surgery corrects jaw deformities to improve aesthetics and functions. Due to the complexity of the craniomaxillofacial (CMF) anatomy, orthognathic surgery requires precise surgical planning, which involves predicting postoperative changes in facial appearance. To this end, most conventional methods involve simulation with biomechanical modeling methods, which are labor intensive and computationally expensive. Here we introduce a learning-based framework to speed up the simulation of postoperative facial appearances. Specifically, we introduce a facial shape change prediction network (FSC-Net) to learn the nonlinear mapping from bony shape changes to facial shape changes. FSC-Net is a point transform network weakly-supervised by paired preoperative and postoperative data without point-wise correspondence. In FSC-Net, a distance-guided shape loss places more emphasis on the jaw region. A local point constraint loss restricts point displacements to preserve the topology and smoothness of the surface mesh after point transformation. Evaluation results indicate that FSC-Net achieves 15× speedup with accuracy comparable to a state-of-the-art (SOTA) finite-element modeling (FEM) method.
AB - Orthognathic surgery corrects jaw deformities to improve aesthetics and functions. Due to the complexity of the craniomaxillofacial (CMF) anatomy, orthognathic surgery requires precise surgical planning, which involves predicting postoperative changes in facial appearance. To this end, most conventional methods involve simulation with biomechanical modeling methods, which are labor intensive and computationally expensive. Here we introduce a learning-based framework to speed up the simulation of postoperative facial appearances. Specifically, we introduce a facial shape change prediction network (FSC-Net) to learn the nonlinear mapping from bony shape changes to facial shape changes. FSC-Net is a point transform network weakly-supervised by paired preoperative and postoperative data without point-wise correspondence. In FSC-Net, a distance-guided shape loss places more emphasis on the jaw region. A local point constraint loss restricts point displacements to preserve the topology and smoothness of the surface mesh after point transformation. Evaluation results indicate that FSC-Net achieves 15× speedup with accuracy comparable to a state-of-the-art (SOTA) finite-element modeling (FEM) method.
KW - 3D facial appearance
KW - Orthognathic surgery
KW - geometric deep learning
KW - point transform network
KW - topology preservation
UR - http://www.scopus.com/inward/record.url?scp=85131761776&partnerID=8YFLogxK
U2 - 10.1109/TMI.2022.3180078
DO - 10.1109/TMI.2022.3180078
M3 - Article
C2 - 35657829
AN - SCOPUS:85131761776
SN - 0278-0062
VL - 42
SP - 336
EP - 345
JO - IEEE Transactions on Medical Imaging
JF - IEEE Transactions on Medical Imaging
IS - 2
ER -