UI Binding Transfer for Bone-driven Facial Rigs

Jing Hou; Zhihe Zhao; Dongdong Weng

doi:10.1109/VRW58643.2023.00172

UI Binding Transfer for Bone-driven Facial Rigs

Jing Hou, Zhihe Zhao, Dongdong Weng^*

^*此作品的通讯作者

光电学院

Beijing Institute of Technology

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

1 引用（Scopus）

摘要

We propose an automatic method to transfer the UI binding from a rigged model to a new target mesh. We use feed forward neural net-works to find the mapping functions between bones and controllers of source model. The learned mapping networks then become the initial weights of an auto-encoder. Then the auto-encoder is retrained using target controllers-bones pairs obtained by the mesh transfer and bones decoupling method. Our system only requires neutral expression of the target person but allows artists to customize other basic expressions, and is evaluated by the semantic reproducibility of basic expressions and the semantic similarity.

源语言	英语
主期刊名	Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
出版商	Institute of Electrical and Electronics Engineers Inc.
页	659-660
页数	2
ISBN（电子版）	9798350348392
DOI	https://doi.org/10.1109/VRW58643.2023.00172
出版状态	已出版 - 2023
活动	2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 - Shanghai, 中国期限: 25 3月 2023 → 29 3月 2023

出版系列

姓名	Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

会议

会议	2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
国家/地区	中国
市	Shanghai
时期	25/03/23 → 29/03/23

访问文件

10.1109/VRW58643.2023.00172

其它文件与链接

链接到 Scopus 的出版物

引用此

Hou, J., Zhao, Z., & Weng, D. (2023). UI Binding Transfer for Bone-driven Facial Rigs. 在 Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 (页码 659-660). (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VRW58643.2023.00172

Hou, Jing ; Zhao, Zhihe ; Weng, Dongdong. / UI Binding Transfer for Bone-driven Facial Rigs. Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. 页码 659-660 (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023).

@inproceedings{cc4c63c1da34459b84c7eca8806a7a00,

title = "UI Binding Transfer for Bone-driven Facial Rigs",

abstract = "We propose an automatic method to transfer the UI binding from a rigged model to a new target mesh. We use feed forward neural net-works to find the mapping functions between bones and controllers of source model. The learned mapping networks then become the initial weights of an auto-encoder. Then the auto-encoder is retrained using target controllers-bones pairs obtained by the mesh transfer and bones decoupling method. Our system only requires neutral expression of the target person but allows artists to customize other basic expressions, and is evaluated by the semantic reproducibility of basic expressions and the semantic similarity.",

keywords = "Animation, Computer graphics, Computer graphics, Computing methodologies, Computing methodologies, Graphics systems and interfaces, Procedural animation, Virtual reality",

author = "Jing Hou and Zhihe Zhao and Dongdong Weng",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023 ; Conference date: 25-03-2023 Through 29-03-2023",

year = "2023",

doi = "10.1109/VRW58643.2023.00172",

language = "English",

series = "Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "659--660",

booktitle = "Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023",

address = "United States",

}

Hou, J, Zhao, Z & Weng, D 2023, UI Binding Transfer for Bone-driven Facial Rigs. 在 Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023, Institute of Electrical and Electronics Engineers Inc., 页码 659-660, 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023, Shanghai, 中国, 25/03/23. https://doi.org/10.1109/VRW58643.2023.00172

UI Binding Transfer for Bone-driven Facial Rigs. / Hou, Jing; Zhao, Zhihe; Weng, Dongdong.
Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. 页码 659-660 (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023).

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

TY - GEN

T1 - UI Binding Transfer for Bone-driven Facial Rigs

AU - Hou, Jing

AU - Zhao, Zhihe

AU - Weng, Dongdong

PY - 2023

Y1 - 2023

N2 - We propose an automatic method to transfer the UI binding from a rigged model to a new target mesh. We use feed forward neural net-works to find the mapping functions between bones and controllers of source model. The learned mapping networks then become the initial weights of an auto-encoder. Then the auto-encoder is retrained using target controllers-bones pairs obtained by the mesh transfer and bones decoupling method. Our system only requires neutral expression of the target person but allows artists to customize other basic expressions, and is evaluated by the semantic reproducibility of basic expressions and the semantic similarity.

AB - We propose an automatic method to transfer the UI binding from a rigged model to a new target mesh. We use feed forward neural net-works to find the mapping functions between bones and controllers of source model. The learned mapping networks then become the initial weights of an auto-encoder. Then the auto-encoder is retrained using target controllers-bones pairs obtained by the mesh transfer and bones decoupling method. Our system only requires neutral expression of the target person but allows artists to customize other basic expressions, and is evaluated by the semantic reproducibility of basic expressions and the semantic similarity.

KW - Animation

KW - Computer graphics

KW - Computing methodologies

KW - Graphics systems and interfaces

KW - Procedural animation

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85159673410&partnerID=8YFLogxK

U2 - 10.1109/VRW58643.2023.00172

DO - 10.1109/VRW58643.2023.00172

M3 - Conference contribution

AN - SCOPUS:85159673410

T3 - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

SP - 659

EP - 660

BT - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023

Y2 - 25 March 2023 through 29 March 2023

ER -

Hou J, Zhao Z, Weng D. UI Binding Transfer for Bone-driven Facial Rigs. 在 Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023. Institute of Electrical and Electronics Engineers Inc. 2023. 页码 659-660. (Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023). doi: 10.1109/VRW58643.2023.00172

UI Binding Transfer for Bone-driven Facial Rigs

摘要

出版系列

会议

访问文件

其它文件与链接

指纹

引用此