An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model

Ziqi Tu; Dongdong Weng; Dewen Cheng; Yihua Bao; Bin Liang; Le Luo

doi:10.1007/978-3-030-34110-7_19

An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model

Ziqi Tu, Dongdong Weng^*, Dewen Cheng, Yihua Bao, Bin Liang, Le Luo

^*Corresponding author for this work

School of Optics and Photonics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

In order to give a virtual human rich and realistic facial expression in the film production process, a good blendshape model is needed. But selecting and capturing base expressions for blendshape model requires a lot of manual work, time and effort, and the model also lacks expressiveness. A method for automatically selecting a set of base expressions from a sequence of facial motions is proposed in this paper. In this method, the Procrustes analysis is used to estimate the difference between face meshes and determine the composition of the base expressions. And the base expressions are used to build a local blendshape model which can enhance expressiveness. The results of reconstructing facial expressions by the local blendshape model are shown in this paper. By this method, the base expressions can be automatically selected from the expression sequence, reducing the manual operation.

Original language	English
Title of host publication	Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2
Editors	Yao Zhao, Chunyu Lin, Nick Barnes, Baoquan Chen, Rüdiger Westermann, Xiangwei Kong
Publisher	Springer
Pages	220-231
Number of pages	12
ISBN (Print)	9783030341091
DOIs	https://doi.org/10.1007/978-3-030-34110-7_19
Publication status	Published - 2019
Event	10th International Conference on Image and Graphics, ICIG 2019 - Beijing, China Duration: 23 Aug 2019 → 25 Aug 2019

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11902 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	10th International Conference on Image and Graphics, ICIG 2019
Country/Territory	China
City	Beijing
Period	23/08/19 → 25/08/19

Keywords

Base expression selection
Facial expression reconstruction
Local blendshape model

Access to Document

10.1007/978-3-030-34110-7_19

Cite this

Tu, Z., Weng, D., Cheng, D., Bao, Y., Liang, B., & Luo, L. (2019). An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model. In Y. Zhao, C. Lin, N. Barnes, B. Chen, R. Westermann, & X. Kong (Eds.), Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2 (pp. 220-231). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11902 LNCS). Springer. https://doi.org/10.1007/978-3-030-34110-7_19

Tu, Ziqi ; Weng, Dongdong ; Cheng, Dewen et al. / An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model. Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2. editor / Yao Zhao ; Chunyu Lin ; Nick Barnes ; Baoquan Chen ; Rüdiger Westermann ; Xiangwei Kong. Springer, 2019. pp. 220-231 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{1775759921234739ae1fe3b15e056d12,

title = "An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model",

abstract = "In order to give a virtual human rich and realistic facial expression in the film production process, a good blendshape model is needed. But selecting and capturing base expressions for blendshape model requires a lot of manual work, time and effort, and the model also lacks expressiveness. A method for automatically selecting a set of base expressions from a sequence of facial motions is proposed in this paper. In this method, the Procrustes analysis is used to estimate the difference between face meshes and determine the composition of the base expressions. And the base expressions are used to build a local blendshape model which can enhance expressiveness. The results of reconstructing facial expressions by the local blendshape model are shown in this paper. By this method, the base expressions can be automatically selected from the expression sequence, reducing the manual operation.",

keywords = "Base expression selection, Facial expression reconstruction, Local blendshape model",

author = "Ziqi Tu and Dongdong Weng and Dewen Cheng and Yihua Bao and Bin Liang and Le Luo",

note = "Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 10th International Conference on Image and Graphics, ICIG 2019 ; Conference date: 23-08-2019 Through 25-08-2019",

year = "2019",

doi = "10.1007/978-3-030-34110-7_19",

language = "English",

isbn = "9783030341091",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "220--231",

editor = "Yao Zhao and Chunyu Lin and Nick Barnes and Baoquan Chen and R{\"u}diger Westermann and Xiangwei Kong",

booktitle = "Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2",

address = "Germany",

}

Tu, Z, Weng, D , Cheng, D, Bao, Y, Liang, B & Luo, L 2019, An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model. in Y Zhao, C Lin, N Barnes, B Chen, R Westermann & X Kong (eds), Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11902 LNCS, Springer, pp. 220-231, 10th International Conference on Image and Graphics, ICIG 2019, Beijing, China, 23/08/19. https://doi.org/10.1007/978-3-030-34110-7_19

An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model. / Tu, Ziqi; Weng, Dongdong ; Cheng, Dewen et al.
Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2. ed. / Yao Zhao; Chunyu Lin; Nick Barnes; Baoquan Chen; Rüdiger Westermann; Xiangwei Kong. Springer, 2019. p. 220-231 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11902 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model

AU - Tu, Ziqi

AU - Weng, Dongdong

AU - Cheng, Dewen

AU - Bao, Yihua

AU - Liang, Bin

AU - Luo, Le

PY - 2019

Y1 - 2019

N2 - In order to give a virtual human rich and realistic facial expression in the film production process, a good blendshape model is needed. But selecting and capturing base expressions for blendshape model requires a lot of manual work, time and effort, and the model also lacks expressiveness. A method for automatically selecting a set of base expressions from a sequence of facial motions is proposed in this paper. In this method, the Procrustes analysis is used to estimate the difference between face meshes and determine the composition of the base expressions. And the base expressions are used to build a local blendshape model which can enhance expressiveness. The results of reconstructing facial expressions by the local blendshape model are shown in this paper. By this method, the base expressions can be automatically selected from the expression sequence, reducing the manual operation.

AB - In order to give a virtual human rich and realistic facial expression in the film production process, a good blendshape model is needed. But selecting and capturing base expressions for blendshape model requires a lot of manual work, time and effort, and the model also lacks expressiveness. A method for automatically selecting a set of base expressions from a sequence of facial motions is proposed in this paper. In this method, the Procrustes analysis is used to estimate the difference between face meshes and determine the composition of the base expressions. And the base expressions are used to build a local blendshape model which can enhance expressiveness. The results of reconstructing facial expressions by the local blendshape model are shown in this paper. By this method, the base expressions can be automatically selected from the expression sequence, reducing the manual operation.

KW - Base expression selection

KW - Facial expression reconstruction

KW - Local blendshape model

UR - http://www.scopus.com/inward/record.url?scp=85076896184&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-34110-7_19

DO - 10.1007/978-3-030-34110-7_19

M3 - Conference contribution

AN - SCOPUS:85076896184

SN - 9783030341091

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 220

EP - 231

BT - Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2

A2 - Zhao, Yao

A2 - Lin, Chunyu

A2 - Barnes, Nick

A2 - Chen, Baoquan

A2 - Westermann, Rüdiger

A2 - Kong, Xiangwei

PB - Springer

T2 - 10th International Conference on Image and Graphics, ICIG 2019

Y2 - 23 August 2019 through 25 August 2019

ER -

Tu Z, Weng D , Cheng D, Bao Y, Liang B, Luo L. An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model. In Zhao Y, Lin C, Barnes N, Chen B, Westermann R, Kong X, editors, Image and Graphics - 10th International Conference, ICIG 2019, Proceedings, Part 2. Springer. 2019. p. 220-231. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-34110-7_19

An Automatic Base Expression Selection Algorithm Based on Local Blendshape Model

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this