TY - GEN
T1 - Visual speech recognition using convolutional VEF snake and canonical correlations
AU - Lu, Kun
AU - Wu, Yuwei
AU - Jia, Yunde
PY - 2010
Y1 - 2010
N2 - This paper presents a novel approach for automatic visual speech recognition using Convolutional VEF snake and canonical correlations. The utterance image sequences of isolated Chinese words are recorded with a head-mounted camera, and we use Convolutional VEF snake model to detect and track lip boundary rapidly and accurately. Geometric and motion features are both extracted from lip contour sequences and concatenated to form a joint feature descriptor. Canonical correlation is applied to measure the similarity of two utterance feature matrices and a linear discriminant function is introduced to make further improvement on the recognition accuracy. Experimental results demonstrate that our approach is promising and the joint feature descriptor is more robust than individual ones.
AB - This paper presents a novel approach for automatic visual speech recognition using Convolutional VEF snake and canonical correlations. The utterance image sequences of isolated Chinese words are recorded with a head-mounted camera, and we use Convolutional VEF snake model to detect and track lip boundary rapidly and accurately. Geometric and motion features are both extracted from lip contour sequences and concatenated to form a joint feature descriptor. Canonical correlation is applied to measure the similarity of two utterance feature matrices and a linear discriminant function is introduced to make further improvement on the recognition accuracy. Experimental results demonstrate that our approach is promising and the joint feature descriptor is more robust than individual ones.
KW - Canonical correlation
KW - Head-camera
KW - Joint feature descriptor
KW - Snake model
KW - Visual speech recognition
UR - http://www.scopus.com/inward/record.url?scp=79952765139&partnerID=8YFLogxK
U2 - 10.1109/YCICT.2010.5713068
DO - 10.1109/YCICT.2010.5713068
M3 - Conference contribution
AN - SCOPUS:79952765139
SN - 9781424488841
T3 - Proceedings - 2010 IEEE Youth Conference on Information, Computing and Telecommunications, YC-ICT 2010
SP - 154
EP - 157
BT - Proceedings - 2010 IEEE Youth Conference on Information, Computing and Telecommunications, YC-ICT 2010
T2 - 2010 IEEE Youth Conference on Information, Computing and Telecommunications, YC-ICT 2010
Y2 - 28 November 2010 through 30 November 2010
ER -