DOI: 10.3724/SP.J.1016.2013.02525

Chinese Journal of Computers (计算机学报) 2013/36:12 PP.2525-2536

A Realistic 3D Virtual Head Using Multi-Inputs for Human-Machine Interface

A realistic 3D virtual head using multi-inputs for human-machine interface is proposed. It has following characteristics: (1) it is driven by video, text and speech, thus can interact with humans through more interfaces; (2) online appearance model is used to track 3D facial motion from video in the framework of particle filtering, and multi-measurements are infused to reduce the influence of lighting and person dependence for the construction of online appearance model; (3) 3D facial animation algorithm combining parameterized model and muscular model reduces computational effort greatly while maintains high reality; (4) the computational effort of visual co-articulation model is reduced by tri-phone model without sacrifice any performance. The performance and perceptual evaluations show the suitability for human-machine interface.

Key words:human-machine interface,virtual head,facial motion tracking,facial animation

ReleaseDate:2014-07-21 17:04:09