Information Services banner Edinburgh Research Archive The University of Edinburgh crest

Edinburgh Research Archive >
Centre for Speech Technology Research >
CSTR publications >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1842/3883

This item has been viewed 57 times in the last year. View Statistics

Files in This Item:

File Description SizeFormat
GregorLipsChallenge08.pdf791.43 kBAdobe PDFView/Open
Title: Speech-driven Lip Motion Generation with a Trajectory HMM
Authors: Hofer, Gregor
Yamagishi, Junichi
Shimodaira, Hiroshi
Issue Date: 2008
Journal Title: Proc. Interspeech 2008
Abstract: Automatic speech animation remains a challenging problem that can be described as finding the optimal sequence of animation parameter configurations given some speech. In this paper we present a novel technique to automatically synthesise lip motion trajectories from a speech signal. The developed system predicts lip motion units from the speech signal and generates animation trajectories automatically employing a Trajectory Hidden Markov Model. Using the MLE criterion, its parameter generation algorithm produces the optimal smooth motion trajectories that are used to drive control points on the lips directly. Additionally, experiments were carried out to find a suitable model unit that produces the most accurate results. Finally a perceptual evaluation was conducted, that showed that the developed motion units perform better than phonemes.
URI: http://hdl.handle.net/1842/3883
Appears in Collections:CSTR publications

Items in ERA are protected by copyright, with all rights reserved, unless otherwise indicated.

 

Valid XHTML 1.0! Unless explicitly stated otherwise, all material is copyright © The University of Edinburgh 2013, and/or the original authors. Privacy and Cookies Policy