Publication Details

Toolkit for Animation of Finnish Talking Head

FRYDRYCH Michael, DOBŠÍK Martin, KÄTSYRI Jari and SAMS Mikko. Toolkit for Animation of Finnish Talking Head. In: ISCA Tutorial and Research Workshop on Audio Visual Speech Processing (AVSP'03). St Jorioz France: International Speech Communication Association, 2003, pp. 199-204. ISSN 1680-8908.
Czech title
Systém pro animaci Finsky mluvící hlavy
Type
conference paper
Language
english
Authors
Frydrych Michael, Ph.D. (HUT)
Dobšík Martin, Ing., Ph.D. (DCGM FIT BUT)
Kätsyri Jari, M.Sc. (HUT)
Sams Mikko, Prof. (HUT)
URL
Keywords

talking head, artificial person, audiovisual speech synthesis, computer animation, facial animation

Abstract

Article presents the animation system for audiovisual speech synthesis of Finnish language in detail. The system produces real-time video sequences of Finnish talking head. Detailed structure and used mathematical means are presented too. Mentioned is also evaluation process of this animation system, which is described in another publication.

Annotation

We have designed and implemented a toolkit for real-time animation of virtual 3D talking head, "Artificial Person". Synchronized auditory and visual speech are automatically produced from input text, which can be enriched by user definable commands to perform specific gestures, as for example head nodding or facial expressions. The toolkit is extensible through external configuration files, so new actions can be quickly added. We have configured the Artificial Person to display facial expressions and phoneme articulations. Modular design of the toolkit allows to easily replace parts of the system or to detach and run them on different computers.

Our aim was to create a tool that can be used to produce realistic facial animation for creating controllable stimuli in psychophysical and neurophysiological research on audio-visual perception of speech and emotions.

Published
2003
Pages
199-204
Journal
International Conference on Audio-Visual Speech Processing, no. 9, ISSN 1680-8908
Proceedings
ISCA Tutorial and Research Workshop on Audio Visual Speech Processing (AVSP'03)
Conference
ISCA Tutorial and Research Workshop on Audio Visual Speech Processing, St Jorioz, FR
Publisher
International Speech Communication Association
Place
St Jorioz France, FR
BibTeX 
@INPROCEEDINGS{FITPUB7254,
   author = "Michael Frydrych and Martin Dob\v{s}\'{i}k and Jari K{\"{a}}tsyri and Mikko Sams",
   title = "Toolkit for Animation of Finnish Talking Head",
   pages = "199--204",
   booktitle = "ISCA Tutorial and Research Workshop on Audio Visual Speech Processing (AVSP'03)",
   journal = "International Conference on Audio-Visual Speech Processing",
   number = 9,
   year = 2003,
   location = "St Jorioz France, FR",
   publisher = "International Speech Communication Association",
   ISSN = "1680-8908",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/7254"
}
Back to top