Naslov
A Controller-based Animation System for Synchronizing and Realizing Human-like Conversational Behaviors

Autori
Čereković, Aleksandra ; Pejša, Tomislav ; Pandžić, Igor

Izvornik
Development of Multimodal Interfaces: Active Listening and Synchrony, Lecture Notes in Computer Science (0302-9743) 5967 (2010), 1; 80-91

Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni

Ključne riječi
multimodal realization; embodied conversationa agents

Sažetak
Embodied Conversational Agents (ECAs) are an application of virtual characters that is subject of considerable ongoing research. An essential prerequisite for creating believable ECAs is the ability to describe and visually realize multimodal conversational behaviors. The recently developed Behavior Markup Language (BML) seeks to address this requirement by granting a means to specify physical realizations of multimodal behaviors through human-readable scripts. In this paper we present an approach to implement a behavior realizer compatible with BML language. The system's architecture is based on controllers which schedule preprocessed behaviors in real-time. Animation database is feasibly extensible and it contains behavior examples constructed upon existing lexicons and theory of gestures. Furthermore, we describe a novel solution to the issue of synchronizing gestures with synthesized speech using neural networks and propose improvements to the BML specifi cation.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo

POVEZANOST RADA