engleski

A Controller-based Animation System for Synchronizing and Realizing Human-like Conversational Behaviors

Embodied Conversational Agents (ECAs) are an application of virtual characters that is subject of considerable ongoing research. An essential prerequisite for creating believable ECAs is the ability to describe and visually realize multimodal conversational behaviors. The recently developed Behavior Markup Language (BML) seeks to address this requirement by granting a means to specify physical realizations of multimodal behaviors through human-readable scripts. In this paper we present an approach to implement a behavior realizer compatible with BML language. The system's architecture is based on controllers which schedule preprocessed behaviors in real-time. Animation database is feasibly extensible and it contains behavior examples constructed upon existing lexicons and theory of gestures. Furthermore, we describe a novel solution to the issue of synchronizing gestures with synthesized speech using neural networks and propose improvements to the BML specifi cation.

multimodal realization; embodied conversationa agents

nije evidentirano