engleski

RealActor: Character Animation and Multimodal Behavior Realization System

Embodied Conversational Agents (ECAs) are an application of virtual characters that is subject of considerable ongoing research. An essential prerequisite for creating believable ECAs is the ability to describe and visually realize multimodal human behaviors which include speech, facial movements, gestures and locomotion. The recently developed Behavior Markup Language (BML) seeks to address this requirement In this paper we present RealActor, an open-source, multi-platform character animation system for ECAs which enables the user to specify verbal and non-verbal behaviors and their temporal relationships using BML scripts. We describe our solution to the issue of synchronizing gestures with synthesized speech using neural networks and propose improvements to the BML specifi cation. Furthermore, we describe our system's generic and modular architecture which facilitates rapid integration with different graphics engines on a variety of platforms.

emobodied conversational agents; mulitmodal realization; animation

nije evidentirano