Naslov
Multimodal Behavior Realization for Embodied Conversational Agents

Autori
Čereković, Aleksandra ; Pandžić, Igor

Izvornik
Multimedia tools and applications (1380-7501) 54 (2011), 1; 149-164

Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni

Ključne riječi
Embodied Conversational Agents; behavior realization; multimodal synchrony

Sažetak
Applications with intelligent conversational virtual humans, called Embodied Conversational Agents (ECAs), seek to bring human-like abilities into machines and establish natural human-computer interaction. In this paper we discuss realization of ECA multimodal behaviors which include speech and nonverbal behaviors. We devise RealActor, an open-source, multi-platform animation system for real-time multimodal behavior realization for ECAs. The system employs a novel solution for synchronizing gestures and speech using neural networks. It also employs an adaptive face animation model based on Facial Action Coding System (FACS) to synthesize face expressions. Our aim is to provide a generic animation system which can help researchers create believable and expressive ECAs.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo

POVEZANOST RADA