Pregled bibliografske jedinice broj: 451036
On creating multimodal virtual humans - real time speech driven facial gesturing
On creating multimodal virtual humans - real time speech driven facial gesturing // Multimedia tools and applications, 54 (2011), 1; 165-179 doi:10.1007/s11042-010-0526-y (međunarodna recenzija, članak, znanstveni)
CROSBI ID: 451036 Za ispravke kontaktirajte CROSBI podršku putem web obrasca
Naslov
On creating multimodal virtual humans - real time speech driven facial gesturing
Autori
Zorić, Goranka ; Forchheimer, Robert ; Pandžić, Igor
Izvornik
Multimedia tools and applications (1380-7501) 54
(2011), 1;
165-179
Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni
Ključne riječi
facial gestures; vVisual prosody; multimodal interface; facial animation; speech processing; Human-Computer interaction
Sažetak
In this paper we present a novel method for automatic speech driven facial gesturing for virtual humans capable of real time performance. Facial gestures included are various nods and head movements, blinks, eyebrow gestures and gaze. A mapping from speech to facial gestures is based on the prosodic information obtained from the speech signal. It is realized using a hybrid approach - HMMs, rules and global statistics. Further, we test the method using an application prototype - a system for speech driven facial gesturing suitable for virtual presenters.
Izvorni jezik
Engleski
Znanstvena područja
Računarstvo
Napomena
Special Issue on Multimodal Interaction and Multimodal Content Management
POVEZANOST RADA
Projekti:
036-0362027-2028 - Utjelovljeni razgovorni agenti za usluge u umreženim i pokretljivim sustavima (Pandžić, Igor Sunday, MZO ) ( CroRIS)
Ustanove:
Fakultet elektrotehnike i računarstva, Zagreb
Citiraj ovu publikaciju:
Časopis indeksira:
- Current Contents Connect (CCC)
- Web of Science Core Collection (WoSCC)
- Science Citation Index Expanded (SCI-EXP)
- SCI-EXP, SSCI i/ili A&HCI
- Scopus