Pretražite po imenu i prezimenu autora, mentora, urednika, prevoditelja

Napredna pretraga

Pregled bibliografske jedinice broj: 451036

On creating multimodal virtual humans - real time speech driven facial gesturing


Zorić, Goranka; Forchheimer, Robert; Pandžić, Igor
On creating multimodal virtual humans - real time speech driven facial gesturing // Multimedia tools and applications, 54 (2011), 1; 165-179 doi:10.1007/s11042-010-0526-y (međunarodna recenzija, članak, znanstveni)


CROSBI ID: 451036 Za ispravke kontaktirajte CROSBI podršku putem web obrasca

Naslov
On creating multimodal virtual humans - real time speech driven facial gesturing

Autori
Zorić, Goranka ; Forchheimer, Robert ; Pandžić, Igor

Izvornik
Multimedia tools and applications (1380-7501) 54 (2011), 1; 165-179

Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni

Ključne riječi
facial gestures; vVisual prosody; multimodal interface; facial animation; speech processing; Human-Computer interaction

Sažetak
In this paper we present a novel method for automatic speech driven facial gesturing for virtual humans capable of real time performance. Facial gestures included are various nods and head movements, blinks, eyebrow gestures and gaze. A mapping from speech to facial gestures is based on the prosodic information obtained from the speech signal. It is realized using a hybrid approach - HMMs, rules and global statistics. Further, we test the method using an application prototype - a system for speech driven facial gesturing suitable for virtual presenters.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo

Napomena
Special Issue on Multimodal Interaction and Multimodal Content Management



POVEZANOST RADA


Projekti:
036-0362027-2028 - Utjelovljeni razgovorni agenti za usluge u umreženim i pokretljivim sustavima (Pandžić, Igor Sunday, MZO ) ( CroRIS)

Ustanove:
Fakultet elektrotehnike i računarstva, Zagreb

Profili:

Avatar Url Igor Sunday Pandžić (autor)

Avatar Url Goranka Zorić (autor)

Poveznice na cjeloviti tekst rada:

doi www.springerlink.com

Citiraj ovu publikaciju:

Zorić, Goranka; Forchheimer, Robert; Pandžić, Igor
On creating multimodal virtual humans - real time speech driven facial gesturing // Multimedia tools and applications, 54 (2011), 1; 165-179 doi:10.1007/s11042-010-0526-y (međunarodna recenzija, članak, znanstveni)
Zorić, G., Forchheimer, R. & Pandžić, I. (2011) On creating multimodal virtual humans - real time speech driven facial gesturing. Multimedia tools and applications, 54 (1), 165-179 doi:10.1007/s11042-010-0526-y.
@article{article, author = {Zori\'{c}, Goranka and Forchheimer, Robert and Pand\v{z}i\'{c}, Igor}, year = {2011}, pages = {165-179}, DOI = {10.1007/s11042-010-0526-y}, keywords = {facial gestures, vVisual prosody, multimodal interface, facial animation, speech processing, Human-Computer interaction}, journal = {Multimedia tools and applications}, doi = {10.1007/s11042-010-0526-y}, volume = {54}, number = {1}, issn = {1380-7501}, title = {On creating multimodal virtual humans - real time speech driven facial gesturing}, keyword = {facial gestures, vVisual prosody, multimodal interface, facial animation, speech processing, Human-Computer interaction} }
@article{article, author = {Zori\'{c}, Goranka and Forchheimer, Robert and Pand\v{z}i\'{c}, Igor}, year = {2011}, pages = {165-179}, DOI = {10.1007/s11042-010-0526-y}, keywords = {facial gestures, vVisual prosody, multimodal interface, facial animation, speech processing, Human-Computer interaction}, journal = {Multimedia tools and applications}, doi = {10.1007/s11042-010-0526-y}, volume = {54}, number = {1}, issn = {1380-7501}, title = {On creating multimodal virtual humans - real time speech driven facial gesturing}, keyword = {facial gestures, vVisual prosody, multimodal interface, facial animation, speech processing, Human-Computer interaction} }

Časopis indeksira:


  • Current Contents Connect (CCC)
  • Web of Science Core Collection (WoSCC)
    • Science Citation Index Expanded (SCI-EXP)
    • SCI-EXP, SSCI i/ili A&HCI
  • Scopus


Citati:





    Contrast
    Increase Font
    Decrease Font
    Dyslexic Font