Naslov
Multimodal tools and interfaces for the intercommunication between visually impaired and “ deaf and mute” people

Autori
Moustakas, Konstantinos ; Nikolakis, Georgios ; Tzovaras, Dimitrios ; Deville, Benoit ; Marras, Ioannis ; Pavlek, Jakov

Izvornik
ENTERFACE’ 06

Vrsta, podvrsta
Ostale vrste radova, izvještaj

Godina
2006

Ključne riječi
Multimodal interfaces; Rehabilitation technologies; Virtual Reality

Sažetak
The present paper presents the framework and the results of Project 2: “ Multimodal tools and interfaces for the intercommunication between visually impaired and “ deaf and mute” people” , which has been developed during the eNTERFACE-2006 summer workshop in the context of the SIMILAR NoE. The developed system aims to provide alternative tools and interfaces to blind and deaf-and-mute persons so as to enable their intercommunication as well as their interaction with the computer. All the involved technologies are integrated into a treasure hunting game application that is jointly played by the blind and deaf-and-mute user. The reason for choosing to integrate the multimodal interfaces into a game application is that it serves both as an entertainment and as a pleasant education tool to its users. The proposed application integrates haptics, audio, visual output as well as computer vision, sign language analysis and synthesis, speech recognition and synthesis, in order to provide an interactive environment where the blind and deaf and mute users can collaborate in order to play the treasure hunting game.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo

POVEZANOST RADA