Naslov
Retrieval of multimedia stimuli with semantic and emotional cues: Suggestions from a controlled study

Autori
Horvat, Marko ; Kukolja, Davor ; Ivanec, Dragutin

Vrsta, podvrsta i kategorija rada
Radovi u zbornicima skupova, cjeloviti rad (in extenso), znanstveni

Izvornik
Proceedings of 38th International Convention on Information and Communication Technology, Electronics and Microelectronics MIPRO 2015 / Biljanović, Petar - Rijeka : Hrvatska udruga za informacijsku i komunikacijsku tehnologiju, elektroniku i mikroelektroniku - MIPRO, 2015, 1399-1402

ISBN
978-953-233-083-0

Skup
38th International Convention on Information and Communication Technology, Electronics and Microelectronics MIPRO 2015

Mjesto i datum
Opatija, Hrvatska, 25.05.2015. - 29.05.2015

Vrsta sudjelovanja
Predavanje

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
Multimedia Retrieval ; Emotion ; Semantics ; Knowledge Representation ; Affective Computing ; Human-Computer Interaction

Sažetak
The ability to efficiently search pictures with annotated semantics and emotion is an important problem for Human-Computer Interaction with considerable interdisciplinary significance. Accuracy and speed of the multimedia retrieval process depends on the chosen metadata annotation model. The quality of such multifaceted retrieval is opposed to the potential complexity of data setup procedures and development of multimedia annotations. Additionally, a recent study has shown that databases of emotionally annotated multimedia are still being predominately searched manually which highlights the need to study this retrieval modality. To this regard we present a study with N = 75 participants aimed to evaluate the influence of keywords and dimensional emotions in manual retrieval of pictures. The study showed that if the multimedia database is comparatively small emotional annotations are sufficient to achieve a fast retrieval despite comparatively lesser overall accuracy. In a larger dataset semantic annotations became necessary for efficient retrieval although they contributed to a slower beginning of the search process. The experiment was performed in a controlled environment with a team of psychology experts. The results were statistically consistent with validates measures of the participants’ perceptual speed.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo, Psihologija

POVEZANOST RADA