Naslov
Sound My Vision: Real-Time Video Analysis on Mobile Platforms for Controlling Multimedia Performances

Autori
Kreković, Miranda ; Kreković, Gordan ; Grbac, Franco

Vrsta, podvrsta i kategorija rada
Radovi u zbornicima skupova, cjeloviti rad (in extenso), znanstveni

Izvornik
Proceedings of the 12th International Conference on Sound and Music Computing / Timoney, Joseph ; Lysaght, Thomas - Maynooth, 2015, 235-240

ISBN
9-7809-92746629

Skup
International Conference on Sound and Music Computing

Mjesto i datum
Maynooth, Irska, 29.07.2015. - 01.08.2015

Vrsta sudjelovanja
Poster

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
video analysis; OSC controller; mobile application; music creation

Sažetak
This paper presents Sound My Vision, an Android appli-cation for controlling music expression and multimedia projects. Unlike other similar applications which collect data only from sensors and input devices, Sound My Vision also analyses input video in real time and extracts low-level video features. Such a versatile controller can be used in various scenarios from entertainment and experimentation to live music performances, installations and multimedia projects. The application can replace complex setups that are usually required for capturing and analyzing a video signal in live performances. Additionally, mobility of smartphones allows perspective changes in sense that the performer can become either an object or a subject involved in controlling the expression. The most important contributions of this paper are selection of general and low-level video feature and the technical solution for seamless real-time video extraction on the Android platform.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo

POVEZANOST RADA