Naslov
Increasing Payments in Crowdsourcing: Don't look a gift horse in the mouth

Autori
Varela, Martin ; Maki, Toni ; Skorin-Kapov, Lea ; Hossfeld, Tobias

Vrsta, podvrsta i kategorija rada
Radovi u zbornicima skupova, cjeloviti rad (in extenso), znanstveni

Izvornik
Proc. of the 4th International Workshop on Perceptual Quality of Systems, PQS 2013 / - , 2013

Skup
4th International Workshop on Perceptual Quality of Systems (PQS)

Mjesto i datum
Beč, Austrija, 02.09.2013. - 04.09.2013

Vrsta sudjelovanja
Predavanje

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
crowdsourcing; web QoE; incentives; QoE model

Sažetak
A commonly cited maxim states that “you get what you pay for”, implying that there is a strong correlation between the price paid for something, and its quality. In this paper, we examine whether this often-cited wisdom applies to using crowdsourcing for conducting subjective QoE experiments, and if so, how. As part of a large-scale user study designed to assess Web QoE, we conducted two crowdsourced campaigns to collect user ratings and study the influence of certain website design parameters related to typography and color on the overall visual appeal of the site. While the test content was exactly the same across both campaigns, the second campaign was set up to pay participants three times the reward of the first one. The goal was to analyze the impact of payment on a number of parameters, including the ratio of reliable users and obtained MOS values. With respect to QoE modeling, we found that while payment levels influenced absolute MOS values, there was no significant impact on the actual model.

Izvorni jezik
Engleski

Znanstvena područja
Elektrotehnika

POVEZANOST RADA