Naslov
Effects of scoring method on psychometric quality of composite test scores

Autori
Buško, Vesna

Vrsta, podvrsta i kategorija rada
Sažeci sa skupova, sažetak, znanstveni

Izvornik
IV EUROPEAN CONGRESS OF METHODOLOGY 2010: Abstracts / Koeller, Olaf - Berlin : Institut zur Qualitätsentwicklung im Bildungswesen (IQB), 2010, 79-79

Skup
4th Conference of European Association of Methodology – 27th Conference of the Society of Multivariate Analysis in Behavioral Sciences

Mjesto i datum
Potsdam, Njemačka; Berlin, Njemačka, 21.07.2010. - 23.07.2010

Vrsta sudjelovanja
Predavanje

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
scoring method; multiple choice items; differential weighting; reliability and validity estimates; dimensionality; CFA

Sažetak
The study presents an empirical demonstration of a model for quantitative treatment of performance-based test scores composed of multiple choice items. The proposed model assumes that the choice of an incorrect option is not a random function of an implied score on an underlying construct or a latent variable measured. Once distracters are made so that their choice is dependent on scores on the measured construct, individual items potentially turn into better measures, and the composite scores necessarily become more valid estimates compared to those based on a binary model. The performance of the formulated model of differential weighting was tested and exemplified using several sets of empirical data on different forms of a nonverbal abstract reasoning test and a verbal ability-based emotional intelligence test. The results showed an improvement in performance of both items and derived composite scores when the proposed differential weighting model was used, even with the tests initially created under standard, binary-scoring paradigm.

Izvorni jezik
Engleski

Znanstvena područja
Psihologija

POVEZANOST RADA