engleski

Computer-based question and exam evaluation in summative knowledge assessment

This paper describes a system for automatic multiple-choice pen- and-paper exam generation, which includes evaluation of students’ answers and evaluation of the quality of exams and questions. During the design phase examiner defines the number of questions, area for each question, and the number of variations of the exam. In the evaluation phase, the system automatically evaluates the students’ answers. In the verification phase, the system uses Classical test theory (CTT) concepts to provide feedback to the examiner highlighting all questions identified as too easy or too difficult for students. When using the KR-20 formula to verify more than 100 exams and 5, 000 students, results show that the reliability coefficients are higher than 80% on average, which is considered very high.

e-Learning , Classical Test Theory , Item Response Theory , automated exam evaluation , automated hybrid exam verification

nije evidentirano