Naslov
Assessing Summaries in LSP Courses: Making Sense of the Correct and Incoherent, the Complete and Incorrect, the Coherent and Irrelevant (to name but a few possible combinations)

Autori
Sladoljev-Agejev, Tamara ; Kabalin Borenić, Višnja

Vrsta, podvrsta i kategorija rada
Sažeci sa skupova, sažetak, ostalo

Izvornik
Book of Abstracts, 1st International Conference of the Slovene Association of LSP Teachers / - , 2017, 50-50

Skup
1st International Conference of the Slovene Association of LSP Teachers

Mjesto i datum
Rimske Terme, Slovenija, 18.05.2017. - 20.05.2017

Vrsta sudjelovanja
Predavanje

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
ESP, academic writing, summary writing, assessment, analytic approach

Sažetak
Assessment of discipline-specific summaries is a demanding and time-consuming task, especially if the assessor takes the analytic approach, focusing on individual aspects of summaries to obtain a deeper insight into reading comprehension and writing outcomes (e.g. relevance, cohesion). Namely, in order to deal with multiple complex and interrelated skills involved in summary writing, an effective assessment process will involve a number of criteria and two or more raters. Further impediments to the habitual use of the analytic approach to assessing summaries in ESP classrooms derive from issues related to the development of reliable criteria, achievement of inter-rater agreement and objectivity of assessment. Wishing to outline possible solutions to assessment-related difficulties, we analyse 63 summaries of an expository discipline-specific text by two raters and according to two sets of quantified criteria: content-based criteria (factual accuracy, completeness, relevance and coherence) and text quality-related criteria (cohesion and discourse organization). We discuss the assessment process and its results (students’ summary writing scores), inter-rater reliability, challenges involved in dealing with the two sets of criteria (e.g. possible overlaps), and the implications for ESP teaching arising from the analysis. Our assessment procedure results in inter-rater reliability which is rather satisfactory in the majority of the criteria. We also briefly comment on the valuable insights into our students’ summary writing abilities and related strengths and weaknesses (e.g. satisfactory relevance or a lack of coherence).

Izvorni jezik
Engleski

POVEZANOST RADA