Naslov
A Comprehensive Dataset of Spelling Errors and Users’ Corrections in Croatian Language

Autori
Gledec, Gordan ; Horvat, Marko ; Mikuc, Miljenko ; Blašković, Bruno

Izvornik
Data (2306-5729) 8 (2023), 5; 89, 11

Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni

Ključne riječi
spellchecker ; n-grams ; natural language processing ; Croatian language ; user corrections dataset ; common error analysis

Sažetak
This paper presents a unique and extensive dataset containing over 33 million entries with pairs in the form “spelling error → correction” from ispravi.me, the most popular Croatian online spellchecking service, collected since 2008. The dataset, compiled from the contribution of nearly 900, 000 users, is a valuable resource for researchers and developers in the field of natural language processing (NLP), improving spellcheck accuracy, and language learning applications. The dataset may be used to accomplish several goals: (1) improving spellchecking accuracy by incorporating common user corrections and reducing false positives and negatives ; (2) helping language learners identify common errors and learn correct spelling through targeted feedback ; (3) analyzing data trends and patterns to uncover the most common spelling errors and their underlying causes ; (4) identifying and evaluating factors that influence typing input ; (5) improving NLP applications such as text recognition and machine translation. Tasks specific to the Croatian language include the creation of a letter-level confusion matrix and the refinement of word suggestions based on historical usage of the service. This comprehensive dataset provides researchers and practitioners with a wealth of information, opening the path for advancements in spellchecking, language learning, and NLP applications in the Croatian language.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo

POVEZANOST RADA