Naslov
N-gram overlap in automatic detection of document derivation

Autori
Bosanac, Siniša ; Štefanec, Vanja

Vrsta, podvrsta i kategorija rada
Poglavlja u knjigama, pregledni

Knjiga
INFuture2011: The Future of Information Sciences - Information Sciences and e-Society

Urednik/ci
Billenness, Clive ; Hemera, Annette ; Mateljan, Vladimir ; Banek Zorica, Mihaela ; Stančić, Hrvoje ; Seljan, Sanja

Izdavač
Odsjek za informacijske i komunikacijske znanosti Filozofskog fakulteta Sveučilišta u Zagrebu

Grad
Zagreb

Godina
2011

Raspon stranica
373-382

ISBN
978-953-175-408-8

Ključne riječi
document derivation, text reuse, n-gram overlap, automatic plagiarism detection, string metrics

Sažetak
Establishing authenticity and independence of documents in relation to others is not a new problem, but in the era of hyper production of e-text it certainly gained even more importance. There is an increased need for automatic methods for determining originality of documents in a digital environment. The method of n-gram overlap is only one of several methods proposed by the literature and is used in a variety of systems for automatic identification of text reuse. Although the aforementioned method is quite trivial, determining the length of n-grams that would be a good indicator of text reuse is a somewhat complex issue. We assume that the optimal length of n-grams is not the same for all languages but that it depends on the particular language properties such as morphological typology, syntactic features, etc. The aim of this study is to find the optimal length of n-grams to be used for determining document derivation in Croatian language. Among the potential areas of implementation of the results of this study, we could point out automatic detection of plagiarism in academic and student papers, citation analysis, information flow tracking and event detection in on-line texts.

Izvorni jezik
Engleski

Znanstvena područja
Informacijske i komunikacijske znanosti, Filologija

POVEZANOST RADA