Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian (CROSBI ID 587457)
Prilog sa skupa u zborniku | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Karan, Mladen ; Šnajder, Jan ; Dalbelo Bašić, Bojana.
engleski
Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian
Collocations can be defined as words that occur together significantly more often than it would be expected by chance. Many natural language processing applications such as natural language generation, word sense disambiguation and machine translation can benefit from having access to information about collocated words. We approach collocation extraction as a classification problem where the task is to classify a given n-gram as either a collocation (positive) or a non- collocation (negative). Among the features used are word frequencies, classical association measures (Dice, PMI, chi2), and POS tags. In addition, semantic word relatedness modeled by latent semantic analysis is also included. We apply wrapper feature subset selection to determine the best set of features. Performance of various classification algorithms is tested. Experiments are conducted on a manually annotated set of bigrams and trigrams sampled from a Croatian newspaper corpus. Best results obtained are 79.8 F1 measure for bigrams and 67.5 F1 measure for trigrams. The best classifier for bigrams was SVM, while for trigrams the decision tree gave the best performance. Features which contributed the most to overall performance were PMI, semantic relatedness, and POS information.
collocation extraction ; feature subset selection ; Croatian language
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o prilogu
657-662.
2012.
objavljeno
Podaci o matičnoj publikaciji
Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)
Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis
European Language Resources Association (ELRA)
978-2-9517408-7-7
Podaci o skupu
Eight International Conference on Language Resources and Evaluation (LREC'12)
poster
21.05.2012-27.05.2012
Istanbul, Turska