Naslov
Machine Translation Evaluation for Croatian-English and English-Croatian Language Pairs

Autori
Brkić, Marija ; Seljan, Sanja ; Matetić, Maja

Vrsta, podvrsta i kategorija rada
Poglavlja u knjigama, znanstveni

Knjiga
Proceedings of the 8th International NLPCS Workshop: Human-Machine Interaction in Translation

Urednik/ci
Sharp, Bernardette ; Zock, Michael ; Carl, Michael ; Jakobsen, Arnt Lykke

Izdavač
Copenhagen Business School

Grad
Kopenhagen

Godina
2011

Raspon stranica
93-104

ISBN
978-87-593-1615-3

ISSN
07891-3522

Ključne riječi
online MT (machine translation) ; manual evaluation ; automatic evaluation ; F-measure ; BLEU ; NIST

Sažetak
This paper presents a bidirectional machine translation evaluation study for the Croatian- English and English-Croatian language pairs. Translations from Croatian into English have been obtained in four different domains from four online machine translation services, i.e. Google Translate, Stars21, Translation Guide and InterTran. These translations have been evaluated by three different automatic accuracy metrics, i.e. F-measure, BLEU and NIST, as well as by human evaluators. Evaluations are based on a single reference per sentence. In the reverse translation direction, Google Translate output has been analyzed in the same manner. System level correlation between F-measure, BLEU, NIST and human assessments is given and the significance of the results is discussed.

Izvorni jezik
Engleski

Znanstvena područja
Informacijske i komunikacijske znanosti

POVEZANOST RADA