Napredna pretraga

Pregled bibliografske jedinice broj: 852069

Producing Monolingual and Parallel Web Corpora at the Same Time - SpiderLing and Bitextor's Love Affair


Ljubešić, Nikola; Esplà-Gomis, Miquel; Toral, Antonio; Ortiz Rojas, Sergio; Klubička, Filip
Producing Monolingual and Parallel Web Corpora at the Same Time - SpiderLing and Bitextor's Love Affair // Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016) / Calzolari, N. (ur.).
Portorož, Slovenija: European Language Resources Association (ELRA), 2016. (poster, međunarodna recenzija, cjeloviti rad (in extenso), znanstveni)


Naslov
Producing Monolingual and Parallel Web Corpora at the Same Time - SpiderLing and Bitextor's Love Affair

Autori
Ljubešić, Nikola ; Esplà-Gomis, Miquel ; Toral, Antonio ; Ortiz Rojas, Sergio ; Klubička, Filip

Vrsta, podvrsta i kategorija rada
Radovi u zbornicima skupova, cjeloviti rad (in extenso), znanstveni

Izvornik
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016) / Calzolari, N. - : European Language Resources Association (ELRA), 2016

ISBN
978-2-9517408-9-1

Skup
Language Resources and Evaluation Conference

Mjesto i datum
Portorož, Slovenija, 23-28.05.2016

Vrsta sudjelovanja
Poster

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
Crawling; top-level domain; monolingual corpus; parallel corpus

Sažetak
Abstract "This paper presents an approach for building large monolingual corpora and, at the same time, extracting parallel data by crawling the top-level domain of a given language of interest. For gathering linguistically relevant data from top-level domains we use the SpiderLing crawler, modified to crawl data written in multiple languages. The output of this process is then fed to Bitextor, a tool for harvesting parallel data from a collection of documents. We call the system combining these two tools Spidextor, a blend of the names of its two crucial parts. We evaluate the described approach intrinsically by measuring the accuracy of the extracted bitexts from the Croatian top-level domain "".hr"" and the Slovene top-level domain "".si"", and extrinsically on the English-Croatian language pair by comparing an SMT system built from the crawled data with third-party systems. We finally present parallel datasets collected with our approach for the English-Croatian, English-Finnish, English-Serbian and English-Slovene language pairs."

Izvorni jezik
Engleski

Znanstvena područja
Informacijske i komunikacijske znanosti



POVEZANOST RADA


Ustanove
Filozofski fakultet, Zagreb

Autor s matičnim brojem:
Nikola Ljubešić, (272820)