figshare
Browse
J. Pourmostafa, D. Shterionov, P. Spronck – CLIN31 – 2021.pdf (58.61 MB)

A Novel Pipeline for Domain Detection and Selecting In-domain Sentences in Machine Translation Systems

Download (58.61 MB)
Version 2 2021-07-09, 17:24
Version 1 2021-06-23, 14:25
poster
posted on 2021-06-23, 14:25 authored by Javad Pourmostafa Roshan SharamiJavad Pourmostafa Roshan Sharami, Dimitar Shterionov, Pieter Spronck

General-domain corpora are becoming increasingly available for Machine Translation (MT) systems. However, using those that cover the same or comparable domains allow achieving high translation quality of domain-specific MT. It is often the case that domain-specific corpora are scarce and cannot be used in isolation to effectively train (domain-specific) MT systems. This work aims to improve in-domain MT by (i) a novel unsupervised pipeline for identifying distributions of different domains within a corpus and (ii) a data selection technique that leverages in-domain monolingual or parallel data to select domain-specific sentences from general corpora according to the distribution defined in (i).

History