WMT 2018 Automatic Post-Editing data set



For WMT2018 we have added a new test set of 2.000 segments for each of the 2 language pairs from 2017 (en-de and de-en). Each language pair covers 30k segments. The split is: En-De: training set = 23 k, dev set = 1k, test-set16 = 2k, test-set17 = 2k, test-set18= 2k, De-En: training set: 25k, dev-set = 1k, test-set17= 2k, test-set18 = 2k.
Training, development and text data consist of English-German triplets (source, target and post-edit) belonging to the Information Technology domain and already tokenized. Training and development respectively contain 12,000 and 1,000 triplets, while the test set contains 2,000 instances. Target sentences are machine-translated with the KIT system. Post-edits are collected by Text & Form from professional translators. All data is provided by the EU project QT21 (http://www.qt21.eu/http://www.qt21.eu/).

IMPORTANT LEGAL NOTICE (This dataset is provided under the following terms of use)
TAUS Terms of Use (https://lindat.mff.cuni.cz/repository/xmlui/page/licence-TAUS_QT21).
TAUS grants to QT21 User access to the WMT Data Set with the following rights:
i) the right to use the target side of the translation units into a commercial product, provided that QT21 User may not resell the WMT Data Set as if it is its own new translation;
ii) the right to make Derivative Works; and
iii) the right to use or resell such Derivative Works commercially and for the following goals:
i) research and benchmarking;
ii) piloting new solutions; and
iii) testing of new commercial services.

You don’t have the permission to edit this resource.