Cargando…

Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals

The quality of human translation was long thought to be unattainable for computer translation systems. In this study, we present a deep-learning system, CUBBITT, which challenges this view. In a context-aware blind evaluation by human judges, CUBBITT significantly outperformed professional-agency En...

Descripción completa

Detalles Bibliográficos
Autores principales: Popel, Martin, Tomkova, Marketa, Tomek, Jakub, Kaiser, Łukasz, Uszkoreit, Jakob, Bojar, Ondřej, Žabokrtský, Zdeněk
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7463233/
https://www.ncbi.nlm.nih.gov/pubmed/32873773
http://dx.doi.org/10.1038/s41467-020-18073-9
_version_ 1783577088031195136
author Popel, Martin
Tomkova, Marketa
Tomek, Jakub
Kaiser, Łukasz
Uszkoreit, Jakob
Bojar, Ondřej
Žabokrtský, Zdeněk
author_facet Popel, Martin
Tomkova, Marketa
Tomek, Jakub
Kaiser, Łukasz
Uszkoreit, Jakob
Bojar, Ondřej
Žabokrtský, Zdeněk
author_sort Popel, Martin
collection PubMed
description The quality of human translation was long thought to be unattainable for computer translation systems. In this study, we present a deep-learning system, CUBBITT, which challenges this view. In a context-aware blind evaluation by human judges, CUBBITT significantly outperformed professional-agency English-to-Czech news translation in preserving text meaning (translation adequacy). While human translation is still rated as more fluent, CUBBITT is shown to be substantially more fluent than previous state-of-the-art systems. Moreover, most participants of a Translation Turing test struggle to distinguish CUBBITT translations from human translations. This work approaches the quality of human translation and even surpasses it in adequacy in certain circumstances.This suggests that deep learning may have the potential to replace humans in applications where conservation of meaning is the primary aim.
format Online
Article
Text
id pubmed-7463233
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-74632332020-09-16 Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals Popel, Martin Tomkova, Marketa Tomek, Jakub Kaiser, Łukasz Uszkoreit, Jakob Bojar, Ondřej Žabokrtský, Zdeněk Nat Commun Article The quality of human translation was long thought to be unattainable for computer translation systems. In this study, we present a deep-learning system, CUBBITT, which challenges this view. In a context-aware blind evaluation by human judges, CUBBITT significantly outperformed professional-agency English-to-Czech news translation in preserving text meaning (translation adequacy). While human translation is still rated as more fluent, CUBBITT is shown to be substantially more fluent than previous state-of-the-art systems. Moreover, most participants of a Translation Turing test struggle to distinguish CUBBITT translations from human translations. This work approaches the quality of human translation and even surpasses it in adequacy in certain circumstances.This suggests that deep learning may have the potential to replace humans in applications where conservation of meaning is the primary aim. Nature Publishing Group UK 2020-09-01 /pmc/articles/PMC7463233/ /pubmed/32873773 http://dx.doi.org/10.1038/s41467-020-18073-9 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Popel, Martin
Tomkova, Marketa
Tomek, Jakub
Kaiser, Łukasz
Uszkoreit, Jakob
Bojar, Ondřej
Žabokrtský, Zdeněk
Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
title Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
title_full Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
title_fullStr Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
title_full_unstemmed Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
title_short Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
title_sort transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7463233/
https://www.ncbi.nlm.nih.gov/pubmed/32873773
http://dx.doi.org/10.1038/s41467-020-18073-9
work_keys_str_mv AT popelmartin transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals
AT tomkovamarketa transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals
AT tomekjakub transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals
AT kaiserłukasz transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals
AT uszkoreitjakob transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals
AT bojarondrej transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals
AT zabokrtskyzdenek transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals