Cargando…
Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals
The quality of human translation was long thought to be unattainable for computer translation systems. In this study, we present a deep-learning system, CUBBITT, which challenges this view. In a context-aware blind evaluation by human judges, CUBBITT significantly outperformed professional-agency En...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7463233/ https://www.ncbi.nlm.nih.gov/pubmed/32873773 http://dx.doi.org/10.1038/s41467-020-18073-9 |
_version_ | 1783577088031195136 |
---|---|
author | Popel, Martin Tomkova, Marketa Tomek, Jakub Kaiser, Łukasz Uszkoreit, Jakob Bojar, Ondřej Žabokrtský, Zdeněk |
author_facet | Popel, Martin Tomkova, Marketa Tomek, Jakub Kaiser, Łukasz Uszkoreit, Jakob Bojar, Ondřej Žabokrtský, Zdeněk |
author_sort | Popel, Martin |
collection | PubMed |
description | The quality of human translation was long thought to be unattainable for computer translation systems. In this study, we present a deep-learning system, CUBBITT, which challenges this view. In a context-aware blind evaluation by human judges, CUBBITT significantly outperformed professional-agency English-to-Czech news translation in preserving text meaning (translation adequacy). While human translation is still rated as more fluent, CUBBITT is shown to be substantially more fluent than previous state-of-the-art systems. Moreover, most participants of a Translation Turing test struggle to distinguish CUBBITT translations from human translations. This work approaches the quality of human translation and even surpasses it in adequacy in certain circumstances.This suggests that deep learning may have the potential to replace humans in applications where conservation of meaning is the primary aim. |
format | Online Article Text |
id | pubmed-7463233 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-74632332020-09-16 Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals Popel, Martin Tomkova, Marketa Tomek, Jakub Kaiser, Łukasz Uszkoreit, Jakob Bojar, Ondřej Žabokrtský, Zdeněk Nat Commun Article The quality of human translation was long thought to be unattainable for computer translation systems. In this study, we present a deep-learning system, CUBBITT, which challenges this view. In a context-aware blind evaluation by human judges, CUBBITT significantly outperformed professional-agency English-to-Czech news translation in preserving text meaning (translation adequacy). While human translation is still rated as more fluent, CUBBITT is shown to be substantially more fluent than previous state-of-the-art systems. Moreover, most participants of a Translation Turing test struggle to distinguish CUBBITT translations from human translations. This work approaches the quality of human translation and even surpasses it in adequacy in certain circumstances.This suggests that deep learning may have the potential to replace humans in applications where conservation of meaning is the primary aim. Nature Publishing Group UK 2020-09-01 /pmc/articles/PMC7463233/ /pubmed/32873773 http://dx.doi.org/10.1038/s41467-020-18073-9 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Popel, Martin Tomkova, Marketa Tomek, Jakub Kaiser, Łukasz Uszkoreit, Jakob Bojar, Ondřej Žabokrtský, Zdeněk Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
title | Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
title_full | Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
title_fullStr | Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
title_full_unstemmed | Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
title_short | Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
title_sort | transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7463233/ https://www.ncbi.nlm.nih.gov/pubmed/32873773 http://dx.doi.org/10.1038/s41467-020-18073-9 |
work_keys_str_mv | AT popelmartin transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals AT tomkovamarketa transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals AT tomekjakub transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals AT kaiserłukasz transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals AT uszkoreitjakob transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals AT bojarondrej transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals AT zabokrtskyzdenek transformingmachinetranslationadeeplearningsystemreachesnewstranslationqualitycomparabletohumanprofessionals |