Microsoft claims MT system “achieved human parity” on test data

This discussion belongs to Translation news » "Microsoft claims MT system “achieved human parity” on test data".
You can see the translation news page and participate in this discussion from there.

Michael Marcoux  Identity Verified
United States
Local time: 14:19
Russian to English
+ ...
Don't speak Chinese, but... Mar 21, 2018

it actually looks pretty good. Welp, time to find a new career.


Lincoln Hui  Identity Verified
Hong Kong
Local time: 03:19
Chinese to English
+ ...
Strengths and weaknesses Mar 21, 2018

I tested a few strings and the system does have its strengths. The key weaknesses are as follows:

- It doesn't "know" that what it produces is correct. It's capable of producing several options (in this case, two), one of which is likely to be quite accurate, but it can't tell on its own which one to use.

- It looks like it's designed to parse text written in a specific way, i.e. by trained journalists. News reports have certain style conventions and it's not hard to imagine that a machine with access to a vast amount of data can identify and pick up relevant information. Evidence to this is that the machine performed extremely poorly when I threw a couple of interview quotes at it. They were not in a style that the machine was trained in, and the confused machine was not even able to try and fake a fluent output. I also tried several legal text excerpts, relatively simple ones (terms of service) that pose no significant difficulty for a well-educated reader without formal legal training. The machine was able to produce a more-or-less acceptable output for the more verbose sample, but the other two threw it off completely.

The second weakness can be mitigated with more data, but the first has no solution in the foreseeable future. Accumulating more human selection data can increase the confidence of the choice, but only to a certain extent. It can't deliver total confidence without a human reviewer, and at that point you have a competent translator in the loop.

Translators are cheap, translation mistakes are expensive. The translation market could transform and it could shrink, but it has a long way to go before it becomes irrelevant.


To report site rules violations or get help, contact a site moderator:

Moderator(s) of this forum
Jared Tabor[Call to this topic]

You can also contact site staff by submitting a support request »

Microsoft claims MT system “achieved human parity” on test data

Advanced search

WordFinder Unlimited
For clarity and excellence

WordFinder is the leading dictionary service that gives you the words you want anywhere, anytime. Access 260+ dictionaries from the world's leading dictionary publishers in virtually any device. Find the right word anywhere, anytime - online or offline.

More info »
BaccS – Business Accounting Software
Modern desktop project management for freelance translators

BaccS makes it easy for translators to manage their projects, schedule tasks, create invoices, and view highly customizable reports. User-friendly, integration, community-driven development – a few reasons BaccS is trusted by translators!

More info »

  • All of
  • Term search
  • Jobs
  • Forums
  • Multiple search