Pages in topic:   [1 2 3 4] >
Your thoughts on the quality of "premium" Google Translate?
Thread poster: Samuel Murray

Samuel Murray  Identity Verified
Netherlands
Local time: 00:20
Member (2006)
English to Afrikaans
+ ...
Dec 15, 2016

Hello everyone

As you may already know, Google is rolling out its neural network based machine translation system. It has various names, but Google refers to it as Google Cloud Translation or simply the "premium" service. It is supposed to be much better than their standard machine translation service. But what do you think?

Here are some sample translations in the language combinations that the premium service currently supports. You can also download a file with longer sample translations (and I can also generate more samples for anyone, if interested).









So, your thoughts?

Samuel


Direct link Reply with quote
 
Michele Fauble  Identity Verified
United States
Local time: 16:20
Member (2006)
Norwegian to English
+ ...
Better Dec 15, 2016

MUCH better is an exaggeration. Somewhat better. Still not good enough.

Direct link Reply with quote
 

Kuochoe Nikoi  Identity Verified
Ghana
Local time: 23:20
Japanese to English
Good for getting the general meaning of stuff Dec 15, 2016

I want to hear more about this "cervical car" and "French-language police officer" stuff. It sounds...intriguing.

Direct link Reply with quote
 

David GAY  Identity Verified
Member (2014)
English to French
+ ...
word for word translation Dec 15, 2016

It's pure word for word translation. No brains behind it (even though the sentences are quite basic).Perhaps
the work of a non native translator with a very poor command of the language?

[Modifié le 2016-12-15 21:33 GMT]


Direct link Reply with quote
 
Francis Marche  Identity Verified
France
Local time: 00:20
English to French
+ ...
A new police officer Dec 15, 2016

"lceberg is a new
French-language police officer
written by the French novelist Fred Kassak"

Says it all about Google Translation, Premium or otherwise, doesn't it ?



[Edited at 2016-12-15 23:55 GMT]

[Edited at 2016-12-15 23:56 GMT]


Direct link Reply with quote
 
Daryo
United Kingdom
Local time: 23:20
Serbian to English
+ ...
you put a "1" in front of a "0/zero" Dec 16, 2016

you get "10", BUT

You put a medal in front of a zero, you don't get someone 10 times more valuable, you still have a zero (a worthless individual)

You put a label "premium" in front of garbage, you still have garbage ...

I have no doubts that MT will eventually be really usable - one day - but that's not today, nor tomorrow nor anytime soon.

As it is today, it's about as useful as a glorified glossary ...



[Edited at 2016-12-16 09:24 GMT]


Direct link Reply with quote
 

Michael Wetzel  Identity Verified
Germany
Local time: 00:20
German to English
standard examples slightly better for German-English Dec 16, 2016

"Orient Express" should not be hyphenated and Premium strangely translates the French proper name of the other line into Denglish ("Trainblau").
"among the most famous are" and "the most famous include" both seem perfectly fine.
I don't know how much the comma error (joining two independent clauses without a conjuction) is likely to bother most English readers. It is more or less standard and not problematic in German, but it is certainly not proper English, although it is possible that most people don't care.

The second example seems easier to understand with "Beyond Europe" at the beginning.
Here, both MT versions have failed to recognize that the "wurde" (from "werden") in the original sentence is used as a normal verb (= to become) and not as a helping verb indicating passive.
Without context it is impossible to say with certainty, but "was" (standard) seems much more likely to be the appropriate tense than "has been" (premium).

I had meant to reply to your other post on the subject a couple weeks ago, but never got around to it.
These are certainly not word-by-word translations, and the two examples are more or less properly constructed and do not significantly distort the meaning of the originals. They are perfectly adequate translations for most purposes.
However, I think these examples also seem like deceptively easy sentences (they look harder than they are). Some sentences in the other post had also already been completely or extensively translated in Wikipedia articles.

Google has a great press department, but I don't see any reason to believe that this is going to be able to deal with even marginally complex writing. The only difference is that "statistically based" has now replaced "rule-based" automated translation as the big, bad bogeyman.

On the other hand, the technology only has to become as good as the worst segment of human translators to become relevant for the translation market.


Direct link Reply with quote
 

Samuel Murray  Identity Verified
Netherlands
Local time: 00:20
Member (2006)
English to Afrikaans
+ ...
TOPIC STARTER
@David, @Francis Dec 16, 2016

David GAY wrote:
It's pure word for word translation.


Which language combination are you commenting on, David? They can't all be word-for-word -- the translations differ too much for that.

Francis Marche wrote:
Says it all about Google Translation, Premium or otherwise, doesn't it ?


You'll find difficult sentences in all languages. What did you think of the rest of the FR/EN text?



[Edited at 2016-12-16 08:55 GMT]


Direct link Reply with quote
 

David GAY  Identity Verified
Member (2014)
English to French
+ ...
mostly EN>FR and FR>EN Dec 16, 2016

[quote]Samuel Murray wrote:

David GAY wrote:
It's pure word for word translation.


Which language combination are you commenting on, David? They can't all be word-for-word -- the translations differ too much for that.

EN>FR and FR>EN mostly but the sentences in other languages are also very basic and short.
Word for word translation means that each word has been extracted from the
sentence of the source text and translated separately regardless of the meaning of the full sentence.Exactly
the kind of thing a translator shouldn't do.

[Modifié le 2016-12-16 09:22 GMT]

[Modifié le 2016-12-16 09:29 GMT]

[Modifié le 2016-12-16 09:33 GMT]

[Modifié le 2016-12-16 09:34 GMT]

[Modifié le 2016-12-16 09:41 GMT]


Direct link Reply with quote
 

Lingua 5B  Identity Verified
Bosnia and Herzegovina
Local time: 00:20
English to Croatian
+ ...
Criteria. Dec 16, 2016

Criteria when estimating human translation:

One non-native error in a 1k text = unacceptable

Criteria when estimating machine translation:

It now has 50 errors in 1k text instead of 80 errors like before = bravo, it progressed significantly. Now we can start selling the software and earning the money.

I can remember an ad by a US employer, it went something like this: "If I find only one non-native error in your quote, you will be immediately disqualified" (they were looking for native English speakers/writers).


Direct link Reply with quote
 

Samuel Murray  Identity Verified
Netherlands
Local time: 00:20
Member (2006)
English to Afrikaans
+ ...
TOPIC STARTER
@Lingua Dec 16, 2016

Lingua 5B wrote:
I can remember an ad by a US employer, it went something like this: "If I find only one non-native error in your quote, you will be immediately disqualified" (they were looking for native English speakers/writers).


Did you tell them that "immediately disqualified" is a non-native error? (-:


Direct link Reply with quote
 

Lingua 5B  Identity Verified
Bosnia and Herzegovina
Local time: 00:20
English to Croatian
+ ...
Machines can't read, humans can : ) Dec 16, 2016

Samuel Murray wrote:

Lingua 5B wrote:
I can remember an ad by a US employer, it went something like this: "If I find only one non-native error in your quote, you will be immediately disqualified" (they were looking for native English speakers/writers).


Did you tell them that "immediately disqualified" is a non-native error? (-:


I said clearly, the ad read "something like" (approximation), I didn't quote the exact ad. I was precise enough, but your reading wasn't : )


Direct link Reply with quote
 
Michele Fauble  Identity Verified
United States
Local time: 16:20
Member (2006)
Norwegian to English
+ ...
Only one? Dec 16, 2016

Samuel Murray wrote:

Lingua 5B wrote:
I can remember an ad by a US employer, it went something like this: "If I find only one non-native error in your quote, you will be immediately disqualified" (they were looking for native English speakers/writers).


Did you tell them that "immediately disqualified" is a non-native error? (-:


Nothing non-native about "immediately disqualified".

The real error is "only one". So two or more would be ok? What was meant was "even one".





[Edited at 2016-12-16 17:59 GMT]


Direct link Reply with quote
 

Daniel Frisano
Monaco
Local time: 00:20
Member (2008)
English to Italian
+ ...
Reverse marketing or what? Dec 16, 2016

Did they intentionally pick some mediocre translations as an example of their product, for some reason? Some could pass for human quality, while others are blatantly "machined".

I think we can safely assume that not many among us will be out of work, at least not in the near future.

Also, I have the impression that this kind of technology is reaching some kind of plateau, and still underperforming, given its huge expectations. Looks like it's stalling, or at least not developing as fast as expected.

Whatever progress they were/are/will be able to make is probably due more to an improvement in processing power, i.e. raw processor speed, than real conceptual advancements.

Not to mention that while the results may be barely acceptable when English is involved as source or target, they deteriorate very quickly when translating between any two languages other than English.

[Edited at 2016-12-16 19:26 GMT]


Direct link Reply with quote
 

Tomás Cano Binder, BA, CT  Identity Verified
Spain
Local time: 00:20
Member (2005)
English to Spanish
+ ...
Spanish: Awful! Dec 16, 2016

- Apparently, four C-17's were either ordained or sorted/classified. You can "ordenar" something, in the sense of commanding someone to do something or ordering some goods/services, but the participle "ordenado" is not used for these situations.

- "Boeing C-17 Globemaster III grandes aviones de transporte" got the positions wrong: in Spanish, in a nominal group, the proper name comes at the end. Should be "grandes aviones de transporte Boeing C-17 Globemaster III". In the Standard version, the positions are even worse.

- In Standard, "Cuatro C-17 se les ordenó..." does not make grammatical sense. It could be understood that the four C-17's were commanded to do something.

In some aspects, Standard is better than Premium, because:
- "Royal Australian Air Force" would be naturally translated into Spanish, but is left as is by Premium.

- The preposition that goes with "capacidad" is "para" in this case, i.e. the new units will improve something that exists already. "Capacidad" + "de" would imply that the RAAF is not currently capable of operating at all outside Australia, and getting the new units allows them to begin operating. Maybe Standard just hit the nail by chance with "para", but in any case it is the correct option.

All things considered, Premium's translations are NOT at all better than the previous ones in the case of Spanish.


Direct link Reply with quote
 
Pages in topic:   [1 2 3 4] >


To report site rules violations or get help, contact a site moderator:


You can also contact site staff by submitting a support request »

Your thoughts on the quality of "premium" Google Translate?

Advanced search






memoQ translator pro
Kilgray's memoQ is the world's fastest developing integrated localization & translation environment rendering you more productive and efficient.

With our advanced file filters, unlimited language and advanced file support, memoQ translator pro has been designed for translators and reviewers who work on their own, with other translators or in team-based translation projects.

More info »
Déjà Vu X3
Try it, Love it

Find out why Déjà Vu is today the most flexible, customizable and user-friendly tool on the market. See the brand new features in action: *Completely redesigned user interface *Live Preview *Inline spell checking *Inline

More info »



Forums
  • All of ProZ.com
  • Term search
  • Jobs
  • Forums
  • Multiple search