# Netflix Hermes test

Pages in topic:   < [1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23] >
Netflix Hermes test
thedogisbrown
United States
 Score result analysis May 1

Hi all,

I took the test for fun as a translation newbie (failed Italian with 78.67%). It was fun to do and that was it for me. However, I found it very interesting to read about other people's scores. One user previously mentioned how scores always seem to end in .33 or .67. Then other people started posting results with different decimal numbers. In addition, there is uncertainty about what exactly were the scored parts (apparently parts 5 and 6 were not). Being an engineer I HAD to dig in further.

My main question was: how many questions were actually scored, and how did people receive scores with such weird decimal digits? So I assumed the number of scored questions was anywhere between 20 and 50 and calculated the percentage score for a variety of number of questions answered correctly (assuming 1 point for a correct answer, 0 points for a wrong answer).

The results are really interesting! For example, the score that I received (78.67%) is mathematically impossible to achieve under those assumptions. So that means my scored was either a weighted average (different parts have different weights), or there is partial credit (2 good answer, 1 OK answer, 0 no answer), or who knows what.

In case you are curious to see your score you can see a screenshot of the table I made.

Bye!

Joanna Spychala
Poland
Local time: 14:10
English to Polish
+ ...
 Phase 2 May 1

InBloom wrote:

Hi Joanna,

So you translated the idioms with their corresponding idioms in your language for the phase 2? Or did you select the translation that fits better for the phrase but that's not actually the specular translation of that idiom in the corresponding idiom of your mother tongue?

[Edited at 2017-05-01 13:19 GMT]

In phase 2, I would always choose what I believed was the best way to translate the English phrase. Frequently, it was an idiom. I remember a question with "there's more than one way to skin a cat": four answers where Polish idioms (including some non-existing/inverted ones), one was a non-idiomatic descriptive translation, and I was choosing between this one and one idiom (in fact, none of the answers was how I would actually translate that...).

Venezuela
Local time: 08:10
English to Spanish
+ ...
 Wait a second... May 1

Maria Mari Ros wrote:

Yes, I failed (EN-SP) with 92%, which is quite weird.

Spanish from Spain or Spanish from Latin America?

Seems like a VERY high number to me for a fail. Maybe there are other factors besides just an average?

I would LOVE some actual stats.

Joanna Spychala
Poland
Local time: 14:10
English to Polish
+ ...
 Another explanation May 2

thedogisbrown wrote:

For example, the score that I received (78.67%) is mathematically impossible to achieve under those assumptions. So that means my scored was either a weighted average (different parts have different weights), or there is partial credit (2 good answer, 1 OK answer, 0 no answer), or who knows what.

It's possible they did what EPSO does at the stage of computer-based tests: they excluded questions that included errors and re-calculated the score.

Let me give an example: there are 10 questions, you answer 8 of them correctly - you would expect to get 80%. However, one of the questions is excluded due to an error. This means that you get 88,89% or 77,78% (depending on which questions you answered wrong).

I don't know whether Hermes cares so much about the potential errors in their questions, though. Plus, if they used such approach, I would assume they would exclude those questions from the database as soon as the errors are identified (so results with .67% should not be obtained by the participants who had their score displayed immediately upon the completion of the test - and that's simply not the case).

lypham22
Singapore
English to Vietnamese
 English to Vietnamese May 2

Just finish the test yesterday and got 82% for English - Vietnamese and it's a pass. I'm quite surprised that they have published the results right away. Some answers to me quite confusing because it has the same meaning and I don't know what to choose. Just try my luck on this thing.

Anyone knows after we pass then what will happen?

Garry Arbatov
Russian Federation
Local time: 19:10
Member (2011)
English to Russian
 my two cents May 3

When I completed the test I got my results in 16 days, and my score (an equal number) was just displayed on the dashboard without the drop-down info box. Later, however, I noticed that my score was decreased a bit and the drop-down box appeared with explanation. My score is still passing, and it's with fraction .33 now.

[Редактировалось 2017-05-03 12:44 GMT]

Micssy
Italy
Local time: 14:10
 Italian threshold May 3

bellaria wrote:

ChachiArcola wrote:

I scored 81,33% and failed. So, the Italian threshold must be somewhere between my score and yours.

87,33% and failed, so the Italian threshold must be 88%.

I scored 88% and passed, so I guess 88% really is the threshold for Italian language.

Micssy
Italy
Local time: 14:10
 Evaluation May 3

Maria Mari Ros wrote:

Actually, anyone can retake the test just by starting again the registration process and using a different cell number.

I did so myself just to check what was happening with the scores. I completed the first four sections not paying too much attention. Then I completed the last two sections.

I got immediately my results. I mean immediately, just after clicking submit. I got a 81,33%, by the way. I wasn't planning to pass (I swear I am no longer interested on working with Netflix), so everything was okay (I even got a higher score than I expected). After seeing that I hadn't pass with my previous score, a 92%, it all became an absurd.

As someone said, it has been Netflix who has failed. There's no human review at all. It's like any other test (Sfera and so on), but they just let you keep on completing sections, no matter the results on the previous ones. I am wondering how many minutes of video they got translated for free.

Honestly, I don't think Netflix needs to plan such a big scam in order to have some videos translated (God knows how) for free. It is perfectly understandable that they want you to translate both videos b e f o r e evaluating your results in the previous sections: getting to each successful candidate to ask them to take another test would be pure hell. I guess they will evaluate the actual translation section in a second phase, in order to match you with the contents which better fit your skills (or don't hire you at all if you left it blank).

As for retaking the test, they have your full name in their archive so I'm not sure that starting again the registration process really works.

VALENTINA BONOMI
Italy
Local time: 14:10
English to Italian
+ ...
 TEST RESULTS May 3

Hi,
the results are not sent by email. You must check them in your hermes account (log in, go to dashboard, and there the score, percentage, is displayed).

As for the test, there were some mistakes I pointed out after completing the test, but I didn't get any reply.
For instance, there was a multiple choice question (about idioms) and the answer I wanted to choose because it was the corresponding idiom in Italian contained a word with a typo.

Wojciech_
Poland
Local time: 14:10
English to Polish
+ ...
 Doubts May 4

I seriously doubt that passing the test is now a guarantee of any job in the future. In recent years I passed tests for three companies that are also Netflix vendors and I was rarely approached with new projects.
That's why, I don't consider it as a breakthrough in my professional life. More like an additional item to include in my CV.

[Edited at 2017-05-04 17:16 GMT]

OtavioC
Brazil
English to Portuguese
+ ...
 Oh well... May 5

Failed the PT-BR test with a score of 87,33%.

Venezuela
Local time: 08:10
English to Spanish
+ ...
 Wishful thinking May 5

Wojciech Matyszkiewicz wrote:

That's why, I don't consider it as a breakthrough in my professional life. More like an additional item to include in my CV.

I have been thinking on these terms lately. If anything, it might be somewhat useful/cool to say "Hey, did you hear about that high-profile test that Netflix did back then? Yeah, I passed that...
*gets sunglasses on*
Oh, of course you can hire me, these are my rates..."

They always say "dream big", don't they? At the very least, boasting this kind of thing with the right people might lead to some work down the line.

Wojciech_
Poland
Local time: 14:10
English to Polish
+ ...
 OK May 6

OK, not revealing much of an e-mail exchange I had with a Netflix employee, I can say that my assumptions were quite right.

Netflix wants to recommend some of those who passed the test to their vendors (ergo: forget high rates) and, in some cases (probably rare ones) may consider direct collaboration.

[Edited at 2017-05-06 00:20 GMT]

Cristiana Coblis
Romania
Local time: 15:10
Member (2004)
English to Romanian
+ ...
 Tracking who is working on what tasks May 6

Wojciech Matyszkiewicz wrote:

OK, not revealing much of an e-mail exchange I had with a Netflix employee, I can say that my assumptions were quite right.

Netflix wants to recommend some of those who passed the test to their vendors (ergo: forget high rates) and, in some cases (probably rare ones) may consider direct collaboration.

[Edited at 2017-05-06 00:20 GMT]

I expected this to be the case. I did not bother to apply independently for this reason. If they invested in this system it's to serve some function for their business, not for ours. After all, it's not their job to find us clients.
IMHO, the purpose of this is to track who is working on what tasks by means of the H number and also to have a common minimum standard regarding the level of the people working on these tasks. Depending on the tasks involved, a higher level of proficiency is required. I assume tracking might be the main aspect, because from their end it is very difficult to track freelancers working through vendors.
Best of luck to all.

[Editat la 2017-05-06 07:13 GMT]

Cemo
Turkey
 Hello from Turkey :) May 6

Hello everybody.
I took English-Turkish test and passed with 88.67. I'm surprised with some professional translators' score since I'm just a regular guy who has nothing to do with translation, I'm a geologist by the way. I just enjoy watching movies and shows with English subtitles, and wanted to try my English level and maybe earn some easy money hehe I love Netflix Original Series. I hope I get the job of translating Stranger Things
Anyway I salute Turkish translators who took the test and hope to hear from you with your scores, don't be shy

Pages in topic:   < [1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23] >

To report site rules violations or get help, contact a site moderator:

 Moderator(s) of this forum Patricia Ferreira Larrieux [Call to this topic] Maya Gorgoshidze [Call to this topic] Özgür Salman [Call to this topic] Andriy Bublikov [Call to this topic]

You can also contact site staff by submitting a support request »

### Netflix Hermes test

 Translation news

memoQ translator pro
Kilgray's memoQ is the world's fastest developing integrated localization & translation environment rendering you more productive and efficient.

With our advanced file filters, unlimited language and advanced file support, memoQ translator pro has been designed for translators and reviewers who work on their own, with other translators or in team-based translation projects.

TM-Town

Are you ready for something fresh in the industry? TM-Town is a unique new site for you -- the freelance translator -- to store, manage and share translation memories (TMs) and glossaries...and potentially meet new clients on the basis of your prior work.

P.O. Box 903
Syracuse, NY 13201
USA
+1-315-463-7323
ProZ.com Argentina
Calle 14 nro. 622 1/2 entre 44 y 45
La Plata (B1900AND), Buenos Aires
Argentina
+54-221-425-1266
ProZ.com Ukraine
6 Karazina St.
Kharkiv, 61002
Ukraine
+380 57 7281624