Pages in topic:   [1 2] >
Answers accuracy rating
Thread poster: Dmitry Murzakov
Dmitry Murzakov  Identity Verified
Russian Federation
Local time: 05:25
English to Russian
+ ...
Oct 24, 2010

Hi, everybody!

I want to propose a new feature which can be displayed in users’ profiles – percentage ratio of the user’s answers chosen by askers as the most helpful (A) to the whole number of the user’s answers (B). It is calculated by the following formula – (100 * A) / B. For example my percentage ratio is (100*6) : 29 = 20,68 (%). You can provide a bright name for this new feature and choose a number of digits to be displayed after point.

Dmitry.


Direct link Reply with quote
 

Nicole Schnell  Identity Verified
United States
Local time: 19:25
English to German
+ ...
Accuracy vs. helpful Oct 24, 2010

1. Not every question is about technical terms, and there is no such thing as "accurate" answers to questions in the fields of literature, advertising or gaming, for example.

2. I can perfectly view your entire statistics in regard to KudoZ questions. Maybe this feature is available to paying members only, I can't tell.


Direct link Reply with quote
 

Nicole Schnell  Identity Verified
United States
Local time: 19:25
English to German
+ ...
Addendum Oct 24, 2010

I omitted the topic of showing percentages on purpose because I can not agree with the term "accuracy rating".



Direct link Reply with quote
 

writeaway  Identity Verified
French to English
+ ...
Accuracy does not/can not apply Oct 24, 2010

Nicole Schnell wrote:

I omitted the topic of showing percentages on purpose because I can not agree with the term "accuracy rating".



Answers selected are 'helpful' in the eyes of the Asker. Which makes the degree of helpfulness completely subjective and dependent on Asker's very personal opinion.
The answers can be inaccurate, ridiculous, impossible etc but still be chosen as 'helpful' by Asker. I am referring to strict terminology questions and not things like ideas for advertising slogans which are just brain-picking/idea-stealing sessions with no right or wrong answer possible.
In the old days, when erroneous answers were chosen (again, strictly relating to terminology questions), people used to rush to the discussion box area to warn that the wrong answer had been chosen. Nowadays, this is a punishable offence so it's no longer done and even erroneous glossary entries are sacred and untouchable.
So 'accuracy' is in the eyes of the beholder and generally speaking, I feel that any 'ratio' based on answers chosen risks being totally misleading.


Direct link Reply with quote
 

Mikhail Kropotov  Identity Verified
Russian Federation
Local time: 05:25
Member (2005)
English to Russian
+ ...
Nothing is new under the moon Oct 24, 2010

Your idea has been discussed ad nauseam on these forums, Dmitry. Please do a search for "ratio" and "Kudoz" and you will see.

Direct link Reply with quote
 
Dmitry Murzakov  Identity Verified
Russian Federation
Local time: 05:25
English to Russian
+ ...
TOPIC STARTER
Have it your way Oct 24, 2010

Mikhail Kropotov

I am new here that's why I could miss the relevant topic.

Nicole Schnell

I have hurried over the term "accuracy rating". I suppose the term like this "helpful anwsers percantage rating" would be better. I can agree that even erroneous answers can be chosen as most helpful but this rating will be useful for outsourcers first of all. Although every one can understand how much helpful answers were given by the user just looking at his answers and scores statistics.


Direct link Reply with quote
 

Yaotl Altan  Identity Verified
Mexico
Local time: 21:25
Member (2006)
English to Spanish
+ ...
Agree Oct 24, 2010

Dmitry Murzakov wrote:

Hi, everybody!

I want to propose a new feature which can be displayed in users’ profiles – percentage ratio of the user’s answers chosen by askers as the most helpful (A) to the whole number of the user’s answers (B). It is calculated by the following formula – (100 * A) / B. For example my percentage ratio is (100*6) : 29 = 20,68 (%). You can provide a bright name for this new feature and choose a number of digits to be displayed after point.

Dmitry.


It's a great idea, i support it. That could be the main sort configuration as other cofigurations may be available, for instance, the number of answers or whatever you like. Proz has the resources to fix that and make it work as a spreadsheet, sorting columns according to several parameters.

I like your idea!


Direct link Reply with quote
 
Dmitry Murzakov  Identity Verified
Russian Federation
Local time: 05:25
English to Russian
+ ...
TOPIC STARTER
Thank you! Oct 24, 2010

Yaotl Altan

Than you for your support! I hope ProZ administration will hear me.


Direct link Reply with quote
 

Ildiko Santana  Identity Verified
United States
Local time: 19:25
Member (2002)
English to Hungarian
+ ...

MODERATOR
Askers ask for help, because they don't know/understand, so how can they judge accuracy of answers? Oct 24, 2010

writeaway wrote:

Answers selected are 'helpful' in the eyes of the Asker. Which makes the degree of helpfulness completely subjective and dependent on Asker's very personal opinion.
The answers can be inaccurate, ridiculous, impossible etc but still be chosen as 'helpful' by Asker. I am referring to strict terminology questions and not things like ideas for advertising slogans which are just brain-picking/idea-stealing sessions with no right or wrong answer possible.
In the old days, when erroneous answers were chosen (again, strictly relating to terminology questions), people used to rush to the discussion box area to warn that the wrong answer had been chosen. Nowadays, this is a punishable offence so it's no longer done and even erroneous glossary entries are sacred and untouchable.
So 'accuracy' is in the eyes of the beholder and generally speaking, I feel that any 'ratio' based on answers chosen risks being totally misleading.


I couldn't agree more!


Direct link Reply with quote
 

Yaotl Altan  Identity Verified
Mexico
Local time: 21:25
Member (2006)
English to Spanish
+ ...
Take a look Oct 24, 2010

Dmitry:

Take a look on "New forum for submitting suggestions and ideas" at the root of this forum. perhaps you can post your idea or support it if someone else has done it.



Direct link Reply with quote
 

Miguel Carmona  Identity Verified
United States
Local time: 19:25
English to Spanish
The decision is too subjective and accuracy plays no role in it Oct 24, 2010

writeaway wrote:

Nicole Schnell wrote:

I omitted the topic of showing percentages on purpose because I can not agree with the term "accuracy rating".



Answers selected are 'helpful' in the eyes of the Asker. Which makes the degree of helpfulness completely subjective and dependent on Asker's very personal opinion.
The answers can be inaccurate, ridiculous, impossible etc but still be chosen as 'helpful' by Asker. I am referring to strict terminology questions and not things like ideas for advertising slogans which are just brain-picking/idea-stealing sessions with no right or wrong answer possible.
In the old days, when erroneous answers were chosen (again, strictly relating to terminology questions), people used to rush to the discussion box area to warn that the wrong answer had been chosen. Nowadays, this is a punishable offence so it's no longer done and even erroneous glossary entries are sacred and untouchable.
So 'accuracy' is in the eyes of the beholder and generally speaking, I feel that any 'ratio' based on answers chosen risks being totally misleading.


I am against this percentage ratio proposed here. The decision is too subjective and accuracy plays no role in it.

As it has been said, it should be about accuracy not helpfulness, since, in the KudoZ system, helpfulness is decided upon by the asker.

Nicole and Writeaway, above, summed it up very well.


Direct link Reply with quote
 
Dmitry Murzakov  Identity Verified
Russian Federation
Local time: 05:25
English to Russian
+ ...
TOPIC STARTER
Helpful answers percentage ratio Oct 25, 2010

Miguel Carmona

I have already said that formulation of the answer was made in a hurry. I selected another name for it – “helpful answers percentage ratio”. Let’s speak about it now if you want. This ratio will not change anything but it is a comfortable feature to evaluate translator’s professional level.


Direct link Reply with quote
 
Dmitry Murzakov  Identity Verified
Russian Federation
Local time: 05:25
English to Russian
+ ...
TOPIC STARTER
This feature has so many disadvantages as a number of scores. Oct 25, 2010

Your arguments are really very persuasive. I think that this feature has so many disadvantages as a number of scores. For example, a number of scores earned through Kudoz doesn't tell also that somebody is better in this industry because he managed he was quicker. And I didn’t mention to attribute more important role to this feature but only a statistics instrument.

Direct link Reply with quote
 

Mikhail Kropotov  Identity Verified
Russian Federation
Local time: 05:25
Member (2005)
English to Russian
+ ...
The key word is probably Acceptance Oct 25, 2010

I believe a very accurate name for this statistic is "Acceptance ratio." That's what it has been called from time to time in this community.

Direct link Reply with quote
 

Julia Berman  Identity Verified
Russian Federation
Local time: 05:25
Member (2009)
English to Russian
Honestly I don't think this feature would help to present fairly translator's professional approach. Oct 25, 2010

Dmitry Murzakov wrote:

I selected another name for it – “helpful answers percentage ratio”. Let’s speak about it now if you want. This ratio will not change anything but it is a comfortable feature to evaluate translator’s professional level.


I've seen too many occasions when colleagues rush in with calque translations (while unfailingly opting for highest confidence level!) only to make sure they get there first. It may be a doable strategy to score thousands of Kudoz points, but would you look at it as a mark of professionalism?


Direct link Reply with quote
 
Pages in topic:   [1 2] >


To report site rules violations or get help, contact a site moderator:


You can also contact site staff by submitting a support request »

Answers accuracy rating

Advanced search






memoQ translator pro
Kilgray's memoQ is the world's fastest developing integrated localization & translation environment rendering you more productive and efficient.

With our advanced file filters, unlimited language and advanced file support, memoQ translator pro has been designed for translators and reviewers who work on their own, with other translators or in team-based translation projects.

More info »
Protemos translation business management system
Create your account in minutes, and start working! 3-month trial for agencies, and free for freelancers!

The system lets you keep client/vendor database, with contacts and rates, manage projects and assign jobs to vendors, issue invoices, track payments, store and manage project files, generate business reports on turnover profit per client/manager etc.

More info »



Forums
  • All of ProZ.com
  • Term search
  • Jobs
  • Forums
  • Multiple search