Towards a set of example documents for CAT tool comparison
Thread poster: Hans Lenting
Hans Lenting
Hans Lenting
Netherlands
Member (2006)
German to Dutch
Sep 30, 2012

(I'm taking these quotes out of another thread in this forum, just to make a new topic from it.)

I wrote:


When comparing printers people often use the famous Dr. Grauert letter:

http://de.wikipedia.org/wiki/Dr.-Grauert-Brief

Why not create such a benchmark text ourselves in order to test the quality of fuzzy matching and subsegment leverage, in order to compare our CAT tools?

What would be a good language combination for this?


And Michael B. responded:


Interesting idea about the 'Dr. Hans letter'. I suppose you would have to have one in every language someone might want to test. However, once one existed, MOUSE tool vendors could of course cheat by optimising their tool to handle that one page particularly well... Also, there would be the problem of selecting a type of text; technical, legal, literary, etc. Good luck!


I didn't say it would be simple . But I think it is time to take comparisons one step further. It is fascinating to know that CAT tool A has nicer buttons, a crispier font and a stunning grid than CAT tool B. But at the end of the day, what really matters is how well does a CAT tool perform with term recognition and TM matching.

And what could be against CAT tool vendors optimising their tools for a certain set of example documents? We can always make new version, e.g. to include new features of a certain DTP or word processor software.

Compliance with de facto standards as SDLXLIFF is a starting point, not the final goal. BTW, talking about this, I just read a horrible report from Duncan Bell in the Déjà Vu user list at Yahoo Groups. One quote I'd like to present here, because it describes a horrible scenario:


It's no pleasure to me at all to have to say that "very simple,
step-by-step explanations" are not possible in this case! It's a
complicated matter! The need to handle Studio files has added
considerably to our admin effort and time spent not translating but doing necessary peripheral work.


I remember that I once was very enthusiastic about the inter-CAT tool compatibility XLIFF would allow ...


 
Samuel Murray
Samuel Murray  Identity Verified
Netherlands
Local time: 22:27
Member (2006)
English to Afrikaans
+ ...
Different files to show different problems Sep 30, 2012

Hans Lenting wrote:
It is fascinating to know that CAT tool A has nicer buttons, a crispier font and a stunning grid than CAT tool B. But at the end of the day, what really matters is how well does a CAT tool perform with term recognition and TM matching.


Not really, no. What attracts me to a CAT tool is ease of use, not whether it has many features. If a UI is cumbersome, if I have to squint to see the text, if I have to use my mouse in awkward ways, if the cursor does not respond the way I expect it to respond, etc... those are things that speed me up or slow me down.

That said, I agree that a set of files would be nice to have. You can have a Word file with lots of hidden codes, to show how the various tools handle unzapped documents, for example. The "sample" files used by comparison videos are often deliberately sanitised so that the poor user won't be scared off by what *real* documents look like.

It's no pleasure to me at all to have to say that "very simple, step-by-step explanations" are not possible in this case! It's a complicated matter! The need to handle Studio files has added considerably to our admin effort and time spent not translating but doing necessary peripheral work.


Something can be simple and still require a lot of steps to perform. I suspect that what many people want with "simple" is something that doesn't take up too much of your time.


 
Hans Lenting
Hans Lenting
Netherlands
Member (2006)
German to Dutch
TOPIC STARTER
I think we agree Sep 30, 2012

Samuel Murray wrote:

Not really, no. What attracts me to a CAT tool is ease of use, not whether it has many features. If a UI is cumbersome, if I have to squint to see the text, if I have to use my mouse in awkward ways, if the cursor does not respond the way I expect it to respond, etc... those are things that speed me up or slow me down.


I take those features for granted so I think, basically we agree .

Hans


 


To report site rules violations or get help, contact a site moderator:


You can also contact site staff by submitting a support request »

Towards a set of example documents for CAT tool comparison







TM-Town
Manage your TMs and Terms ... and boost your translation business

Are you ready for something fresh in the industry? TM-Town is a unique new site for you -- the freelance translator -- to store, manage and share translation memories (TMs) and glossaries...and potentially meet new clients on the basis of your prior work.

More info »
CafeTran Espresso
You've never met a CAT tool this clever!

Translate faster & easier, using a sophisticated CAT tool built by a translator / developer. Accept jobs from clients who use Trados, MemoQ, Wordfast & major CAT tools. Download and start using CafeTran Espresso -- for free

Buy now! »