OmegaT and asian languages
Thread poster: Neirda
Neirda
Neirda  Identity Verified
China
Local time: 17:17
Chinese to French
+ ...
Mar 20, 2013

Hello everyone,

So I just got started with OmegaT and Chinese (simplified), and quickly discovered that Fuzzy Matches and Glossary don't seem to work as they should.

Nothing ever shows up on both windows, even after adding entries on the glossary.
I created a test file with sentences of different similarities and lenghts to test the software's behavior, and it seems like only 100% matches are correctly detected & replaced.

I tried to run the softwar
... See more
Hello everyone,

So I just got started with OmegaT and Chinese (simplified), and quickly discovered that Fuzzy Matches and Glossary don't seem to work as they should.

Nothing ever shows up on both windows, even after adding entries on the glossary.
I created a test file with sentences of different similarities and lenghts to test the software's behavior, and it seems like only 100% matches are correctly detected & replaced.

I tried to run the software using Applocale (the Windows launcher for non-unicode systems) with no change. I checked the project files, TMXes and the glossary file are correctly created and filled. So I don't know where would be the problem. Maybe a char display issue ?
Collapse


 
Didier Briel
Didier Briel  Identity Verified
France
Local time: 11:17
English to French
+ ...
Use a tokenizer Mar 20, 2013

Pierret Adrien wrote:
So I just got started with OmegaT and Chinese (simplified), and quickly discovered that Fuzzy Matches and Glossary don't seem to work as they should.

Nothing ever shows up on both windows, even after adding entries on the glossary.
I created a test file with sentences of different similarities and lenghts to test the software's behavior, and it seems like only 100% matches are correctly detected & replaced.

I tried to run the software using Applocale (the Windows launcher for non-unicode systems) with no change. I checked the project files, TMXes and the glossary file are correctly created and filled. So I don't know where would be the problem. Maybe a char display issue ?

For glossaries, it could be an encoding issue. You could test with an English or French source document and glossary to check everything is working as it should.
(As long as you use correctly UTF-8 glossaries, not system-encoded ones, everything should be fine.)

For fuzzy matches, it's very unlikely.

By default, OmegaT uses Java tokenizer, which can only detect words when they are separated by a space. Of course, it doesn't work for CJK languages.

That's why we provide also tokenizers:
http://www.omegat.org/en/howtos/tokenizer.php

For Chinese, LuceneSmartChineseTokenizer seems to be the better one.
Do not forget to use also a target tokenizer, so that you don't have issues with spellchecking in European target languages.

Didier


 
Neirda
Neirda  Identity Verified
China
Local time: 17:17
Chinese to French
+ ...
TOPIC STARTER
You were right Mar 20, 2013

I must have missed something the first time, I re-set up the tokenizer launcher acording to instructions, and now it works, both fuzzy matches and glossary.

Thank you, and sorry for the trouble.


 


There is no moderator assigned specifically to this forum.
To report site rules violations or get help, please contact site staff »


OmegaT and asian languages






Trados Studio 2022 Freelance
The leading translation software used by over 270,000 translators.

Designed with your feedback in mind, Trados Studio 2022 delivers an unrivalled, powerful desktop and cloud solution, empowering you to work in the most efficient and cost-effective way.

More info »
Anycount & Translation Office 3000
Translation Office 3000

Translation Office 3000 is an advanced accounting tool for freelance translators and small agencies. TO3000 easily and seamlessly integrates with the business life of professional freelance translators.

More info »