Concordancing the DGT with lightning speed
Thread poster: 2nl (X)

2nl (X)  Identity Verified
Netherlands
Local time: 22:36
Oct 2, 2014

Source: http://cafetran.wikidot.com/changelog

2014-09-29 Significant performance improvements in the H2 SQL database. New indexing system; existing tables won’t work. You need to delete the existing tables. Next, create a new table and import your data again. On an i3 laptop it takes 2-3 seconds to complete a search in 1.5 million TUs.

Within seconds, your gigantic database is queried and all matches are displayed:

https://www.youtube.com/watch?v=uhBS5MLNIBg

The database used in the demonstration movie contains 2 million TUs from the DGT. Note that 'Verordnung' and 'Kommission' are very frequent in the DGT, so collecting all hits takes more time.

More info: http://cafetran.wikidot.com/working-with-external-databases


 

FarkasAndras  Identity Verified
Local time: 22:36
English to Hungarian
+ ...
I wonder... Oct 3, 2014

... how this compares to TMLookup (which uses sqlite without any added special sauce).
It does look very fast on the youtube video. Care to do a comparison test?


 

2nl (X)  Identity Verified
Netherlands
Local time: 22:36
TOPIC STARTER
Michael's at it Oct 3, 2014

Michael Beijer is doing some tests with his huge resources (45 GB). I'm quite sure he will report as soon as he's ready.

 

Meta Arkadia
Local time: 04:36
English to Indonesian
+ ...
MySQL Oct 3, 2014

FarkasAndras wrote:
...which uses sqlite without any added special sauce

Igor is going to add MySQL soon, and I suppose SQLite will be next. That would be a nice test, CT SQLite against TMLookup SQLite.

Cheers,

Hans


 


To report site rules violations or get help, contact a site moderator:

Moderator(s) of this forum
Natalie[Call to this topic]

You can also contact site staff by submitting a support request »

Concordancing the DGT with lightning speed

Advanced search






SDL MultiTerm 2019
Guarantee a unified, consistent and high-quality translation with terminology software by the industry leaders.

SDL MultiTerm 2019 allows translators to create one central location to store and manage multilingual terminology, and with SDL MultiTerm Extract 2019 you can automatically create term lists from your existing documentation to save time.

More info »
Déjà Vu X3
Try it, Love it

Find out why Déjà Vu is today the most flexible, customizable and user-friendly tool on the market. See the brand new features in action: *Completely redesigned user interface *Live Preview *Inline spell checking *Inline

More info »



Forums
  • All of ProZ.com
  • Term search
  • Jobs
  • Forums
  • Multiple search