Html text extraction
Thread poster: MIGUEL JIMENEZ

MIGUEL JIMENEZ  Identity Verified
Local time: 20:51
English to Spanish
+ ...
Nov 29, 2005

Hi,
I am trying to compile a big corpus of text extracted from webpages for some research. I was wondering if anybody would know what would be the best tool to extract "translatable" text only from html pages and create a separate text file. This would be for research purpouses only, I would not need to convert back to html, xml or anything.
Thanks for your help


Direct link Reply with quote
 
xxxMarc P  Identity Verified
Local time: 02:51
German to English
+ ...
Html text extraction Nov 29, 2005

Why not simply open the html file in a suitable word processor (such as OpenOffice.org) and "Save As" plain text? Are there too many files?

Marc


Direct link Reply with quote
 

Rodolfo Raya  Identity Verified
Local time: 21:51
English to Spanish
Word processors miss text Nov 29, 2005

MarcPrior wrote:

Why not simply open the html file in a suitable word processor (such as OpenOffice.org) and "Save As" plain text? Are there too many files?

Marc


Word processors usually ignore translateable attributes, such as "alt" in images.

Rodolfo


Direct link Reply with quote
 
Sonja Tomaskovic  Identity Verified
Germany
Local time: 02:51
English to German
+ ...
.. Nov 29, 2005

Rodolfo Raya wrote:
Word processors usually ignore translateable attributes, such as "alt" in images.


I doubt that someone who needs "to compile a big corpus of text extracted from webpages for some research" needs the alt attribute of an image.

Another solution would be to open the file with a text editor and remove all html tags. This should be able with regexp.


Sonja


Direct link Reply with quote
 

Samuel Murray  Identity Verified
Netherlands
Local time: 02:51
Member (2006)
English to Afrikaans
+ ...
HTML2TXT and a DOS command Nov 29, 2005

MIGUEL JIMENEZ wrote:
I am trying to compile a big corpus of text extracted from webpages for some research. I was wondering if anybody would know what would be the best tool to extract "translatable" text only from html pages and create a separate text file.


In two steps.

1. Download Bobsoft's HTML2TXT and use it to convert all the html files into text files:
http://www.bobsoft.com/h2t/

2. Merge all the text files into a single file, using the following DOS command:
copy *.* > /b all.txt

Good luck!


Direct link Reply with quote
 

Samuel Murray  Identity Verified
Netherlands
Local time: 02:51
Member (2006)
English to Afrikaans
+ ...
Try Caterpillar (shareware) Nov 29, 2005

Rodolfo Raya wrote:
Word processors usually ignore translateable attributes, such as "alt" in images.


Well, in that case, try Caterpillar by Stormdance. The web site says "Extracts all text requiring translation - including hidden text and text within tags etc."

The shareware version is limited to 8 HTML pages per project, though. Cost for full version is GBP 25.00. The author claims it is "Wordfast compatible".


Direct link Reply with quote
 


To report site rules violations or get help, contact a site moderator:


You can also contact site staff by submitting a support request »

Html text extraction

Advanced search







CafeTran Espresso
You've never met a CAT tool this clever!

Translate faster & easier, using a sophisticated CAT tool built by a translator / developer. Accept jobs from clients who use SDL Trados, MemoQ, Wordfast & major CAT tools. Download and start using CafeTran Espresso -- for free

More info »
PerfectIt consistency checker
Faster Checking, Greater Accuracy

PerfectIt helps deliver error-free documents. It improves consistency, ensures quality and helps to enforce style guides. It’s a powerful tool for pro users, and comes with the assurance of a 30-day money back guarantee.

More info »



Forums
  • All of ProZ.com
  • Term search
  • Jobs
  • Forums
  • Multiple search