Question: Do you know of any tool / script to detect a web site's language?

[Mcod]

Hi there,

 

My big question of the day is: Do you know of any tool / script to detect a web site's language?

 

I basically have a list of 1 million URL's (Alexa Top 1 Million by rank) and would like to batch check the URL's to find out which site is written in English and filter out the ones who are not. I have the data in a mysql database, but checking so many URL's one by one by downloading the site, analyzing the text and guess what language it is takes too many server resources (I tried). That said, do you maybe know a tool or API which can "guess" the language by feeding a list of URL's?

 

Thanks

[Pikachu2000]

Maybe Google Translate has an API?

[scootstah]

Maybe Google Translate has an API?

 

They might not like it if you loop it 1 million times, though.

[Pikachu2000]

If they have that functionality, I'm sure they charge for API usage over x calls/day, so maybe they actually would like it

[Philip]

Yar, it is indeed $$.

 

Figuring out the language (by grabbing a string) and the cost

[scootstah]

Yar, it is indeed $$.

 

Figuring out the language (by grabbing a string) and the cost

 

Eek.