how to find valid web servers from a list of random IPs

deejaykaz asked 2 years ago

HI,
I need to sample 1 million web pages for their languages.
after generating random IPs , I need to know which ones belong to a web server. How can I check this.

(I pinged yahoo.com got their IP 209.191.93.53 ,
but using java
InetAddress addr = InetAddress.getByName("209.191.93.53");
I get addr.getHostName as "b1.www.vip.mud.yahoo.com" which is not reachable using the InetAddress.isReachable(maxTimeInMsToTry)
)
any help will be much appreciated.

Regards,
kaz

1 Answers
Cody Robertson Staff answered 2 years ago

Kaz

I can help you with this. However I'd like to know "why are you doing this?". You'll understand that this kind of activity is a very greedy use of network resources. I'd also prefer to discuss this off-line with you as I don't want to discuss this openly. You can contact me directly from my web site: [url]http://clanmills.com[/url].

Know the answer? Login or sign up for an account to answer this question.
Sign Up