100 million sites on the web??

CNN: Web reaches new milestone: 100 million sites

At first sight you might wonder how you can possibly visit all of these sites. It's actually really not that bad. Assuming you want to go to all 100 million sites and it takes you one second per site serially, it will only take you about 3.16 years to get that done.

Alternatively, assuming your hands can't type in all these sites too fast and you can't afford to sit around for 3.16 years with no sleep, you can actually write a script to do that for you. Assuming you're behind a 100mbps NIC and assuming an average response size of a webpage is 14kB, then you can probably issue ~892 wgets per second assuming the server side has 0 latency. Given that, it will really only take you ~1.29 days to do that.

Of course, that's only visiting the front page of every site. But hey, at least you'll get to go to the gusiness book of records for this.

Oh but wait, all the search engines out there have probably already done that. Pfft.