Newsletters Select newsletters below and click the button to sign up!
Internetnews BloggersRecent Entries
ArchivesMonthly ArchivesSearch The Blog
« Microsoft: Not worried about open source patents |
Sean Michael Kerner Blog
| Facebook nabs one Mozilla Mike »
1 trillion unique URLs on the Web From the "Carl Sagan would be proud" files:
Google is now reporting that its seen more than 1 trillion unique URLs on the Web. That's a big number and a massive jump from the 26 million URLs it saw in 1998. But even at a trillion pages Google admits that there are many duplicates (in terms of content), and that there well may be an infinite number of pages overall. Many pages have multiple URLs with exactly the same content or URLs that are auto-generated copies of each other. Even after removing those exact duplicates, we saw a trillion unique URLs, and the number of individual Web pages out there is growing by several billion pages per day.Thanks to the magic of dynamically generated page content (with or without session IDs) and the fact that Google (despite their best efforts) has never effectively indexed Flash content properly -- I personally think the 1 trillion number is on the low side. Now that doesn't mean there are more than a trillion Web sites out there -- the latest netcraft study reports just over 173 million sites. 0 TrackBacksListed below are links to blogs that reference this entry: 1 trillion unique URLs on the Web. TrackBack URL for this entry: https://swarm.jupitermedia.com/mt-tb.cgi/4129 |
||
Leave a comment