The Ultimate Guide to the Invisible Web

When you use a search engine on the Internet and can't find what you're looking for, what do you do? Maybe you're seeking to learn something, which means you're probably going to keep trying until you find it. Or give up in frustration. Don't give up that easily. There's information out there that is actually not indexed in the big search engines. Such Web pages are part of what's called the Dark, Deep, Hidden or Invisible Web. Those pages that are actually indexed are known by some as the surface Web. Fortunately, the invisible Web is getting easier to search, with tools beyond the standard big three search engines such as Google, Yahoo, and MSN.

In the early days of the Web, computing power and storage space was at such a premium that the few search engines that were around often indexed only a tiny fraction of Web pages and not even full pages at that. But eventually space became relatively cheap and engines started indexing pages in full (full text), as well as more pages. Still, engines miss a lot of pages. Here's a guide to those "invisible" pages. The Ultimate Guide to the Invisible Web | OEDb

Linked by shanmuga Monday, 18th December 2006 10:32PM