
	Where results make sense

Topic: Deep web

Related Topics

Web crawler

PageRank

Web robot

Knowledge representation

Robot

KnowLedge

In the News (Sat 19 Dec 09)

Northern Trust

Marvin Harrison

Peter Chernin

Gary Locke

Match Play

Penelope Cruz

Mickey Rourke

AR Rahman

Danny Boyle

Hugh Jackman

	Deep web - Wikipedia, the free encyclopedia
		The deep web (or invisible web or hidden web) is the name given to pages on the World Wide Web that are not part of the surface web that is indexed by common search engines.
		The deep web should not be confused with the term dark web or dark internet which refers to machines or network segments not connected to the Internet.
		In opposition to the 'surface web' is the 'deep web'.
	en.wikipedia.org /wiki/Deep_web (1171 words)

	The Deep Web (Site not responding. Last check: 2007-10-09)
		In fact, the part of the Web that is not fixed, and is served dynamically "on the fly," is far larger than the fixed documents that many associate with the Web.
		The phenomenon of databases on the Web has been talked about for years, before the terms "invisible Web" or "deep Web" were coined.
		The concept of the deep Web is becoming more complex as search engines such as Google have found ways to integrate deep Web content into their centralized search function.
	library.albany.edu /internet/deepweb.html (1088 words)

	PDQ Library: Deep Web
		Deep Web sites store their content in searchable databases that only display results in response to a request - then a Web page is generated on-the-fly to display the results of your request.
		Deep Web sites tend to be narrower in focus, but with deeper content than conventional surface sites.
		Deep Web content is highly relevant to every information need, market and domain, with most sites containing topic specific databases.
	www.pdqwebdesign.ca /lib/deepweb.html (262 words)

	CompletePlanet - Deep Web FAQ
		The Deep Web is content that resides in searchable databases, the results from which can only be discovered by a direct query.
		But BrightPlanet’s Deep Web white paper is the first to comprehensively define, quantify and characterize this entirely different category of Web content.
		Total quality content of the Deep Web is at least 1,000 to 2,000 times greater than that of the surface Web.
	aip.completeplanet.com /aip-engines/help/help_deepwebfaqs.jsp (1450 words)

	DeepWeb.com - Your source for deep web information
		Also known as the 'invisible web', the 'deep web' is a vast repository of web pages, usually generated by database-driven websites, that are available to web users yet hidden from traditional search engines.
		According to a study by Bright Planet, the deep web is estimated to be up to 550 times larger than the 'surface web' accessible through traditional search engines and over 200,000 database-driven websites are affected by the problem.
		But the deep web is a bigger problem than that; The quality of information in the deep web is usually very high (compared to the surface web), because the deep web consists of the major, authorotive websites available on the net.
	www.deepweb.com (479 words)

	BrightPlanet® — Deep Web White Paper
		Though individual deep Web sites have tremendous diversity in their number of records, ranging from tens or hundreds to hundreds of millions (a mean of 5.43 million records per site but with a median of only 4,950 records), these sites are on average much, much larger than surface sites.
		Deep Web sites on average are more highly linked to than surface sites by nearly a factor of two (6,200 links vs. 3,700 links), though the median deep Web site is less so (66 vs. 83 links).
		By 2000, original deep Web content is estimated to have exceeded print by a factor of seven and is projected to exceed print content by a factor of sixty three by 2003.
	www.brightplanet.com /technology/deepweb.asp (11437 words)

	Turns of Phrase: Deep Web
		The firm also points out that the deep data is usually of excellent quality, and that most of it is publicly accessible without charge.
		BrightPlanet estimates that this so-called “deep Web” could be 500 times larger than the surface Web that most search engines try to cover.
		The FAA database is part of the invisible Web, sometimes called the “deep Web”— a vast repository of information hidden in databases that general-purpose search engines don’t reach.
	www.worldwidewords.org /turnsofphrase/tp-dee1.htm (209 words)

	Optimizing Dynamic Web Sites - Metamend
		Making this deep web visible to the search engines is part of the search engine optimization process.
		The Deep Web is different from the rest of the Internet, in that most of the Deep Web content is stored in searchable databases that only produce results dynamically in response to a direct request.
		Deep Web content is highly focused and relevant.
	www.metamend.com /deep-web.html (1082 words)

	Deep Web Data Extraction
		Web pages in the Deep Web are dynamically-generated in response to a query through a web site's search form and often contain rich content.
		A recent study has estimated the size of the Deep Web to be more than 500 billion pages, whereas the size of the "crawlable" web is only 1% of the Deep Web (i.e., less than 5 billion pages).
		In analogy to search engines over the "crawlable" web, we argue that one way to unlock the Deep Web is to employ a fully automated approach to extracting, indexing, and searching the query-related information-rich regions from dynamic web pages.
	www.cc.gatech.edu /projects/disl/specialProjects/DeepWeb.html (736 words)

	LLRX -- Deep Web Research
		Searching the World Wide Web Using Your Brain and Bots is a keynote presentation that I have been delivering over the last year, and much of my information comes from the extensive research that I have completed over the years into the “invisible” or what I like to call the “deep” web.
		Comparing historical perspectives with current day thinking allows one to appreciate the true “deep web” and how it is changing the way the web is searched and the many new ways to discover, retrieve and extract information from the deep web.
		To properly search the Deep Web, one must be armed with the appropriate resources and tools necessary to accomplish the mission to search, retrieve and extract information from areas on the web that have never been searched before or areas that search engines cannot actively extract from.
	www.llrx.com /features/deepweb.htm (953 words)

	The Deep Web (Site not responding. Last check: 2007-10-09)
		It has been estimated that content on the deep Web may be 500 times larger than the content provided by search engines.
		This aspect of the Web is sometimes (though unfortunately) referred to as the "invisible Web" because database content is "invisible" to search engine spiders.
		Another term used for this phenomenon is "deep Web," a better term since database content is visible with the appropriate technology.
	library.albany.edu /internet/deep.html (529 words)

	Searching the Deep Web: Directed Query Engine Applications at the Department of Energy
		Both qualitative and quantitative in difference, deep web content is estimated at 500 times that of the surface web, yet has remained mostly untapped due to the limitations of traditional search engines [1].
		Although the phrase "deep web" was not yet in the lexicon, it was immediately evident that common web search engines would not be capable of searching the rich full text of collections like the Information Bridge.
		As the deep web continues to grow deeper, the importance of Directed Query Engine tools increases proportionately and the Distributed Explorer application is well positioned as the first generation architecture for the PSII.
	www.dlib.org /dlib/january01/warnick/01warnick.html (3757 words)

	The "Deep web" (Site not responding. Last check: 2007-10-09)
		What they cannot see is often called the "Invisible" or "Deep" Web.
		Information held on "invisible" web sites tends to be of a much higher quality - more reliable, more up-to-date, more flexible, and in more detail.
		Instead of directly seeking the information, when searching the "Deep Web" you must first search for sites likely to contain the information you require - in the same way that you would search for information in a traditional library by first identifying where in the library books on that subject might be held.
	library.ons.gov.uk /Companion/the_invisible_web.htm (338 words)

	JEP: The Deep Web (Site not responding. Last check: 2007-10-09)
		Although it is designed as a marketing tool for a program "for existing Web portals that need to provide targeted, comprehensive information to their site visitors," its insight into the structure of the Web makes it worthwhile reading for all those involved in e-publishing.
		Finally, the estimates for the size of the deep Web include neither specialized search engine sources -- which may be partially "hidden" to the major traditional search engines -- nor the contents of major search engines themselves.
		Also, the absolute number of results shows that deep Web sites tend to return efensible conclusion that quality is many times greater for the deep Web than for the surface Web.
	www.press.umich.edu /jep/07-01/bergman.html (10522 words)

	BrightPlanet® — Deep Web F.A.Q.
		Total quality content of the deep Web is much greater than that of the surface Web.
		Because traditional search engine crawlers can not probe beneath the surface, the deep Web has heretofore been hidden in plain sight.
		Ultimately, CompletePlanet’s goal is to list all deep Web sites and to keep current with new ones as they arise.
	www.brightplanet.com /deepcontent/deep_web_faq.asp#WhatIs (1331 words)

	Deep Web Technologies - Technology - Explorit Software
		They permit researchers to perform a single query across hundreds of different types of sources at once, culminating with merged results that are automatically relevance-ranked.
		It can be configured to access a variety of web databases, independent of the full-text search engine or database package being used.
		For each web page it inspects, the Focused Crawler determines whether or not the page is relevant according to the indicated criteria.
	www.deepwebtech.com /dexpl.shtml (399 words)

	Deep Web Technologies
		Abe Lederman, President and CTO of Deep Web Technologies presented a talk addressing the challenges associated with the searching of 1000s of information sources through federated search at this years Search Engine Meeting in Boston, MA.
		Deep Web Technologies provides customized software and crawling solutions for knowledge management.
		Deep Web Technologies is expert at mining the deep web - the part of the Internet that encompasses vast and diverse content including commercial subscription databases, content buried within publicly available websites, and internally-generated documents scattered throughout an organization.
	www.deepwebtech.com (171 words)

	Deep Web Research
		Marcus P. Zillman's article titled Deep Web Research 2006 was the feature article in the January 2006 LLRX and can be read by clicking here.
		Deep Web Research 2006 Report by Marcus P. Zillman HTML Format By Clicking Here.
		Deep Web Research 2006 Report by Marcus P. Zillman.PDF Format (40 Pages 644KB) By Clicking Here.
	deepwebresearch.blogspot.com (1532 words)

	Getting in Deep
		While the Deep Internet provides the most reliable information for many topics, it can do little good for those who do not consult it because it is unknown to them.
		Debbie, one of the most inventive teacher librarians and Internet pioneers in the USA (click for bio), has listed 38 types of research or questions that a student might need to approach and then points to several sources that are appropriate for each.
		In yet another somewhat mystical approach to the Deep Internet, there are some who would find meaning in the layers of detritus itself, arguing that the waste products of digital endeavors can produce insights when properly exploited, employing a metaphor such as the extraction of methane gas from a landfill to explain the strategy.
	fno.org /feb06/deep.html (1655 words)

	deep web (Site not responding. Last check: 2007-10-09)
		Read about deep web in the free online encyclopedia and dictionary.
		Find deep web at one of the best sites the Internet has to offer!
		Find results for deep web and anything else you are looking for instantly!
	xtypa.com /deep_web.htm (198 words)

	LLRX -- Deep Web Research
		His Subject Tracer Information Blogs (41 and constantly growing) are freely available from the Virtual Private Library, which include the latest resources on Deep Web Research and Bot Research.
		Deep Web Research 2005 is a very exciting place to search and to do research.
		This article is constantly updated as its source is the Deep Web Research Subject Tracer Information Blog.
	www.llrx.com /features/deepweb2005.htm#resourcesdeepwebresearch (1515 words)

	The Deep Web (Site not responding. Last check: 2007-10-09)
		Traditional search engines cannot "see" or retrieve content in the "Deep Web".
		The "Deep Web" is a vast reservoir of Internet content that is estimated to consist of 500 billion pages of information.
		Growing compiliation of links that reside on the Invisible Web.
	www.informational.com /deepweb.htm (163 words)

	OSTI Communications - Atoms for Peace video, Office of Scientific and Technical Information, U.S. Department of Energy, ...
		To support the needs of Web patrons, OSTI has developed state-of-the-art technologies and services including a Deep Web search capability.
		The Deep Web includes content in searchable databases available to Web users but not accessible by popular search engines.
		This video provides an introduction to the Deep Web search engine and how it can be used to access RandD information contained in previously hard-to-find databases.
	www.osti.gov /media/DeepWebVideo.html (131 words)

	Catalogablog
		Our catalog is part of the deep or invisible Web.
		In an effort to make it more visible I've created a Web page that is just a bibliography with links back to the catalog record for LPI publications.
		It will be interesting to see if and when these publications get indexed by the search engines.
	catalogablog.blogspot.com /2006/03/deep-web.html (152 words)

	Deep Web Pathfinder
		This invaluable material resides on “The Invisible Web,” which is largely comprised of content-rich databases from universities, libraries, associations, businesses, and government agencies around the world.” –from
		The Invisible Web: uncovering information sources search engines can't see by Gary Price and Chris Sherman.
		Invisible Web Website, created and infrequently maintained by the authors of the book of the same name: http://www.invisible-web.net
	library.trocaire.edu /deep_web_pathfinder.htm (247 words)

	Deep Web
		Scientists at federal agencies have filled billions of database fields and millions of Web pages with their research results.
		In May 2003, the department’s Small Business Innovation Research program awarded Deep Web Technologies LLC of Los Alamos, N.M., a $99,000 grant to develop advanced document sorting techniques.
		The Deep Web software ranks results in order of relevance, using several techniques.
	www.gcn.com /print/23_15/26274-1.html (842 words)

	Deep Web
		This massive store of information is locked up inside databases from which Web pages are generated in response to specific queries.
		Although these dynamic pages have a unique URL address with which they can be retrieved again, they are not persistent or stored as static pages, nor are there links to them from other pages.
		The deep Web also includes sites that require registration or otherwise restrict access to their pages, prohibiting search engines from browsing them and creating cached copies.
	computerworld.com /.../websitemgmt/story/0,10801,107097,00.html (1564 words)

	Wired News: Surfing the Deep Web
		The service, called Yahoo Search Subscriptions, allows users to search multiple online subscription content sources and the web from a single search box.
		Users can see content from the sites they subscribe to, while nonsubscribers have the option of paying to see it.
		Content providers, for their part, get access to the vast audience of web search users.
	www.wired.com /news/business/0,1367,67883,00.html?tw=wn_tophead_7 (705 words)

Try your search on: Qwika (all wikis)