
	Where results make sense

Topic: World Wide Web Wanderer

Related Topics

Search engine

Common Gateway Interface

Gopher protocol

Perl

Java programming language

Unix manual

Command (computing)

In the News (Tue 29 Dec 09)

Northern Trust

Marvin Harrison

Peter Chernin

Gary Locke

Match Play

Penelope Cruz

Mickey Rourke

AR Rahman

Danny Boyle

Hugh Jackman

	Wired 4.04: Bots Are Hot!
		Web robots are often referred to as spiders and less frequently as wanderers and worms.
		The first Web robot was the World Wide Web Wanderer, a script written in the spring of 1993 by MIT student Matthew Gray.
		Web robots should not be confused with search engines, the programs that act upon the databases of information the bots assemble.
	www.wired.com /wired/archive/4.04/netbots.html?pg=6&topic=robots_ai (731 words)

	World Wide Web Wanderer - Wikipedia, the free encyclopedia
		Also referred to as just the Wanderer, this was a perl based web crawler that was first deployed in June, 1993 to measure the size of the World Wide Web.
		The Wanderer was developed at MIT by Matthew Gray.
		Later in 1993, it was used to generate an index called the "Wandex", providing the first search engine on the web.
	en.wikipedia.org /wiki/World_Wide_Web_Wanderer (107 words)

	World-Wide Web for the Warrior
		Web pages are created using HyperText Markup Language (HTML), a subset of SGML, the Standard Generalized Markup Language, which has found broad use in creating and publishing large, structured documents in the defense, pharmaceutical and aerospace industries.
		Web browsers function by interpreting the HTML tags the author puts in the text, usually at the beginning and end of the tagged item.
		When you consider that the Web is only about two years old and these are the evolutionary equivalents of Internet protozoa, the thought of what we may be able to provide over the Web in a few years staggers the imagination.
	www.chips.navy.mil /archives/95_oct/file6.html (2847 words)

	A Brief History of Search Engines - webreference.com
		Almost 20 years after the creation of the Internet, the World Wide Web was born to allow the public exchange of information on a global basis.
		According to The Web Robots FAQ, "A robot is a program that automatically traverses the Web's hypertext structure by retrieving a document, and recursively retrieving all documents that are referenced.
		Web robots are sometimes referred to as web wanderers, web crawlers, or spiders.
	www.webreference.com /authoring/search_history (1710 words)

	Measuring the Growth of the Web
		The World Wide Web was started originally proposed in 1989 and the first implementation appeared in 1990.
		As the Web grew rapidly, the focus quickly changed to charting the growth of the Web.
		The Wanderer was first functional in spring of 1993 and performed regular traversals of the Web from June 1993 to June 1995.
	www.mit.edu /people/mkgray/growth (415 words)

	Challenges for Web Information Providers
		Web growth can also be seen in terms of the number of servers, amount of traffic, and increasingly various kinds of information offered.
		Matthew Gray, writing in his web page "Growth of the World Wide Web" reports a dramatic increase in the number of servers.
		According to NSFNET backbone statistics, during the first several months of 1994, the Web's share of NSFNET backbone traffic increased from 2.6 percent in January to 6.1 percent in June, surpassing Gopher in terms of bytes transferred in March.
	www.ibiblio.org /cmc/mag/1994/oct/webip.html (989 words)

	Benson Technology© - Your Visual Media Specialists - Website Design, Graphic Design, Hosting, Logos, and More! (Site not responding. Last check: 2007-11-03)
		The first Web search engine was "Wandex", a now-defunct index collected by the World Wide Web Wanderer, a web crawler developed by Matthew Gray at MIT in 1993.
		Web link analysis was first developed by Dr. Jon Kleinberg and his team while working on the CLEVER project at IBM's Almaden research lab.
		Most web search engines are commercial ventures supported by advertising revenue and, as a result, some employ the controversial practice of allowing advertisers to pay money to have their listings ranked higher in search results.
	www.bensontechnology.com /faq_search_engines-0.htm (1576 words)

	SoftLab Tele-Training System: Introduction Page
		Although the World-Wide Web project has the potential to make a significant impact in these areas, it is poised to revolutionize many elements of society, including commerce, politics, and literature.
		Even though the robot's programming was improved somewhat, and a number of factors may have affected the final count, the growth rate of the Web from the last half of 1993 throughout the first half of 1994 is amazing and continues to increase.
		However, considering the number of hosts that frequent the most populated areas of the Web, it is safe to say that there are around 250,000 to 500,000 current active Web users today.
	www.softlab.ece.ntua.gr /~thpalpa/samples/odiseas_intro.html (1304 words)

	Searching the Web for Information: How do we Fare?
		The World Wide Web is an incredibly fast-growing phenomena and with this growth comes an overwhelming amount of information which is not locatable in any structured manner.
		All three methods of locating information on the Web are valid and the user will find that one method is more appropriate than another depending on the type of information required.
		We may just have to concede that the World Wide Web will never be capable of indexing Webspace and that the subject tree approach is an excellent alternative.
	www.csu.edu.au /special/conference/apwww95/papers95/gwestera/gwestera.html (2946 words)

	Dr. Dobb's \| Webmaster's Domain \| How Shall I Measure Thee? Let Me Count the Ways. \| January 1, 2002
		From the papers available at PARC's Web site, I learned a number of interesting things, including the fact that the "six degrees of separation" rule is in fact much compressed on the Web; you can travel from any site on the Web to any other site in approximately four clicks.
		Web surfers are honeybees flitting from flower to flower in search of the sweet nectar of information.
		As the Web continues its explosion and cyberspace expands to fill our minds if not our cellars, people will continue to try to gain a modicum of control over it by measuring it, weighing it, sorting it, and modeling it.
	www.ddj.com /dept/architect/184413947?pgno=2 (1855 words)

	Transient Vagabond Arrives - World Affairs Board
		The World Affairs Board is one of the leading forums for the discussion of political, military, and defense topics.
		If you have served in one of the world's armed forces as an NCO or officer, make sure to take a look at our Military Professional program.
		By the latter we are known at home, by the former to the world.
	www.worldaffairsboard.com /showthread.php?p=70827 (390 words)

	Search Engines - Overview - Google - Yahoo
		The first Web search engine was "Wandex", a now-defunct index collected by the World Wide Web Wanderer, a web crawler developed by Matthew Gray at MIT in 1993.
		Web link analysis was first developed by Dr. Jon Kleinberg and his team while working on the CLEVER project at IBM's Almaden research lab.
		Most Web search engines are commercial ventures supported by advertising revenue and, as a result, some employ the controversial practice of allowing advertisers to pay money to have their listings ranked higher in search results.
	www.linksandlaw.com /technicalbackground-searchengines.htm (4544 words)

	PAM NOTE - How popular is the Web?
		The NCSA produces a number of popular software products for World-Wide Web use and their Web site is used as documentation for their products as well as a repository for announcements of new events on the Web.
		50% of Web users being highly educated professionals working in technical and academic field whilst the "other half" are students and recent graduates working in technical, managerial or professional fields.
		It is probably this ease of use as well as the popularity of many graphical interfaces to the Web that caused the explosion of Web traffic from 1993.
	www.ai.sri.com /~berry/PAM/PAM-1H.html (934 words)

	Wiley :: Companion Sites / Sonnenreich et al.
		The Wanderer was the first robot on the web and was designed to track the web's growth.
		Matthew Gray’s Wanderer inspired a number of programmers to follow up on the idea of web robots, or spiders, as they are now called.
		This was very useful for web designers who were trying to get some popularity for their pages; they could frequently check to see how many other pages were referencing them.
	www.wiley.com /legacy/compbooks/sonnenreich/history.html (5174 words)

	Website Directory: Search Engine Optimization and Search Engine History
		The Web is in fact just a single component of the Internet as a whole, but mostly when people refer to the "Internet" they actually mean the World Wide Web.
		In the early history of the World Wide Web the only way to pass information from one computer to another on the Internet was via File Transfer Protocol or FTP, this required that one computer knew the address of another.
		Matthew Gray's World Wide Web Wanderer was the first autonomous agent on the web, it was designed to track the growth of the internet, initially it counted only web servers but leter it started to capture URL's as well.
	www.thisisouryear.com /index.html?p=history (2027 words)

	Web Searching - Search Industry Explained (Part 1)
		During this time the Web has blossomed from isolated static pages of scientific papers to billion pound revenue dynamic marketing behemoths driven by teams of professional web developers and marketers whose collective duties culminate in a web presence made visible in the search engines.
		It was becoming evident the Web was growing fast and some method of identifying, archiving, cataloguing and categorising the ever growing content was required.
		The World Wide Web, as we now know it, was yet to be born but the proliferation of disparate information was soon to be corralled as first Archie and Veronica then Gopher indexed and transmitted requests for specific information from the first Internet document database.
	www.searchandgo.com /articles/search-engine-marketing.php (714 words)

	AusWeb95 - The WWW.AU Index of Australian Web Sites
		This usually happens when one category is growing too large and there is a logical way to reorganise the groupings, or in response to feedback from people who enter their sites into the index but feel that no existing category accurately reflects the content of their site.
		Essentially, these indexes are formed by "web robots" which start with a set of web documents and then perform various types of graph traversals along the hypertext links to find further web documents which are added to the initial set.
		These web robots differ in the details of how the traversal is carried out, what documents are retained and for how long, and which parts of the documents are used for index searches.
	ausweb.scu.edu.au /aw95/tools/goldschager/index.html (4389 words)

	Mike's Web Page - Search Tools
		The extensive WWW Virtual Library is a powerful search tool that allows you to find information on almost any of the world's Web servers through user-friendly key word searches.
		A fair amount of information is available to proles but magnates who've made their millions may want to subscribe to the in-depth service for £7400 pa. Like most villages, it's easy to find your way around and the atmosphere is friendly.
		Seldom mentioned but holding its own, Galaxy's Web directory is both an engine that searches for your request and a listings directory of Web addresses.
	members.fortunecity.com /mnorton/srchtool.htm (2879 words)

	index.htm (Site not responding. Last check: 2007-11-03)
		- As early as June 1993, Matthew Gray deployed the World Wide Web Wanderer to measure the growth of the Web by discovering and counting the number of Web servers.
		A type of Web robot, known as Web maintenance spiders, exist to traverse their own particular section of Web space by periodically and automatically traversing the indexed hypertext structure in search of dead links.
		Web maintenance robots can also be designed to monitor such things as document style conformance and document HTML compliance.
	www.slais.ubc.ca /courses/libr500/00-01-wt2/www/E_Hernandez/Uses.htm (284 words)

	Measurements of WWW Connection Latency (Site not responding. Last check: 2007-11-03)
		Over the last few months, I have been conducting tests of connection latency to world wide web document servers around the world.
		The list of servers I contact is a subset of those found by World Wide Web Wanderer a program that periodically measures the size of the web by doing a controlled depth-first traverse.
		Once the data has been collected, I will summarize it and make it available on the web, most likely as a technical report.
	www.cs.virginia.edu /~clv2m/webtest.html (688 words)

	World Energy Efficiency Organization
		The Globe wide Network Academy (GNA) is a global non-profit consortium of educational and research organizations intended to improve education by creating a central marketplace for courses as well as to offer administrative and technical services in support of online courses.
		The index is constructed by a spider that walks the web, building a graph in an Oracle database, and WAIS indexing the full text of the document.
		The World Wide Web Consortium provides the overall structure for this virtual library.
	www.weea.org /Directories/Directory-libraries.htm (1530 words)

	BSEG Submission
		The Xanadu(TM) project was founded by Ted Nelson, who invented the concepts of hypertext and hypermedia and coined the words in his 1965 ACM national conference presentation "A File Structure for the Complex, the Changing and the Indeterminate".
		According to the World Wide Web Wanderer, growth of WWW is currently estimated at around 3000% per annum.
		It is my personal belief that the significant disparity in the amount of bandwidth required to provide text-based services and multimedia services will eventually make it more economical to provide text-based services for free rather than bother with fractional-cent accounting, especially considering the advantages of providing a minimal level of service to the entire population.
	www.aus.xanadu.com /xanadu/BSEG.html (990 words)

	What is The World Wide Web? (Site not responding. Last check: 2007-11-03)
		The operation of the Web relies mainly on hypertext as its means of
		Web from the last half of 1993 throughout the first half of 1994 is amazing
		Web is to name the person in charge of administrating a World-Wide Web site a
	www.rdc.com.au /WhatisWWW1.html (2564 words)

	Guide to Cyberspace 6.1: How popular is the Web?
		Even though the robot's programming was improved somewhat, and a number of factors may have affected the final count, the growth rate of the Web from the last half of 1993 throughout the first half of 1994 is amazing and continues to increase.
		Based on Web site statistics, estimates of the number of knowledgeable Web users in the world has been as large as two million.
		Because HCC's service began operation when there were relatively few such sites in the world, and in part due to its popularity, their growth in traffic has closely reflected the growth of the Web.
	aggie-horticulture.tamu.edu /wwwguide/guide.05.html (981 words)

	World-Wide Web
		Conceptually the web began in 1989 at CERN, European Laboratory for Particle Physics, as part of an effort to assist scientists around Europe collaborate.
		The model presented by Tim Berners-Lee, then at CERN now with the World Wide Web Consortium based at MIT, was a distributed, hypermedia model.
		Practically speaking, using a web client meant you were using one software package to access any number of information providers, regardless of protocol.
	www2.umassd.edu /topics/foundations/www.html (1186 words)

	What was the First Search Engine?
		Before the World Wide Web existed, but after the advent of the Internet and its ensuing popularity in the university circuit, the first search engine was created.
		In 1993, not long after the creation of the World Wide Web, Matthew Grey developed the World Wide Web Wanderer, which was the first web robot.
		The World Wide Web Wanderer indexed all of the websites that existed in the internet by capturing their URLs, but didn’t track any of the actual content of the websites.
	www.wisegeek.com /what-was-the-first-search-engine.htm (771 words)

	Relevance and insight in experimental studies
		The first gathering program for the Web was the World Wide Web Wanderer (2).
		In October 1993, Aliweb (Archie-Like Indexing of the Web), an analog of the Archie system, was developed (3).
		Individual users were encouraged to find a node in the tree that best fits their Web page and to submit descriptions of their Web pages to be included at that point in the hierarchy.
	lazytoad.com /lti/pub/ieee97.html (2689 words)

	Ethics Resources
		The internet had been around for a few years, but its use--except for e-mail--was largely confined to a comparatively small group of academics and researchers who were willing to master the intricacies of Unix servers and such things as ftp.
		The world wide web changed all that, because it brought to the internet a graphical interface.
		Although I haven't tried this out myself, some instructors are allowing students to submit world wide web sites that they have created as term papers.
	ethics.sandiego.edu /resources.html (2012 words)

Try your search on: Qwika (all wikis)