Metasearch is used by dogpile to search multiple engines, which gives the user the best search results for each search the user executes. All the searches are filtered for duplicates and copies, and are then shown to the user. Dogpile uses multiple popular search engines, which includes Google, Yahoo! Search, MSN, Ask.com, About, MIVA, LookSmart and more.
Source: http://en.wikipedia.org/wiki/Dogpile
Saturday, 30 June 2007
Friday, 29 June 2007
Acquisition by Ask Jeeves
Excite continued to operate until the Excite Network was acquired by Ask Jeeves (now Ask.com) in March 2004. Ask Jeeves promised to rejuvenate iWon and Excite, but did not. Ask Jeeves management became distracted, according to the East Bay Business Times, first by a search feature arms race with Google and Yahoo!, and then by its $1.85 billion merger with Barry Diller's InterActive Corporation, announced in March of 2005.
Source: http://en.wikipedia.org/wiki/Excite
Source: http://en.wikipedia.org/wiki/Excite
Thursday, 28 June 2007
History
Excite was founded as Architext in 1994 by Graham Spencer, Joe Kraus, Mark Van Haren, Ryan McIntyre, Ben Lutch and Martin Reinfried, who were all computer science students at Stanford University (except for Kraus, who was a political science major). In July 1994 International Data Group paid them $100,000 to develop an online service.
Source: http://en.wikipedia.org/wiki/Excite
Source: http://en.wikipedia.org/wiki/Excite
Wednesday, 27 June 2007
Web crawler architectures
A crawler must not only have a good crawling strategy, as noted in the previous sections, but it should also have a highly optimized architecture.
Source: http://en.wikipedia.org/wiki/Web_crawler
Source: http://en.wikipedia.org/wiki/Web_crawler
Saturday, 23 June 2007
Restricting followed links
A crawler may only want to seek out HTML pages and avoid all other MIME types. In order to request only HTML resources, a crawler may make an HTTP HEAD request to determine a Web resource's MIME type before requesting the entire resource with a GET request. To avoid making numerous HEAD requests, a crawler may alternatively examine the URL and only request the resource if the URL ends with .html, .htm or a slash. This strategy may cause numerous HTML Web resources to be unintentionally skipped. A similar strategy compares the extension of the web resource to a list of known HTML-page types: .html, .htm, .asp, .aspx, .php, and a slash.
Source: http://en.wikipedia.org/wiki/Web_crawler
Source: http://en.wikipedia.org/wiki/Web_crawler
Friday, 22 June 2007
How search engines work
A search engine operates, in the following order
Source: http://en.wikipedia.org/wiki/Searchengine
Source: http://en.wikipedia.org/wiki/Searchengine
Subscribe to:
Posts (Atom)