Query user-agent string on line. provide a user-agent list as used by search-engines crawlers and spiders, Internet browsers, dowload tools, proxy servers, web directories, spambots, etc...
You are here: Home » User-agent List » Yahoo! Slurp
Yahoo! Slurp User-Agent String
| User-Agent Name | Yahoo! Slurp | |
| User-Agent URL | http://help.yahoo.com | |
| Category | Robot, Spider, Crawler | |
| Organization | Yahoo! Inc. | |
| Total Strings | 1 | |
| Last Visit | Nov 28, 2009 18:57 PST |
All user-agent string from Yahoo! Slurp
| # | User-Agent String | Visit Frequency | Last Visit | View |
|---|---|---|---|---|
| 1 | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | 582177 | Nov 28, 2009 18:57 PST | View Detail |
The description about Yahoo! Slurp
Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! Search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.
As part of the crawling effort, the Yahoo! Slurp crawler takes robots.txt standards into account to ensure we do not crawl and index content from those pages whose content you do not want included in Yahoo! Search. If a page is disallowed to be crawled by robots.txt standards, Yahoo! does not read or use the contents of that page.