RSS feed of httpuseragent.org RSS   Contact  

Contact Andrew

My E-mail:

Subscribe HttpUserAgent.org

RSS Feed of HttpUserAgent.org

Submit Your User-Agent

You are here: Home » User-agent List » Yahoo! Slurp » User-agent string detail

Yahoo! Slurp User-Agent String: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

Yahoo! Slurp

User-Agent NameYahoo! Slurp [1 items]
User-Agent URLhttp://help.yahoo.com/help/us/ysearch/slurp
CategoryRobot, Spider, Crawler
OrganizationYahoo! Inc.  The city and country location of web http://www.yahoo.com/
User-agent StringMozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
Sponsor
Visit Frequency608768
First VisitOct 23, 2007 03:12 PDT
First IP74.6.28.198 - ha6.ge-4-19.bas-1-con.ac2.yahoo.com
Last VisitDec 30, 2011 16:04 PST
Last IP72.30.161.253 - llf531014.crawl.yahoo.net

Last updated: Nov 23, 2008 19:22 PST    

The description about Yahoo! Slurp

Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! Search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.

As part of the crawling effort, the Yahoo! Slurp crawler takes robots.txt standards into account to ensure we do not crawl and index content from those pages whose content you do not want included in Yahoo! Search. If a page is disallowed to be crawled by robots.txt standards, Yahoo! does not read or use the contents of that page.