RSS feed of RSS   Contact  

Contact Andrew

My E-mail:


RSS Feed of

Submit Your User-Agent

You are here: Home » User-agent List » Yahoo! Slurp 3.0

Yahoo! Slurp 3.0 User-Agent String

Yahoo! Slurp 3.0

User-Agent NameYahoo! Slurp 3.0
User-Agent URL
CategoryRobot, Spider, Crawler
OrganizationYahoo! Inc.
Total Strings1
Last VisitFeb 28, 2009 23:59 PST

All user-agent string from Yahoo! Slurp 3.0

#User-Agent StringVisit FrequencyLast VisitView
1Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; 28, 2009 23:59 PSTView Detail

The description about Yahoo! Slurp 3.0

Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! Search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.

As part of the crawling effort, the Yahoo! Slurp crawler takes robots.txt standards into account to ensure we do not crawl and index content from those pages whose content you do not want included in Yahoo! Search. If a page is disallowed to be crawled by robots.txt standards, Yahoo! does not read or use the contents of that page.

With everything now in place, the rollout has officially begun. The new Yahoo! Slurp 3.0 recognizes the same user-agent and all robots.txt directives for Yahoo! Slurp, though it will identify itself as Slurp 3.0 in your web logs

The resource about Yahoo! Slurp/3.0