You are here: Home » User-agent List » Speedy Spider

| User-Agent Name | Speedy Spider | |
| User-Agent URL | http://www.entireweb.com | |
| Category | Robot, Spider, Crawler | |
| Organization | Entireweb.com | |
| Total Strings | 2 | |
| Last Visit | Dec 25, 2011 11:03 PST |
| # | User-Agent String | Visit Frequency | Last Visit | View |
|---|---|---|---|---|
| 1 | Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) | 45239 | May 06, 2010 08:47 PDT | View Detail |
| 2 | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) | 114746 | Dec 25, 2011 11:03 PST | View Detail |
Entireweb is a trademark of Entireweb Sweden AB, a privately held, profitable corporation based in Halmstad, Sweden. Entireweb Sweden AB, incorporated in 1999, is dedicated to providing state-of-the-art search technology for both Internet and Intranet environments.
Entireweb currently handles millions of searches every month, and is a trusted partner of internationally acclaimed search engines such as Exactseek and IxQuick, who rely on Entireweb to provide world-class search results.
Speedy obeys the Robot Exclusion standard. To prevent a particular file or directory of your site (or the entire site) from being crawled by Speedy, please follow the steps below:
Example: http://www.httpuseragent.org/robots.txt.
Indicates that Speedy should stop visit whole site further:
User-agent: Speedy Disallow: /
Indicates that Speedy should stop visit secret directory further:
User-agent: Speedy Disallow: /secret
Speedy also supports HTTP META tag.
meta name="speedy" content="noindex"
meta name="speedy" content="nofollow"
meta name="speedy" content="noindex,nofollow"
Entireweb's crawlers primarily operate from the IP range 88.131.106.0/26. These IP numbers map to hostnames of the form cNN.entireweb.com, where NN is a hexadecimal number.