|User-Agent Name||Speedy Spider|
|Category||Robot, Spider, Crawler|
|Last Visit||May 05, 2012 16:37 PDT|
|#||User-Agent String||Visit Frequency||Last Visit||View|
|1||Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)||45239||May 06, 2010 08:47 PDT||View Detail|
|2||Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)||115134||May 05, 2012 16:37 PDT||View Detail|
Entireweb is a trademark of Entireweb Sweden AB, a privately held, profitable corporation based in Halmstad, Sweden. Entireweb Sweden AB, incorporated in 1999, is dedicated to providing state-of-the-art search technology for both Internet and Intranet environments.
Entireweb currently handles millions of searches every month, and is a trusted partner of internationally acclaimed search engines such as Exactseek and IxQuick, who rely on Entireweb to provide world-class search results.
Speedy obeys the Robot Exclusion standard. To prevent a particular file or directory of your site (or the entire site) from being crawled by Speedy, please follow the steps below:
Indicates that Speedy should stop visit whole site further:
User-agent: Speedy Disallow: /
Indicates that Speedy should stop visit secret directory further:
User-agent: Speedy Disallow: /secret
Speedy also supports HTTP META tag.
meta name="speedy" content="noindex"
meta name="speedy" content="nofollow"
meta name="speedy" content="noindex,nofollow"
Entireweb's crawlers primarily operate from the IP range 18.104.22.168/26. These IP numbers map to hostnames of the form cNN.entireweb.com, where NN is a hexadecimal number.