|User-Agent Name||Speedy Spider [2 items]|
|Category||Robot, Spider, Crawler|
|User-agent String||Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)|
|First Visit||Oct 23, 2007 18:57 PDT|
|First IP||184.108.40.206 - speedyspider.entireweb.com|
|Last Visit||May 06, 2010 08:47 PDT|
|Last IP||220.127.116.11 - static-18.104.22.168.addr.tdc.se|
Last updated: Oct 30, 2010 06:44 PDT
Entireweb is a trademark of Entireweb Sweden AB, a privately held, profitable corporation based in Halmstad, Sweden. Entireweb Sweden AB, incorporated in 1999, is dedicated to providing state-of-the-art search technology for both Internet and Intranet environments.
Entireweb currently handles millions of searches every month, and is a trusted partner of internationally acclaimed search engines such as Exactseek and IxQuick, who rely on Entireweb to provide world-class search results.
Speedy obeys the Robot Exclusion standard. To prevent a particular file or directory of your site (or the entire site) from being crawled by Speedy, please follow the steps below:
Indicates that Speedy should stop visit whole site further:
User-agent: Speedy Disallow: /
Indicates that Speedy should stop visit secret directory further:
User-agent: Speedy Disallow: /secret
Speedy also supports HTTP META tag.
meta name="speedy" content="noindex"
meta name="speedy" content="nofollow"
meta name="speedy" content="noindex,nofollow"
Entireweb's crawlers primarily operate from the IP range 22.214.171.124/26. These IP numbers map to hostnames of the form cNN.entireweb.com, where NN is a hexadecimal number.