Search17 Web Crawler

Search17 is a web crawler for a new semantic search engine. We will use data collected to uncover new relations within internet data and provide users with friendly and intuitive way to navigate their search and decision process.

Search17 obeys robots.txt

You can prevent Search17 from indexing all or part of your site by including the following lines in your http://www.yoursite.com/robots.txt file:

# Allow only specific directories
User-agent: search17
Disallow: /
Allow: /public

Search17 IP ranges

Search17 crawls from the following IP ranges:

96.31.166.228-96.31.166.253

Search17 Politeness

Search17 tries its best to crawl politely and abide robots.txt rules. But if you do experience a problem with Search17, please let us know at crawler@search17.com. We'll respond to your concern ASAP and will do everything possible to resolve it.

Copyright© search17.com