About SEO4iBot

SEO4iBot is the web crawler used by SEO4i, an SEO analysis tool operated by Tomryn Inc. It visits websites only when a user of SEO4i requests an audit of that site. There is no continuous or speculative crawling of the web.

Every request the crawler makes, including its request for robots.txt, is sent with this user-agent string:

Mozilla/5.0 (compatible; SEO4iBot/1.0; +https://seo4i.com/bot)

SEO4iBot requests publicly accessible pages and reads page structure, metadata, headings and links. It does not attempt to log in, bypass paywalls, or access anything requiring authentication.

• Reads and obeys robots.txt before crawling anything else.
• Limits each audit to 100 pages.
• Crawls up to 4 levels deep from the starting address.
• Rate-limits requests to avoid load on your server, with a minimum of one second between requests to the same host. If your robots.txt sets a Crawl-delay, we use that instead when it is longer.

Add the following to the robots.txt file at the root of your site:

User-agent: SEO4iBot
Disallow: /

Changes to robots.txt are respected on the next audit.

If you are a site owner with questions about SEO4iBot, or you would like your site excluded from analysis, email support@seo4i.com. We read every message and will respond to questions and removal requests.