About our crawler

Seenkite audits websites for the people who run them. If you saw our crawler in your logs, someone added your site to their account, usually you or your agency.

How it behaves

  • Identifies itself with a user-agent that links to this page.
  • Follows the rules in robots.txt for its own name.
  • Makes at most two requests at a time to a site.
  • Only fetches public pages. It never logs in or submits forms.
  • To check AI crawler access, it also requests the home page once with each AI crawler's user-agent.

User-agent

seenkitebot/1.0 (+https://seenkite.com/bot)

Block or limit it

Add a group for our crawler to your robots.txt:

User-agent: seenkitebot
Disallow: /

To report misuse (someone auditing a site they shouldn't), or if you think it is misbehaving, write to [email protected].