CrawlWatch – AI Bot Insights

CrawlWatch shows you the invisible traffic: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 40+ AI crawlers visiting your WordPress site.

• AI bot hits + which URLs they read
• AI referrals (visitors coming from ChatGPT, Perplexity, Gemini, Claude)
• One-click llms.txt + ai.txt generator
• robots.txt allow/block per AI bot (preview, no code)
• Readiness Score 0-100 with ranked Quick Wins
• 100% free, no upsell. Data stays on your server. IPs are hashed, never stored raw.

No API key. No external service in V1. Lightweight: normal visitors cause zero extra queries.

Privacy

CrawlWatch logs AI crawler visits locally: time, bot name, visited URL, referrer domain, truncated user-agent, and SHA-256 hashed IP (IPv4 last octet and IPv6 /64 anonymized before hashing). Raw IPs are never stored. Retention is configurable (default 30 days) and all data is deleted on uninstall if enabled in Settings. No visitor data leaves your site.