AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control

Is your website ready for the AI search revolution? AI Visibility Control is the ultimate tool for webmasters to control how Large Language Models (LLMs), AI bots, and conversational search platforms index their content.

This lightweight, highly optimized plugin allows you to block data-scraping AI crawlers while optimizing your content for friendly AI search engines, and tracking the exact traffic they refer back to your site.

Why Users Need This Plugin

As AI search engines like ChatGPT, Claude, and Perplexity become mainstream, they crawl your website to train models and answer user queries. Traditional robots.txt files do not make it easy to manage these new crawlers. AI Visibility Control solves this by giving you a central control panel to configure crawler rules, output search-optimized summaries, and monitor referred traffic.

What Makes This Plugin Different

Unlike standard robots.txt editors or massive security suites, AI Visibility Control is built specifically for the AI era. It is 100% self-contained, requires no external API keys, does not track your admin activity, and runs locally. It features:
1. AI crawler settings: Toggle switches to block specific bots (like GPTBot, ClaudeBot, PerplexityBot, etc.) dynamically.
2. llms.txt standard: Generates dynamic plain-text markdown cataloging your public pages to optimize AI ingestion.
3. Local AI traffic analytics: Tracks incoming visits from AI platforms locally without bloating your database.

Key Features

• Automatic llms.txt Generator: Generates a standard /llms.txt file containing your site title, description, and a structured list of your public posts and pages.
• Transient Caching: Caches the llms.txt output to ensure instant page load times and automatically flushes the cache when content is saved or updated.
• Crawler Bot Block Manager: Checkbox controls to block GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Amazonbot, and Applebot-Extended in your virtual robots.txt.
• AI Referral Logger: Sniffs referrers from ChatGPT, Claude, Perplexity, Gemini, Copilot, and Bard, logging them into a custom database table.
• GDPR-Compliant IP Hashing: Hashes visitor IP addresses to protect user privacy and comply with GDPR regulations.
• Referral Logger Debounce: Uses a 5-minute transient debounce check to prevent duplicate entries and keep your database clean.
• Automated Health Checks: Runs diagnostics on pretty permalinks, loopback reachability, robots.txt, and search engine visibility.
• Diagnostic Tools: Rebuild cache, clear log entries, export logs as a CSV file, and reset setting options with a single click.