Rawi MD — Markdown for AI Crawlers

People are asking ChatGPT, Claude and Perplexity the questions they used to type into Google. To answer, those tools visit real websites and read them — including yours.

But they read a WordPress page badly. Your content arrives buried in markup, scripts, navigation and cookie banners that mean nothing to a language model, and the model pays for every one of those tokens.

This plugin answers Accept: text/markdown with a clean Markdown document at the same URL. Browsers keep getting the normal page. Nothing changes for your visitors, and nothing changes in how you write.

The part most plugins get wrong

Page caches answer requests before WordPress runs. When LiteSpeed or WP Rocket has a stored copy of a page, an agent asking for Markdown gets HTML instead, and the plugin never even loads. This plugin handles that on both sides: it tells the cache plugins to stand down at runtime, and it generates the server-level rules you need to paste in so the cache steps aside before PHP starts.

How agents can reach the Markdown

• Accept: text/markdown on the normal page URL — real HTTP content negotiation, the route AI agents actually use
• A .md suffix on any URL, for agents that do not send the header
• ?format=md or ?output_format=md

The HTML page also advertises the Markdown version through a <link rel="alternate"> tag and a Link: response header, so an agent can find it without guessing.

What you control

• Which post types are served, and which individual pages are excluded
• Which theme elements are stripped, by CSS selector
• Which YAML frontmatter fields appear
• WooCommerce products carry SKU, price, currency, stock status and rating in the frontmatter. Those live in post meta, so a converter working from rendered HTML cannot produce them
• A Content-Signal header stating how you allow the content to be used

Reporting

A dashboard shows which agents requested Markdown, which pages they wanted, and which route they used.

Privacy

The plugin records Markdown requests in a table in your own database: timestamp, post ID, URL path, user agent, and a one-way hash of the IP address. Nothing is sent anywhere. IP addresses are never stored in readable form, hashing can be turned off entirely, and entries are deleted after a retention period you set. Uninstalling removes the table.

Languages

The interface ships in English and Arabic. WordPress picks the Arabic strings automatically when the site language is set to Arabic, and the admin screens follow the right-to-left layout.