Back

Whizz MD — Markdown Endpoints for AI Crawlers

Name: Whizz MD — Markdown Endpoints for AI Crawlers
Author: Whizz People

By Whizz People

Details

View on WordPress

Back

Whizz MD automatically creates a .md version of every published post and page on your WordPress site, served dynamically without storing any files on disk.

AI-powered search engines and LLM crawlers (GPTBot, ClaudeBot, PerplexityBot, Googlebot) increasingly prefer clean, structured content. This plugin gives them exactly that — a Markdown file with rich YAML frontmatter containing all your SEO signals, served at a predictable URL like /your-post-slug.md.

How It Works

Any published post or page automatically gets a .md endpoint
AI crawlers discover it via a <link rel="alternate"> tag in your page <head>, a dedicated /md-sitemap.xml, and crawlable anchor links in your page content
The Markdown is generated on the fly — no files written to disk, no database bloat
Full YAML frontmatter is included with all SEO metadata

What Gets Generated

YAML Frontmatter includes:

title — SEO title (from Yoast, Rank Math, AIOSEO, or post title)
slug — post slug
date and modified — publication and last modified dates
author — author display name
meta_description — SEO meta description (from SEO plugin or auto-generated)
focus_keyword — primary keyword (from Yoast/Rank Math)
canonical_url — points back to your HTML page
og_title and og_description — Open Graph fields
og_image — featured image URL
schema_type — auto-detected (Article, HowTo, FAQPage, WebPage)
categories and tags
reading_time and word_count
robots — respects your SEO plugin’s noindex settings
lang — site language (WPML/Polylang compatible)

Markdown Body includes:

H1–H6 headings with anchor ID preservation
Bold, italic, strikethrough, inline code
Fenced code blocks with language detection
Ordered and unordered lists (nested)
GitHub Flavored Markdown (GFM) tables
Blockquotes, images with alt text, links (relative absolute)
Gutenberg block HTML stripped cleanly

URL Patterns

/your-post-slug.md — clean pretty permalink
/parent/child-page.md — works with nested pages
/?p=123&format=md — query string fallback

AI Crawler Discovery

The plugin automatically:

Adds <link rel="alternate" type="text/markdown"> to every page <head>
Registers /md-sitemap.xml listing all .md URLs
Appends explicit Allow: /*.md rules to robots.txt for all major AI crawlers
Injects a crawlable <a> link on each page so robots can follow it naturally

SEO Plugin Compatibility

✅ Yoast SEO
✅ Rank Math
✅ All in One SEO (AIOSEO)
✅ WPML
✅ Polylang
✅ Gutenberg (Block Editor)
✅ Classic Editor

No Duplicate Content Risk

The .md endpoint serves Content-Type: text/markdown, not text/html. An HTTP-level Link: rel="canonical" header points back to the original HTML page, and X-Robots-Tag: noindex, follow prevents Google from indexing the raw Markdown as a competing webpage — while still allowing AI crawlers to read it.

Why This Matters

LLMs and AI search engines crawl the web to build their knowledge. Clean, structured Markdown with rich YAML frontmatter is the ideal format for these systems to parse, index, and cite your content — giving you organic visibility in AI-powered search results, summaries, and citations.

Details

Plugin code:

whizz-md

Plugin version:

1.0.5

Author:

Whizz People

Outdated:

WP version:

6.0 or higher

PHP version:

8.0 or higher

Test up to WP version:

7.0

Total installations:

Last updated:

2026-06-15

Rating:

Times rated:

crawler

llm

markdown

seo