MD Sitemap
This module generates a separate markdown sitemap specifically for AI crawlers. It creates a dedicated endpoint where it lists URLs with a configurable suffix, allowing for machine-readable content optimized for LLMs.
MD Sitemap is a Drupal module that generates a dedicated markdown sitemap designed for LLM (Large Language Model) crawlers.
Instead of only creating traditional sitemap.xml files for search engines, this module creates a separate sitemap endpoint that outputs URLs with a configurable suffix (e.g. .md, .txt, .ai), making it ideal for exposing machine-readable versions of your site's content.
This is particularly useful when paired with modules like Markdownify to deliver clean Markdown or text-based pages optimized for AI ingestion.
Main features / functionalities:
- ✅ Provides a dedicated sitemap endpoint at:
/sitemap-llm - ✅ Configurable URL suffix (e.g. .md, .txt) depending on your preference and implementation of text based versions of your web pages.
- ✅ Admin UI to select entity types and bundles (e.g. nodes, taxonomy terms, media, commerce products).
- ✅ Automatically detects any entity type with a canonical URL.
- ✅ Automatic cache invalidation on: Entity insert, update, delete and configuration changes.
- ✅ Lightweight and decoupled from SEO-specific sitemap modules.
- ✅ Compatible with llms.txt for LLM crawler directives. Just add a link to
/sitemap-llm
Post-Installation
After installing the module, go to: /admin/config/search/md-sitemap or use the menu Configuration → Search and metadata → MD Sitemap
Additional Requirements
This module has no external dependencies beyond Drupal Core.
Similar projects
-
TODO: Note other sitemap modules and differences
Community Documentation
Once initial release is ready I will provide a YouTube walkthrough of all the functionality this module provides!
Supporting organisation
Pivale are a globally trusted web development company who build Drupal CMS websites and software.