LLMs.txt Generator
This module helps you manage an `llms.txt` file on your website, which guides Large Language Models (LLMs) on how to interact with your content. It allows you to control permissions, rate limits, caching, attribution, and training usage for AI crawlers. You can configure these settings through an administration interface.
LLMs.txt Generator helps you create and manage an llms.txt file on your website, giving you control over how Large Language Models (LLMs) such as ChatGPT, Claude, and others interact with your site's content.
What is llms.txt?
The llms.txt file provides guidance to AI crawlers and large language models
about how they should interact with your website content. Similar to
robots.txt for search engines, it helps establish boundaries for:
- Content usage permissions.
- Rate limiting requests.
- Caching policies.
- Attribution requirements.
- Training allowances.
Features
This module allows site administrators to:
- Create and maintain an llms.txt file for their website.
- Customize the file content through an administration interface.
- Control whether the file is enabled or disabled.
Installation
- Install the module using Composer or by placing it in your modules directory.
- Enable the module through the Drupal admin interface or Drush.
- Access the configuration form at:
Administration > Configuration > Search and metadata > LLMs.txt Generator
Once enabled, the llms.txt file is accessible at:
https://yoursite.com/llms.txt
What next ?
A new submodule is in the works to provide advanced control and customization for llms-full.txt file generation. Stay tuned!