llms_txt_generator

LLMs.txt Generator helps you create and manage an llms.txt file on your website, giving you control over how Large Language Models (LLMs) such as ChatGPT, Claude, and others interact with your site's content.

What is llms.txt?

The llms.txt file provides guidance to AI crawlers and large language models
about how they should interact with your website content. Similar to
robots.txt for search engines, it helps establish boundaries for:

• Content usage permissions.
• Rate limiting requests.
• Caching policies.
• Attribution requirements.
• Training allowances.

Features

This module allows site administrators to:

• Create and maintain an llms.txt file for their website.
• Customize the file content through an administration interface.
• Control whether the file is enabled or disabled.

Installation

• Install the module using Composer or by placing it in your modules directory.
• Enable the module through the Drupal admin interface or Drush.
• Access the configuration form at:
  Administration > Configuration > Search and metadata > LLMs.txt Generator

Once enabled, the llms.txt file is accessible at:

https://yoursite.com/llms.txt

What next ?

A new submodule is in the works to provide advanced control and customization for llms-full.txt file generation. Stay tuned!