AnythingLLM Provider

Use Drupal and Anything LLM as your own data-sovereign Retrieval Augmented Generation (RAG) application and create AI-based chats based on data from your own website incl. file documents / attachments out of the box.

Anything LLM is "The all-in-one AI application" which supports LLMs, Embedder Models, Speech models, and Vector Databases.

This module connects your Drupal to Anything LLM.

You can use this module in combination with Search API without any Vector Database or AI Search Submodule.

Implemented:

• Chat
  • also usable for ai_ckeditor and ai_translate and 3rd party like ai_image_alt_text or ai_tmgmt
  • Supports AnythingLLM API or OpenAI-compatibility mode
• Embedding
• Search API
  • Create server
  • Create index
  • Store and delete entities to index
  • Store attachments (via file entity) to index
  • Create search view incl. filters *

* The filtering is not done in AnythingLLM database but in code after recieving the results.

Planned / Postponed:

• Translation / Transcription

Links for AnythingLLM:

• Github
• README
• Documentation
• Product Page
• Hosted Service

Anything LLM is licensed under MIT.

Please aware to check whether the telemetry option meets your privacy requirements.