This module connects Drupal to AnythingLLM, enabling you to build AI-powered chatbots and other applications using your own website data and documents. It supports features like chat, embedding, and search indexing, allowing you to leverage Retrieval Augmented Generation (RAG) while maintaining data sovereignty.
Use Drupal and Anything LLM as your own data-sovereign Retrieval Augmented Generation (RAG) application and create AI-based chats based on data from your own website incl. file documents / attachments out of the box.
Anything LLM is "The all-in-one AI application" which supports LLMs, Embedder Models, Speech models, and Vector Databases.
This module connects your Drupal to Anything LLM.
You can use this module in combination with Search API without any Vector Database or AI Search Submodule.
Implemented:
- Chat
- also usable for ai_ckeditor and ai_translate and 3rd party like ai_image_alt_text or ai_tmgmt
- Supports AnythingLLM API or OpenAI-compatibility mode
- Embedding
- Search API
- Create server
- Create index
- Store and delete entities to index
- Store attachments (via file entity) to index
- Create search view incl. filters *
* The filtering is not done in AnythingLLM database but in code after recieving the results.
Planned / Postponed:
- Translation / Transcription
Links for AnythingLLM:
Anything LLM is licensed under MIT.
Please aware to check whether the telemetry option meets your privacy requirements.