ai_provider_litellm

AI Provider: LiteLLM

This module provides an integration with LiteLLM, a lightweight and self-hostable service that provides a unified interface for various Large Language Models (LLMs).

This module allows you to use LiteLLM as an AI Provider in your Drupal application, enabling you to leverage the power of different LLMs through a single, consistent API.

Installation

1. Install the module via Composer:
composer require drupal/ai_provider_litellm

2. Enable the module in your Drupal site, for example via drush:
drush en ai_provider_litellm

Configuration

1. Navigate to the AI Provider configuration page in your Drupal admin interface via Admin -> Configuration -> AI -> AI Providers or via the page: /admin/config/ai/providers/ai_provider_litellm
2. Select your "LiteLLM" key, you may need to first create the key.
3. Enter the URL of your LiteLLM instance.