LocalAI Provider
This project integrates Drupal with LocalAI, an open-source alternative to OpenAI that allows you to run large language models, generate images, and perform audio tasks locally or on-premise without needing a GPU. It offers features like text generation, audio transcription, image generation, and embedding capabilities, all compatible with the OpenAI API.
AI-Provider for LocalAI: LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures. Does not require GPU.
Features of LocalAI:
- Text generation with GPTs (llama.cpp, gpt4all.cpp and more)
- Text to Audio
- Audio to Text (Audio transcription with whisper.cpp)
- Image generation with stable diffusion
- OpenAI functions
- Embeddings generation for vector databases
- Constrained grammars
- Download Models directly from Huggingface
- Vision API
- Stores
- Reranker
- P2P Inferencing
See here for more information.