ai_provider_localai
No security coverage
AI-Provider for LocalAI: LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures. Does not require GPU.
Features of LocalAI:
- Text generation with GPTs (llama.cpp, gpt4all.cpp and more)
- Text to Audio
- Audio to Text (Audio transcription with whisper.cpp)
- Image generation with stable diffusion
- OpenAI functions
- Embeddings generation for vector databases
- Constrained grammars
- Download Models directly from Huggingface
- Vision API
- Stores
- Reranker
- P2P Inferencing
See here for more information.