LocalAI
Drop-in OpenAI replacement
Ettore Di Giacinto
LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio locally with consumer grade hardware, supporting multiple model families and architectures. ⚠️ Note After installation, LocalAI takes a few minutes to start up. Please be patient and wait for the app to download required models. Also, before running a model, make sure your device has enough free RAM to support it. Attempting to run a model that exceeds your available memory could cause your device to crash or become unresponsive. Always check the model requirements before downloading or starting it.
This release brings exciting updates to LocalAI: - New LocalAI logo and branding - SYCL support added for stablediffusion.cpp - WebUI enhancements for improved user experience - Support for the Lumina model family for image generation - Bug fixes, including issues related to LOCALAI_SINGLE_ACTIVE_BACKEND Full release notes can be found at https://github.com/mudler/LocalAI/releases
- Versionv2.28.0
- CategoryAI
- Source codePublic
- Developed byEttore Di Giacinto
- Submitted byhighghlow
- Compatible withumbrelOS 0.5 or later