LocalAI

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio locally with consumer grade hardware, supporting multiple model families and architectures. ⚠️ Note Before running a model, make sure your device has enough free RAM to support it. Attempting to run a model that exceeds your available memory could cause your device to crash or become unresponsive. Always check the model requirements before downloading or starting it.

This release includes several improvements and new features: - WebUI improvements: now size can be set during image generation - New backends: KittenTTS, kokoro, and dia are now available as backends and models can be installed directly from the gallery - Support for reasoning effort in the OpenAI chat completion - Diffusers backend now available for l4t images and devices - Backends can now be sideloaded from the system ⚠️ Note: New backends need to be warmed up during the first call to download the model files. Full release notes can be found at https://github.com/mudler/LocalAI/releases

• Versionv3.4.0
• CategoryAI
• Source codePublic
• Developed byEttore Di Giacinto
• Submitted byhighghlow
• Compatible withumbrelOS 0.5 or later