LocalAI

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio locally with consumer grade hardware, supporting multiple model families and architectures. ⚠️ Note Before running a model, make sure your device has enough free RAM to support it. Attempting to run a model that exceeds your available memory could cause your device to crash or become unresponsive. Always check the model requirements before downloading or starting it.

This new release of LocalAI comes with major improvements and new features. Key highlights include: - Backend Gallery: Install and remove backends on the fly with API-driven customization - Audio Support: Upload audio, PDFs, or text files directly in the UI - Realtime API: WebSocket support compatible with OpenAI clients for chat apps and agents - Reasoning UI: Visual thinking indicators for smart models during inference - Dynamic VRAM Handling: Smarter GPU usage with automatic layer offloading - 50+ New Models: Huge model gallery update including Qwen3, reasoning models, and multimodal LLMs - Experimental Video Generation: New video generation endpoint Full release notes can be found at https://github.com/mudler/LocalAI/releases

• Versionv3.0.0
• CategoryAI
• Source codePublic
• Developed byEttore Di Giacinto
• Submitted byhighghlow
• Compatible withumbrelOS 0.5 or later