LocalAI

🎉 LocalAI 4.11.0 Release! 🚀

LocalAI 4.11.0 is out!

This release makes LocalAI more useful for audio understanding, resilient model serving, structured decisions, and day-to-day operation. Audio scenes can now combine transcription, diarization, sound detection, and remembered speaker names. Ordered failover chains keep a public model available across local and remote targets, while new Studio and operations pages expose these capabilities without requiring distributed mode.

The release also adds first-class decision models through /v1/systemone, signed OCI model galleries, and Kimodo text-to-animation. It includes 243 merged pull requests, 353 commits, 79 new gallery entries, focused fixes across APIs and backends, and broad backend-source updates.

Highlights:

• 🎙️ Audio scenes and remembered speakers - combine speech-to-text, speaker diarization, sound-event detection, and speaker identification. Studio can diarize a recording, preview clean intervals, and register selected speakers by name.
• 🔀 Model failover chains - place local and remote targets behind one model name, retry before response commitment, observe health and target switches, and pin a target from the API, MCP tools, or the React UI.
• 🧭 Decision models - advertise the decisions use case and answer structured choice, score, and noul questions through /v1/systemone, with validation and dedicated gallery models.
• 📦 Signed OCI galleries - distribute complete model galleries as OCI artifacts, verify them with Sigstore policies, and use digest-bound last-known-good caches.
• 🕺 Kimodo text-to-animation - generate skeletal motion from text through POST /3d/animate, preview it in Studio, and export binary glTF animation.
• 🖥️ Operate this machine - inspect resources and locally loaded models, view logs, and stop models on a single LocalAI host without enabling distributed mode.
• 🛡️ Safer gallery and API behavior - path-confinement fixes, stricter credential checks, correct pre-stream errors, preserved streamed Responses items, and more reliable model installation.

Plus PDF attachment extraction in chat, deeper Hugging Face repository discovery, improved hardware detection, new Italian Piper voices, NeMo diarization and ASR models, and large model-gallery batches.

📸 [ screenshot: diarize a recording and remember speakers by name ] Studio turns anonymous speaker segments into reusable named speaker profiles.

---

📊 This release in numbers

| | | |---|---| | Pull requests merged | 243 | | Commits | 353 | | Files changed | 623 (+51,035 / -2,625) | | Development window | 15 days (2026-09-18 to 2026-10-02) | | Human contributors | 12, of whom 4 first-time | | Gallery entries | 1,847 to 1,926 (+79) |

Where the work landed:

| Area | Change | |---|---| | core/ | +23,883 / -807 across 350 files | | backend/ | +12,437 / -186 across 119 files | | gallery/ | +4,998 / -110 | | pkg/ | +3,310 / -170 across 61 files | | docs/ | +2,142 / -1,115 across 50 files | | swagger/ | +2,254 / -100 |

---

📌 TL;DR

| Area | Summary | |------|---------| | 🎙️ Audio scenes | parakeet-cpp can combine ASR, diarization, and sound detection in one model. POST /v1/audio/diarization can optionally include text and versioned speaker profiles. Transcription segments and words can carry speaker labels, and realtime sessions emit transcription-segment and sound-detection events. | | 🗣️ Remembered speakers | Configure a compatible speaker_model to identify voices from t