Ollama – v0.17.8-rc1: ci: Fix windows build (#14754)

🚨 Ollama v0.17.8-rc1 is live! 🚨

This one’s a micro-update with big implications for Windows devs and CI workflows — no flashy new features, but a solid behind-the-scenes upgrade!

🔧 What’s new?

• ✅ Fixed Windows build issues (#14754) by swapping out shell-based wildcard expansion (`sh`) for a native Go implementation.
• 🌐 Why it matters: `sh` (e.g., bash) behaves differently—or not at all—on Windows. This change boosts cross-platform consistency, especially in automated environments like GitHub Actions or Docker builds.
• 🛠️ Think of it as Ollama finally nailing its Windows boot sequence — fewer “works on my machine” headaches!

📦 No user-facing changes yet, but this paves the way for smoother releases ahead. Keep an eye out for the stable `v0.17.8` drop! 🎯

#Ollama #LLMDev #AITools

🔗 View Release

Ollama – v0.17.8-rc0: MLX: add header vendoring and remove go build tag (#14642)

🚀 Ollama v0.17.8-rc0 is here — and it’s packing some serious dev-friendly upgrades!

🔥 MLX Integration Gets a Major Boost

• ✅ Header vendoring for `mlx-c` — Go can now build without CMake first 🎉
• ✅ Removed `go build` tag restriction — MLX support is now on by default
• 🔄 Headers auto-refresh on CMake runs → easier upgrades & less friction
• ✅ Basic Windows + Linux support confirmed (finally!)

🔧 ROCm on Windows

• 🚫 Temporarily sticking with ROCm v6 (v7 needs more love — stay tuned)

🛠️ CI/CD Hardening

• 🛡️ CI now handles flaky Chocolatey repos gracefully
• ⚠️ Builds proceed even if cache fails (since caching is optional for speed)

💡 Why it matters: Smoother builds, better Apple Silicon (MLX) support, and more resilient CI = faster iteration for devs experimenting locally. 🧪💻

Check it out if you’re running Ollama on macOS/Windows/Linux — especially with Apple Silicon or ROCm setups! 🧠⚡

#Ollama #LLMs #AIDev #LocalLLM

🔗 View Release

Text Generation Webui – v4.0

🚀 Text-Generation-WebUI v4.0 is here! 🚀

The big v4.0 update brings major improvements across the board — think of it as the “big bang” moment for the UI’s modernization! Here’s what’s new:

🔹 Brand-new Gradio-based UI

A complete redesign with a sleek, responsive interface — faster, cleaner, and way more intuitive. Think Stable Diffusion WebUI vibes, but for LLMs 🎨✨

🔹 Backend Agnostic Architecture

Now even easier to switch between backends (llama.cpp, Transformers, ExLlamaV3/V2, TensorRT-LLM) — with better hot-swapping and config management. 🔄

🔹 Built-in Document Loader (PDF, DOCX, TXT)

Upload and chat with your files directly — no more copy-paste or external tools! 📄➡️🧠

🔹 Web Search Integration (Optional)

Add real-time context via DuckDuckGo or SERP API — perfect for RAG without the hassle. 🔍🌐

🔹 New Extensions API

Smoother, more powerful extension support — TTS, translation, custom UI hooks, and more. 🧩

🔹 OpenAI-Compatible API Improvements

Better parity with the real deal — including streaming, chat completions, and tool calling. 📡

🔹 One-Click Portable Builds & Installer

Still as easy as ever to get up and running — Windows, Linux, macOS. 🧪⚡

🔥 Bonus: Better memory management, improved prompt templates, and a much more stable chat mode.

Grab the update — your local LLM playground just got a serious upgrade! 🛠️💻

👉 github.com/oobabooga/text-generation-webui

🔗 View Release

Ollama – v0.17.7

🚨 Ollama v0.17.7 is out! 🚨

This patch brings a subtle but important fix under the hood:

🔹 Stale context window entries now get properly overridden — meaning outdated prompt/chat history data won’t linger and mess with your inference accuracy. 💡

🧠 Why you’ll care:

• Cleaner, more reliable multi-turn conversations
• Better token efficiency (no hidden bloat from old context!)
• Smoother long-context handling — especially helpful if you’re pushing model limits

📦 No flashy new models or API changes this time, but it’s a solid reliability bump for everyday use.

🔗 Full details: v0.17.7 Release

Happy local LLM tinkering! 🛠️🤖

🔗 View Release

Ollama – v0.17.7-rc2

🚀 Ollama v0.17.7-rc2 is out!

This release candidate brings a handy fix for context window management — specifically, overriding stale entries in the context tracking logic. 🧠✨

🔹 What’s fixed?

• Stale context data (e.g., outdated conversation history) no longer lingers and messes with model responses.
• Improves reliability in multi-turn chats, especially for longer sessions or when switching between conversations.

💡 Why it matters: Cleaner context = more accurate, consistent responses — and fewer “wait, why did it say that?!” moments. 😅

Since this is an rc2, it’s a pre-release focused on polish and stability ahead of the final `v0.17.7`. No flashy new features yet, but solid under-the-hood improvements!

👉 Grab it and test: v0.17.7-rc2 on GitHub

Let us know how it behaves in the wild! 🛠️

🔗 View Release

Ollama – v0.17.7-rc1

🚨 Ollama v0.17.7-rc1 is out! 🚨

This release is a tiny but tidy patch candidate — only one commit landed:

🔧 `cmd/config: fix cloud model limit lookups in integrations (#14650)`

✅ What’s fixed:

• Resolves a bug where Ollama was misfetching or misapplying model usage limits when integrated with cloud services (e.g., Ollama Cloud or third-party APIs).
• Ensures smoother, more accurate rate-limit handling in hybrid/local–cloud workflows.

📌 Why it matters:

• If you’re using Ollama with cloud backends or integrations (like LangChain, LlamaIndex, or custom tooling), this fix helps avoid unexpected throttling or config mismatches.
• No new features, no breaking changes — just more reliability 🛠️

📅 Tagged: Mar 5, 2024

🔗 Release on GitHub

⚠️ RC = Release Candidate — test it out, but maybe wait for the stable drop before pushing to prod.

Let me know if you want a deep dive into PR #14650 or how this affects your integrations! 🤖✨

🔗 View Release

Ollama – v0.17.7-rc0

🚨 Ollama v0.17.7-rc0 is here — and it’s all about Qwen3.5 love! 🧠✨

The latest release candidate is a focused update with one standout improvement:

🔹 Context length configuration for Qwen3.5 models at launch — now you can tweak how much context the model uses right from the start, boosting compatibility and flexibility for longer prompts or multi-turn conversations.

No flashy new features this time — just smart, targeted tuning to make Qwen3.5 models run smoother and more predictably on your machine 🛠️💻

Perfect for anyone experimenting with Qwen3.5 locally or building apps around it!

Curious how it behaves? Drop a test prompt and share your results 👇

🔗 View Release

Ollama – v0.17.6

🚨 Ollama v0.17.6 is out — and it’s a quick but important patch! 🚨

This release is light on features, heavy on precision:

🔧 Bug fix: Corrected how `glm-ocr` image tags are parsed in renderer prompts

🔗 PR #14584 by @Victor-Quqi

✅ Why it matters:

• If you’re using GLM-OCR (especially for multimodal OCR tasks), image tags like `<image>` in your prompts will now render correctly instead of causing errors or misinterpretations.
• Ensures smoother integration in custom renderer workflows — critical for anyone building multimodal apps or pipelines on top of Ollama.

📦 No new models, no API changes — just a clean, targeted fix to keep your local LLM workflows humming.

If you rely on GLM-OCR or custom multimodal prompts, update away! 🛠️

Let me know if you want a breakdown of how Ollama renderers work or how to test this fix! 🤖✨

🔗 View Release

Voxtral Wyoming – v1.0.0

🚨 Voxtral Wyoming v1.0.0 is live — and it’s production-ready! 🚀

The wait is over: this release marks the stable, final v1.0.0 of Voxtral Wyoming — your go-to offline STT service powered by Mistral’s Voxtral models, now fully integrated with Home Assistant Assist via the Wyoming protocol.

✨ What’s new (and why it matters):

✅ Stable & battle-tested — all major bugs squashed, performance optimized for real-world use

✅ API finalized — no more breaking changes ahead; integrations are safe to lock in

✅ Full tooling in place — docs, tests, and CI/CD pipelines are now rock-solid

✅ Zero flash, all function — no flashy new features, just a polished, reliable upgrade ready for production 🛠️

🎯 Whether you’re running it on CPU, CUDA (NVIDIA), or MPS (Apple Silicon), and whether your audio comes in MP3, OGG, FLAC, or WAV — Voxtral Wyoming handles it all with automatic PCM16 conversion. Config via env vars? Yep — host, port, language, model ID… all covered.

📦 Dockerized. Deployed. Ready.

🟢 Green light for production! Let’s build smarter, offline-first voice assistants — together. 🎤💡

🔗 View Release

Ollama – v0.17.5

🚨 Ollama v0.17.5 is live! 🚨

Hey AI tinkerers — fresh update alert! 🔥 Ollama just rolled out v0.17.5, and it’s a quiet but mighty one — especially if you love playing with Qwen3 or importing GGUF models. Here’s the lowdown:

🔹 GGUF love, expanded! 🎁

• Full support for importing and running Qwen3 models (like `Qwen3-0.6B`, `Qwen3-1.7B`) — straight from Hugging Face or wherever you grab your GGUFs.
• Smoother imports, fewer hiccups 🛠️

🔹 Under-the-hood polish

• Bug fixes and stability tweaks (you won’t see them, but you’ll feel the smoother run).

💡 Why care?

If you’re experimenting with lightweight Qwen3 variants or love the flexibility of GGUF (quantized, portable, efficient 📦), this update makes your workflow just a little more magical. ✨

Ready to upgrade? `ollama pull ollama` 🚀

Let us know how it runs!

🔗 View Release