Text Generation Webui – v4.6.1
🚀 Big Update Alert: text-generation-webui v4.6.1 is here!
If you’re looking for the “AUTOMATIC1111” of local LLMs, this latest release for the Gradio-based web UI is a massive win for anyone running models locally. It’s packed with quality-of-life upgrades and expanded connectivity to make your local setup even more powerful.
New MCP Power 🛠️
The Model Context Protocol (MCP) support just got a serious boost! You can now configure local subprocess-based MCP servers via `mcp.json`—exactly like you would in Claude Desktop or Cursor. The UI now pre-loads these tools at startup and caches discovery to keep your generations snappy.
Enhanced Control & Transparency 🔍
- Tool Call Confirmation: No more “black box” executions! You can now enable a checkbox in the Chat tab to see inline approve/reject buttons before any tool call runs.
- Thinking Process Management: A new `preserve-thinking` flag and UI checkbox let you decide whether to keep thinking blocks from previous turns in your context—perfect for managing those precious tokens!
- Smart UI: “Reasoning effort” controls now only appear when the specific model you’re using actually supports them.
Under the Hood & Performance ⚙️
- llama.cpp Upgrades: Includes updated dependencies and a default tweak (`–draft-min 48`) for smoother speculative decoding.
- UI Overhaul: Sidebars are now independent and remember their state even after a page refresh.
- Security Patch: Critical fixes for SSRF vulnerabilities in URL fetching to keep your local environment safe.
Portable Builds Ready! 📦
New self-contained packages are available for Windows, Linux, and macOS. Whether you’re rocking NVIDIA (CUDA 12.4 or 13.1), AMD (ROCm/Vulkan), or just a standard CPU, there’s a build ready to go. Updated builds for `ik_llama.cpp` are also included for those specialized quant types!
Pro-Tip: Updating is a breeze—just extract the new version and swap your `user_data` folder. You can even keep multiple versions of the webui side-by-side sharing a single `user_data` directory! 🛠️✨
