Text Generation Webui – v4.0

Text Generation Webui – v4.0

πŸš€ Text-Generation-WebUI v4.0 is here! πŸš€

The big v4.0 update brings major improvements across the board β€” think of it as the “big bang” moment for the UI’s modernization! Here’s what’s new:

πŸ”Ή Brand-new Gradio-based UI

A complete redesign with a sleek, responsive interface β€” faster, cleaner, and way more intuitive. Think Stable Diffusion WebUI vibes, but for LLMs 🎨✨

πŸ”Ή Backend Agnostic Architecture

Now even easier to switch between backends (llama.cpp, Transformers, ExLlamaV3/V2, TensorRT-LLM) β€” with better hot-swapping and config management. πŸ”„

πŸ”Ή Built-in Document Loader (PDF, DOCX, TXT)

Upload and chat with your files directly β€” no more copy-paste or external tools! πŸ“„βž‘οΈπŸ§ 

πŸ”Ή Web Search Integration (Optional)

Add real-time context via DuckDuckGo or SERP API β€” perfect for RAG without the hassle. πŸ”πŸŒ

πŸ”Ή New Extensions API

Smoother, more powerful extension support β€” TTS, translation, custom UI hooks, and more. 🧩

πŸ”Ή OpenAI-Compatible API Improvements

Better parity with the real deal β€” including streaming, chat completions, and tool calling. πŸ“‘

πŸ”Ή One-Click Portable Builds & Installer

Still as easy as ever to get up and running β€” Windows, Linux, macOS. πŸ§ͺ⚑

πŸ”₯ Bonus: Better memory management, improved prompt templates, and a much more stable chat mode.

Grab the update β€” your local LLM playground just got a serious upgrade! πŸ› οΈπŸ’»

πŸ‘‰ github.com/oobabooga/text-generation-webui

πŸ”— View Release