Text Generation Webui – v4.0
π Text-Generation-WebUI v4.0 is here! π
The big v4.0 update brings major improvements across the board β think of it as the “big bang” moment for the UIβs modernization! Hereβs whatβs new:
πΉ Brand-new Gradio-based UI
A complete redesign with a sleek, responsive interface β faster, cleaner, and way more intuitive. Think Stable Diffusion WebUI vibes, but for LLMs π¨β¨
πΉ Backend Agnostic Architecture
Now even easier to switch between backends (llama.cpp, Transformers, ExLlamaV3/V2, TensorRT-LLM) β with better hot-swapping and config management. π
πΉ Built-in Document Loader (PDF, DOCX, TXT)
Upload and chat with your files directly β no more copy-paste or external tools! πβ‘οΈπ§
πΉ Web Search Integration (Optional)
Add real-time context via DuckDuckGo or SERP API β perfect for RAG without the hassle. ππ
πΉ New Extensions API
Smoother, more powerful extension support β TTS, translation, custom UI hooks, and more. π§©
πΉ OpenAI-Compatible API Improvements
Better parity with the real deal β including streaming, chat completions, and tool calling. π‘
πΉ One-Click Portable Builds & Installer
Still as easy as ever to get up and running β Windows, Linux, macOS. π§ͺβ‘
π₯ Bonus: Better memory management, improved prompt templates, and a much more stable chat mode.
Grab the update β your local LLM playground just got a serious upgrade! π οΈπ»
