Text Generation Webui – v4.3

Written by

Tater Totterson

in

Text Generation Webui – v4.3

🚨 Text-Generation-WebUI v4.3 is live! 🚨

Hey AI tinkerers & devs — fresh update dropped, and it’s packed with performance wins, new backends, and security upgrades. Here’s the lowdown:

—

🔹 🔥 Brand-new backend: `ik_llama.cpp`

A high-octane fork by the imatrix creator, now baked into TGWU:

  • ✅ New quant formats (Q4_K_M, Q6_K, etc.)
  • 🧠 Hadamard-based KV cache quantization — way more accurate, on by default
  • ⚡ Built for MoE models & CPU inference (yes, really fast)

→ Grab it via `textgen-portable-ik` or `–ik` flag!

—

🔹 🧠 API upgrades (OpenAI-compatible!)

The `/v1/completions` endpoint now supports:

  • `echo`: Returns prompt + completion in one go
  • `logprobs`: Token-level log probabilities (prompt & generated)
  • `top_logprobs_ids`: Top token IDs per position — perfect for probing model confidence 🎯

—

🔹 🎨 Gradio UX + Security Boost

  • 🐌 Custom Gradio fork = ~50ms faster UI interactions
  • 🔒 Fixed ACL bypass (Windows/macOS path quirks)
  • ✅ Server-side validation for Dropdown/Radio/CheckboxGroup
  • 🛡️ SSRF fix in superbooga: blocks internal/private IPs

—

🔹 🔧 Bug fixes & polish

  • `–idle-timeout` now works for encode/decode + parallel generations ✅
  • Stopping strings fixed (e.g., `<|return|>` vs `<|result|>`)
  • Qwen3.5 MoE loads cleanly via ExLlamaV3_HF
  • `ban_eos_token` finally works (EOS suppression at logit level)

—

🔹 📦 Dependency upgrades

  • 🦙 `llama.cpp` → latest (`a1cfb64`) + Gemma-4 support
  • 🔄 `ExLlamaV3` → v0.0.28
  • 📦 `transformers` → 5.5
  • ✨ Auto-detects `torch_dtype` from model config (override with `–bf16`)
  • 🗑️ Removed obsolete `models/config.yaml` — templates pulled from model metadata now

—

🔹 📌 Terminology update

“Truncation length” → now “context length” in logs (more accurate, less confusing!)

—

🔹 📦 Portable builds — GGUF-ready & zero-install

| Platform | Build to Use |

|———-|————–|

| NVIDIA (old driver) | `cuda12.4` |

| NVIDIA (new driver, CUDA >13) | `cuda13.1` |

| AMD/Intel GPU | `vulkan` |

| AMD (ROCm) | `rocm` |

| CPU-only | `cpu` |

| Apple Silicon | `macos-arm64` |

| Intel Mac | `macos-x86_64` |

🔁 Updating? Just swap the folder — keep `user_data/`, and now you can even move it one level up for shared use across versions 🎉

—

Let me know if you want a quick-start walkthrough on `ik_llama.cpp` or portable builds! 🛠️🚀

🔗 View Release

More posts