MLX-LM – v0.30.7

MLX-LM – v0.30.7

πŸš€ MLX-LM v0.30.7 is live β€” and it’s packed with model love, speed boosts, and polish!

πŸ”₯ New Models Added:

  • βœ… GLM-5 β€” a powerful new contender in the LLM space 🧠
  • βœ… Qwen3.5 (text-only) β€” ideal for high-performance, non-vision tasks
  • βœ… DeepSeek V3.2 improvements β€” faster indexer & smoother weight loading πŸ› οΈ
  • βœ… Kimi Linear bugs squashed β€” now stable & reliable

πŸ› οΈ Tooling Upgrades:

  • 🐍 Pythonic tool calling for LFM2 models (huge thanks to @viktike!)
  • 🧰 New Mistral tool parser β€” cleaner, more intuitive function/tool integration

⚑ Performance & Training:

  • πŸ“ˆ Faster DSV3.2 generation β€” thanks to kernel & op-level optimizations
  • πŸ“ LongCat MLA support β€” smarter attention for long-context generations
  • πŸ” Validation set now optional in training β€” faster prototyping!

πŸ‘ Shoutout to our newest contributors: @viktike & @JJJYmmm β€” welcome to the crew!

πŸ‘‰ Dive into the details: [v0.30.6 β†’ v0.30.7 Changelog](link-to-changelog)

Let’s push the limits on Apple silicon β€” together! πŸ› οΈπŸ’»βœ¨

πŸ”— View Release