MLX-LM – v0.31.2
MLX LM: Run LLMs with MLX just dropped an update! 🚀
If you’re rocking Apple silicon, this package is your best friend for generating text and fine-tuning large language models using the high-performance MLX framework. It’s incredibly versatile, supporting quantization, distributed inference, and thousands of models directly from the Hugging Face Hub.
What’s new in mlx-lm v0.31.2:
This minor release is all about internal stability and refining how the engine handles data during inference:
- Align batch logits processor token contract: This technical tweak ensures more consistent behavior within the batch logits processor, keeping your token handling predictable and smooth. 🛠️
It might be a small adjustment under the hood, but it’s exactly the kind of refinement that keeps local LLM workflows stable for devs and tinkerers alike!