Looks like MLX quants are released: - 4bit: https://huggingface.co/mlx-community... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		pickettd 11 months ago \| parent \| context \| favorite \| on: QwQ-32B: Embracing the Power of Reinforcement Lear... Looks like MLX quants are released: - 4bit: https://huggingface.co/mlx-community/QwQ-32B-4bit - 6bit: https://huggingface.co/mlx-community/QwQ-32B-6bit

seanmcdirmid 11 months ago [–]

I downloaded the 8 bit quant last night but haven't had a chance to play with it yet.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact