Tuesday, December 3, 2024

Sparrow Apple MLX Backend on Mac Mini M4 (Qwen2 72B 4bit)

I show how I’m running the Qwen2 72B 4bit model locally on a Mac Mini M4 for Sparrow’s backend. MLX (and MLX-VLM) is the main platform I’m using for local data extraction in Sparrow. 

 

No comments:

Post a Comment