Andrej Baranovskij Blog
Blog about Oracle, Full Stack, Machine Learning and Cloud
Tuesday, December 3, 2024
Sparrow Apple MLX Backend on Mac Mini M4 (Qwen2 72B 4bit)
I show how I’m running the Qwen2 72B 4bit model locally on a Mac Mini M4 for Sparrow’s backend. MLX (and MLX-VLM) is the main platform I’m using for local data extraction in Sparrow.
Newer Posts
Older Posts
Home
Subscribe to:
Posts (Atom)