Monday, January 20, 2025
Apple MLX Vision LLM Server with Ngrok, FastAPI and Sparrow
I show how I run Apple MLX backend on my local Mac Mini M4 Pro 64GB and access it from the Web through Ngrok, with automatically provisioned HTTPS certificate.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment