Local AI just got real for Mac users with deep pockets.
antirez (Redis creator) dropped ds4 — a lean C engine that runs frontier open models on your machine. No cloud. No API fees.
What you get:
→ $DEEPSEEK V4 Flash, GLM 5.x, Qwen 3.8 Flash Next
→ ~39 tokens/sec on 128GB M5 Max
→ OpenAI/Anthropic-compatible API + CLI + coding agent
→ 2-bit quantization so big models actually fit
Why it slaps:
Most local AI tools try to support everything. ds4 focuses on a few top models and does them right. 23k+ stars, MIT license.
If you've got a high-memory Mac or NVIDIA/AMD GPU, you can run frontier models at home now. One dev. One engine. Zero compromise.
Repo in replies.
antirez (Redis creator) dropped ds4 — a lean C engine that runs frontier open models on your machine. No cloud. No API fees.
What you get:
→ $DEEPSEEK V4 Flash, GLM 5.x, Qwen 3.8 Flash Next
→ ~39 tokens/sec on 128GB M5 Max
→ OpenAI/Anthropic-compatible API + CLI + coding agent
→ 2-bit quantization so big models actually fit
Why it slaps:
Most local AI tools try to support everything. ds4 focuses on a few top models and does them right. 23k+ stars, MIT license.
If you've got a high-memory Mac or NVIDIA/AMD GPU, you can run frontier models at home now. One dev. One engine. Zero compromise.
Repo in replies.