Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU
GitHub
Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). Quickstart · Quantization & Memory Specs · Supported Models · Supported Hardware · Leaderboard · Technical Paper ( paper/ ) · Architecture · FAQ.
Summary drawn from GitHub's own description of the story.