All news
AI

Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU

GitHub

Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). Quickstart · Quantization & Memory Specs · Supported Models · Supported Hardware · Leaderboard · Technical Paper ( paper/ ) · Architecture · FAQ.

Summary drawn from GitHub's own description of the story.

All tech news
Loading related stories