Three Years of KV Cache Optimization
In November 2023, when DeepSeek released its first-generation model, its KV cache required 389,120 bytes per token—an unexceptional figure at the time. By December 2025, with DeepSeek-V3.2, that footprint plummeted to 48,068 bytes, an eightfold reduction. The experimental