Summary Memory Gets Worse the More You Use It. We Benchmarked 9 Agent Memory Architectures
On 90-day chat histories, a rolling 6,000-character summary scored 48 out of 100 for the heaviest user, exactly what the last 14 messages score. Every design whose store grows with the history held up. Full context won, but 90 days of chat still fits in the prompt. And three bugs in our measurement were each as large as the effects we were measuring.
Yu Chen · 2026-11-02