When Does Selection Replace Extraction? A Pre-Registered Test of Agent Memory with a Typed Decision Model
Rishabh Sharma · Rishika Lall
Abstract
Does conversational memory for agents need LLM-extracted facts, or is selecting the right raw turns enough? We test this under a pre-registered plan on held-out LoCoMo conversations and on LongMemEval. Raw turns selected by one call to a typed decision model are non-inferior to LLM-extracted memory at matched context, while being 3,061× cheaper to write. The context budget decides the answer: when the reader sees few items, selection holds its own; when it sees many, extraction is more accurate.
1 Introduction