HasMem: Hard-Origin Adaptively Softened Memory for Long-Term LLM Agents
En palabras de los autores
Text-based memory and context compression support reuse of past interactions. Resizing continuous memory changes the input to a frozen LLM, coupling capacity allocation with readout. We propose Hard-Origin Adaptively Softened Memory (HasMem). Frozen hard-prompt embeddings provide a verifiable initial state. A controller adjusts memory widths, a Writer re-encodes resized entries, and Reader and Global provide readout adaptation and cross-turn state. On all questions in a reconstruction probe derived from the Multi-Session Chat (MSC) development split, the main configuration achieves lexical F1 of ( percentage points) at of the hard reference's framed memory positions. With approximately matched per-question target body budgets, six configurations at mean per-entry retention around -- exceed rule-based re-encoding by -- exact-match (EM) percentage points. With fixed model parameters and rule target width ratio , Global's EM gain passes a user-level exact paired test with Bonferroni correction over eight comparisons. On all LongMemEval-S questions, local lexical F1 rises from the hard reference's to , and answer negative log-likelihood (NLL) falls from to . F1 gains accompany lower EM on both evaluations.
Apareció: lunes, 28 de septiembre. arXiv. Preprint, todavía sin revisión por pares.