# Some Memories Must Fade: Persistence and Decay of User Memories in Model Parameters

DevFeed: [Some Memories Must Fade: Persistence and Decay of User Memories in Model Parameters](<https://devfeed.tech/articles/some-memories-must-fade-persistence-and-decay-of-user-memories-in-model-parameters-145026.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25235>)

Author: Sanidhya Vijayvargiya, Rahul Lokesh

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [lora](<https://devfeed.tech/topics/lora.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>)

Tags: [adapter](<https://devfeed.tech/tags/adapter.md>), [behavioral-shifts](<https://devfeed.tech/tags/behavioral-shifts.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [cl](<https://devfeed.tech/tags/cl.md>), [continual-learning](<https://devfeed.tech/tags/continual-learning.md>), [controller](<https://devfeed.tech/tags/controller.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [horizon](<https://devfeed.tech/tags/horizon.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>), [lora](<https://devfeed.tech/tags/lora.md>), [manage](<https://devfeed.tech/tags/manage.md>), [management](<https://devfeed.tech/tags/management.md>), [memory](<https://devfeed.tech/tags/memory.md>), [memory-management](<https://devfeed.tech/tags/memory-management.md>), [model-weights](<https://devfeed.tech/tags/model-weights.md>), [persistence](<https://devfeed.tech/tags/persistence.md>), [user](<https://devfeed.tech/tags/user.md>)

## AI overview

The paper proposes managing user memories directly in model weights, with a fixed-capacity LoRA adapter for storing facts and a learned lightweight controller for deciding what to retain, update, reinforce, or let fade. The adapter uses k-hot rank combinations intended to reduce catastrophic interference and supports independently controlled temporal decay. Evaluation on controlled long-horizon user trajectories tests recall while facts remain valid and abstention after they expire. The learned policy reaches 86% of oracle performance by balancing recall and abstention; the authors report that continual-learning and retrieval-augmented-generation baselines tend to default mainly to one behavior. These findings are from the described dataset and evaluation.

## Source excerpt

arXiv:2611.25235v1 Announce Type: new Abstract: Parametric memory allows Large Language Models to internalize knowledge directly into their weights, offering a potentially powerful alternative to retrieval-based memory (RAG). However, existing approaches to parametric memory are difficult to deploy as they largely mirror the Continual Learning (CL) objective of retaining information indefinitely. This is neither sustainable nor sufficient for a memory system, which must govern knowledge across its lifecycle by retaining stable facts, reinforcing recurring observations, updating changed beliefs, and allowing transient information to fade. We propose a system for parametric memory management consisting of a memory substrate (handling information storage and forgetting) and a learned policy (what to remember, how deeply, and for how long). Our substrate is a fixed-capacity LoRA adapter that consists of k-hot rank combinations which store facts without catastrophic interference and maintain an independently controlled temporal decay, enabling outdated information to fade while long-term facts persist. On this substrate, we train a lightweight controller that governs each incoming user event to ensure the memory system reflects the user's true, updated belief state. To evaluate how memory systems manage user memory, we introduce a controlled dataset of long-horizon user trajectories with varying persistence of facts based on changing belief states and user-behavioral shifts, and probe queries that test recall while information is valid and abstention after it expires. Our policy learns to effectively manage user memory over its entire lifecycle, balancing recall and abstention to achieve 86% of oracle performance, unlike CL and RAG baselines that primarily default to one of the two behaviors. By providing the first system to manage memory directly in model weights, this work establishes a foundation for long-horizon parametric memory.