r/LocalLLaMA
· Communities
Agent memory layers don’t need an LLM deciding what to remember
Most agent memory setups run a model call on the way in. Something reads the turn, decides whether it's worth keeping, rewrites it into a "memory", tags it with a type and an importance score. That's a second inference pass on every interaction and I think it's the wrong place to spend one. Cost isn't the issue. The ju