Deletion too aggressive, check for references first! #11

Closed
opened 2026-10-01 19:16:03 -06:00 by tangent · 1 comment
Owner

The way memories are deleted should queue things for possible deletion rather than deleting them FIRST, then check at the end of processing if the items queued for deletion have actually been removed from the embeddings JSON and only delete them if they are no longer referenced. This way, if multiple things reference the same segment, it doesn't get wiped out prematurely.

Also, when it comes to allowing the system to generate and store its own memories, if a memory ends up containing identical information to a note that is removed, it doesn't get wiped just because the note was removed - a memory still references it. That's very unlikely, but possible. I just think the current system is too aggressive about deletion.

The way memories are deleted should queue things for possible deletion rather than deleting them FIRST, then check at the end of processing if the items queued for deletion have actually been removed from the embeddings JSON and only delete them if they are no longer referenced. This way, if multiple things reference the same segment, it doesn't get wiped out prematurely. Also, when it comes to allowing the system to generate and store its own memories, if a memory ends up containing identical information to a note that is removed, it doesn't get wiped just because the note was removed - a memory still references it. That's very unlikely, but possible. I just think the current system is too aggressive about deletion.
Author
Owner

A problem with this approach is deleting memories made outside of source files. I need some way to tag these so they don't get deleted.

A problem with this approach is deleting memories made outside of source files. I need some way to tag these so they don't get deleted.
Sign in to join this conversation.
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: tools/llm-tricks#11