Loading...

GOD-LIKE SOLUTIONS

Connections
Loading...
EN SV

About me

▶

How I work

▶

AI on top of the systems you already have

▶

Document analysis and extraction

▶

Agent systems and MCP

▶

Reverse engineering and data control

▶

The model proposes, the rules write

▶

Evidence over confidence

▶

Harness engineering

▶

Flashback

▼

Associative memory for agents

People don't solve a familiar problem from scratch. Something about the situation reminds us of last time, and we remember roughly what we did and how it turned out. Most agents don't get that. Every run starts cold.

Flashback is my attempt to give agents that kind of situational memory.

How it works

For the agent's current state, an embedding model retrieves the top-k most similar historical turns. Each comes with its context, the actions that were taken and the trajectory that followed. The agent doesn't just see "a similar situation happened". It sees what was done and where it led.

The memory is built passively. Whenever a harness run happens, its turns are logged in a normalised format and become searchable. Nothing has to be curated by hand.

Strong models teach, small models reuse

This is the part that interests me most. Trajectories built up by stronger models can be reused by small, locally hosted models, without changing their weights. A small model that can recall how a strong model handled a near-identical situation punches well above its size. Making local, open-weight models genuinely useful is, to me, mostly a harness problem, and memory is a big piece of it.

The same memory doubles as a dataset: collected (state, action, outcome) trajectories are exactly the material you want for distillation and fine-tuning, if you decide to go that way later.

Open questions

  • How do you weight a remembered trajectory that failed? It's useful as a warning, but risky as an example.
  • When does similarity in embedding space actually mean similarity in task structure?
  • How much memory helps before it starts crowding out the actual problem in the context window?

These are what I'm testing now.

Twelve years of messy data

▶

Technical Resume

▶
C O N T A C T • M E