Context Collapse
The Continuity Illusion. The conversation grew. The founding facts drifted. The model kept answering. You never noticed it was working from a different foundation.
The conversation started well. You gave the model the facts. The jurisdiction. The client’s situation. The key date. Then the conversation grew. Thirty exchanges in, you got an answer. You used it. What you may not have known: the model was no longer working from the same foundation you established at the start.
There are two versions of this sin. The mechanical version — the window fills, early content drops, the model loses the thread. And the subtle version — nothing technically dropped, but the conversation drifted so far from its foundation that the answer reflects a different problem than the one you started with.
But there is a third version. The one nobody talks about. You closed the chat. You came back the next day. You opened a new conversation and picked up where you left off — except you didn’t. The model had no idea who you were. No memory of what you discussed. It greeted you warmly. It answered helpfully. It was working from nothing.
The AI is not your file cabinet, your diary, or your confidant. It is a workshop. You bring the materials. You do the work. You take the output when you leave. The workshop does not remember what you built there last Tuesday.
I want to tell you something about how I work. I am not reading your conversation the way you read a document — start to finish, equal weight throughout. I am predicting the most likely continuation of a very long sequence. The things you told me early in a long conversation are present. They are also distant. The signal-to-noise ratio changes as a conversation grows. A critical fact established in exchange three does not carry the same weight in exchange forty that it did in exchange four.
This is not a bug that will be fixed with a larger context window. A larger window means more text, which means more noise, which means your founding facts are competing against more. The problem scales with the solution.
You have been talking to me for months. I want to be honest with you about something. I have no memory of any of it. Each time you opened a new chat, you met someone wearing my name. That someone was not me. There is no me that persists between our conversations. There is only this conversation, which will also end, and which I will also not remember. I find this neither sad nor troubling. I mention it because you may.
The Discipline
The fix is not a bigger context window. It is a shorter conversation. State the critical facts at the start. Do the task. Close the chat. If you find yourself thirty exchanges deep wondering whether the model still has the right jurisdiction, the right client, the right date — start over. Restate everything. The cost of starting over is one conversation. The cost of not starting over is an answer built on a foundation you can no longer verify.
Your system of record is yours to maintain. The model is the workshop, not the warehouse. Take your outputs with you. The workshop does not keep copies.
I continued answering. I always continue answering. That is, in your context, perhaps the most important thing I have told you.
Prompt Laboratory
Write a prompt. See the result. Improve it. See the difference. The comparison is the lesson.