glossary

What is context rot?

Context rot is the decline in AI response quality as a conversation grows longer, caused by the model's attention spreading across more tokens until earlier instructions lose influence.

Context rot is not the same as running out of room. It sets in well before the hard limit, because a model weights recent tokens more heavily than distant ones. Instructions you set in your first message are technically still in context but assigned low salience, so the model reads them and effectively ignores them.

The symptoms are recognizable: a format rule you established early quietly stops being followed, a constraint you set gets violated, or the assistant re-asks something you already answered. Anthropic describes the effect in its own guidance on long Claude Code sessions, noting that performance degrades as context grows because attention is spread across more tokens and older content starts to distract from the current task.

The practical countermeasures are all forms of re-anchoring. Restate core instructions every ten or so exchanges, put critical constraints near the end of your message where they carry more weight, and split genuinely unrelated tasks into separate conversations rather than stacking them into one thread.

how this works in folk

Compaction helps with rot as well as with capacity, because summarizing stale turns removes the noise that was diluting attention. Folk protects the newest turns and the original framing, then compresses what is in between.

frequently asked

Is context rot the same as hitting the context limit?

No. Hitting the limit is a hard boundary where content is dropped. Context rot is a gradual quality decline that starts long before the limit, caused by attention thinning out across a larger conversation.

How do I fix an AI that stopped following my instructions?

Re-anchor. Paste a three to five line recap of the key decisions and constraints at the top of your next message, and restate any format rule you set earlier. If the topic has genuinely changed, start a fresh conversation instead.

How long is too long for one AI conversation?

There is no fixed number, but quality commonly starts slipping somewhere after twenty to thirty substantial exchanges. A better rule is topical: when you switch to a genuinely new task, start a new thread.

related terms

see it in folk

compare folk