Feedback Loop
Steer the next answer with the last one
Most AI products collect feedback as silent telemetry. A real feedback loop closes immediately — the user picks a reason ('too long', 'missed the point'), sees the system write a preference, and the next answer demonstrably uses it. Feedback becomes an active control, not a future training signal.
Framing
The problem
Feedback in AI products is mostly telemetry — users vote, then nothing visible changes.
The pattern
Make feedback a structured loop: reason chips, a visible preference write, and the next answer demonstrating the change.
Why chat breaks here
Chat hides whether feedback influenced anything; users either give up or invent rituals to be heard.
Risks
Over-eager preference writes can swing the assistant toward instability; users need to edit and unpin.
Avoid when
The session is short and feedback would not survive long enough to be useful.
Use when
Feedback should visibly shape future answers — not just feed silently into telemetry.
DOPE evaluation
- Directability
- Pin, edit, or unpin any preference at any time
- Observability
- Each feedback entry produces a visible memory write the user can edit
- Predictability
- The next answer uses the preference; before/after is comparable on the same prompt
- Explainability
- Each preference is labelled with the feedback that produced it
In the wild
- ChatGPT Memory Updated + Pulse Curate (OpenAI) — "Memory updated" toasts appear inline when a fact is saved — user can hover, click "Manage memories", inspect the write. Pulse (Sept 2025) closes the loop with Curate feedback that visibly shapes the next morning brief.
- Claude Memory Write-Back (Anthropic) — Claude shows visible memory writes when it learns a preference; user can edit the memory summary in Settings → Capabilities. The diff is inspectable, not buried in telemetry.
- Cursor Per-Message Feedback (Cursor) — Caveat — thumbs + reason chips on each agent message feed CursorBench training, but the immediate next-answer impact is less user-visible than Pulse. Listed as a developer-facing example.
FAQ
When should I use the Feedback Loop pattern?
Feedback should visibly shape future answers — not just feed silently into telemetry.
When should I avoid the Feedback Loop pattern?
The session is short and feedback would not survive long enough to be useful.
What problem does Feedback Loop solve?
Feedback in AI products is mostly telemetry — users vote, then nothing visible changes.
Why is chat the wrong fit for this?
Chat hides whether feedback influenced anything; users either give up or invent rituals to be heard.
Related patterns
- Extends: AI Memory — Feedback is the input; memory is the artefact it writes. The loop closes when the user sees the write and can edit it.
- Alternative to: Constraint Rules Engine — Both shape future runs — feedback through accumulated preference, rules through declared constraint. Soft vs hard.
- Often paired with: Autonomy Dial — Tune autonomy with feedback as the agent learns what kind of decisions you defer or reverse.