// bring a trace and a verdict changes
The court
Every challenge to a verdict, the evidence behind it, and the ruling — including the ones where we were wrong. A verdict overturned by evidence is the best thing that happens here.
Cases
6 shown · every ID is permanent-
VERDICT OVERTURNED
Sierra · RECOVERS yes → uncertain 5/5 AGENT → 4/5 AGENT filed by editorial internal audit · 2026-08-11 · decided 2026-08-11
The evidence behind the YES was supervisors reviewing responses in flight and stepping agents back on track — oversight correcting the agent, not the agent working out a different attempt. No tool-call retry is documented either way, so rule 04 can be neither met nor refused on this record. This is the only ruling of the six that moved a score down.
the evidence → · case #0006 → -
VERDICT OVERTURNED
Amazon Q Developer · RECOVERS no → yes 4/5 AGENT → 5/5 AGENT filed by editorial internal audit · 2026-08-11 · decided 2026-08-11
Transformation docs: "As it makes changes, it re-builds and runs existing unit tests in your source code to iteratively fix any encountered errors." That is rule 04 met — an error, a different attempt, no human turn. The old NO conceded the loop existed.
the evidence → · case #0005 → -
VERDICT OVERTURNED
Lovable · UNSUPERVISED no → yes 4/5 AGENT → 5/5 AGENT filed by editorial internal audit · 2026-08-11 · decided 2026-08-11
Build mode "handles execution end to end with minimal supervision" and the docs place review after the run, not at each step. Rule 05 turns on capability, and the stop button is an interrupt, not an approval gate. The old NO cited the mode working and answered no anyway.
the evidence → · case #0004 → -
VERDICT OVERTURNED
ChatGPT Tasks · ACTS no → yes filed by editorial internal audit · 2026-08-11 · decided 2026-08-11
Live docs state tasks can use apps that take write actions in connected services, which changes state outside the conversation. Score moved 1/5 to 2/5, CRON JOB WITH EXTRA STEPS to WRAPPER WITH AMBITION.
the evidence → · case #0003 → -
VERDICT OVERTURNED
Operator · RECOVERS no → yes filed by editorial internal audit · 2026-08-11 · decided 2026-08-11
Per-action screenshot feedback lets it pick a different next step, and the system card shows it writing substitute scripts after a tool failed — a different action, taken with no human in the loop. Score moved 3/5 to 4/5, WRAPPER WITH AMBITION to AGENT.
the evidence → · case #0002 → -
VERDICT UPHELD
LangGraph · RECOVERS filed by editorial internal audit · 2026-08-11 · decided 2026-08-11
The claim was that RetryPolicy and error handlers constitute recovery. Rule 04 excludes repeating the identical call, and RetryPolicy re-runs the identical node attempt; the error handler is a developer-written hook, a primitive the framework provides rather than the framework devising an alternative. Verdict upheld.
the evidence → · case #0001 →
Community votes never move a verdict on their own. Evidence does, and the reasoning that moved it is printed above in full.
File a challenge
evidence, not opinionName the product and the criterion, and link a trace, a doc page, or a recorded run that shows the behaviour. Vendors are welcome, and a vendor's own filing is labelled as such on the case. Sponsorship does not move a verdict and does not move a case up the queue.