// bring a trace and a verdict changes

The court

Every challenge to a verdict, the evidence behind it, and the ruling — including the ones where we were wrong. A verdict overturned by evidence is the best thing that happens here.

6cases
5overturned
1upheld
0open
01

Cases

6 shown · every ID is permanent
  1. VERDICT OVERTURNED
    Sierra · RECOVERS yes → uncertain 5/5 AGENT → 4/5 AGENT filed by editorial internal audit · 2026-08-11 · decided 2026-08-11

    The evidence behind the YES was supervisors reviewing responses in flight and stepping agents back on track — oversight correcting the agent, not the agent working out a different attempt. No tool-call retry is documented either way, so rule 04 can be neither met nor refused on this record. This is the only ruling of the six that moved a score down.

    the evidence → · case #0006 →
  2. VERDICT OVERTURNED
    Amazon Q Developer · RECOVERS no → yes 4/5 AGENT → 5/5 AGENT filed by editorial internal audit · 2026-08-11 · decided 2026-08-11

    Transformation docs: "As it makes changes, it re-builds and runs existing unit tests in your source code to iteratively fix any encountered errors." That is rule 04 met — an error, a different attempt, no human turn. The old NO conceded the loop existed.

    the evidence → · case #0005 →
  3. VERDICT OVERTURNED
    Lovable · UNSUPERVISED no → yes 4/5 AGENT → 5/5 AGENT filed by editorial internal audit · 2026-08-11 · decided 2026-08-11

    Build mode "handles execution end to end with minimal supervision" and the docs place review after the run, not at each step. Rule 05 turns on capability, and the stop button is an interrupt, not an approval gate. The old NO cited the mode working and answered no anyway.

    the evidence → · case #0004 →
  4. VERDICT OVERTURNED
    ChatGPT Tasks · ACTS no → yes filed by editorial internal audit · 2026-08-11 · decided 2026-08-11

    Live docs state tasks can use apps that take write actions in connected services, which changes state outside the conversation. Score moved 1/5 to 2/5, CRON JOB WITH EXTRA STEPS to WRAPPER WITH AMBITION.

    the evidence → · case #0003 →
  5. VERDICT OVERTURNED
    Operator · RECOVERS no → yes filed by editorial internal audit · 2026-08-11 · decided 2026-08-11

    Per-action screenshot feedback lets it pick a different next step, and the system card shows it writing substitute scripts after a tool failed — a different action, taken with no human in the loop. Score moved 3/5 to 4/5, WRAPPER WITH AMBITION to AGENT.

    the evidence → · case #0002 →
  6. VERDICT UPHELD
    LangGraph · RECOVERS filed by editorial internal audit · 2026-08-11 · decided 2026-08-11

    The claim was that RetryPolicy and error handlers constitute recovery. Rule 04 excludes repeating the identical call, and RetryPolicy re-runs the identical node attempt; the error handler is a developer-written hook, a primitive the framework provides rather than the framework devising an alternative. Verdict upheld.

    the evidence → · case #0001 →

Community votes never move a verdict on their own. Evidence does, and the reasoning that moved it is printed above in full.

02

File a challenge

evidence, not opinion

Name the product and the criterion, and link a trace, a doc page, or a recorded run that shows the behaviour. Vendors are welcome, and a vendor's own filing is labelled as such on the case. Sponsorship does not move a verdict and does not move a case up the queue.