// the data · 1.0 · generated 2026-08-11

Take it and check us.

Every number on this site is folded from one file. Here it is, with the schema that describes it, the license that frees it, and the limits we know it has.

dataset.json dataset.csv schema.json court.json leash aggregate

01

What is in it

schema 1.0.0 · CC BY 4.0
02

Distributions

Verdict

  • 25AGENT
  • 4WRAPPER WITH AMBITION
  • 1CRON JOB WITH EXTRA STEPS

Proof grade (per criterion)

  • 5TRACE VERIFIED
  • 127OPERATOR INSPECTABLE
  • 16DOCS CLAIMED
  • 2UNVERIFIED

Trace access (per product)

  • 0PUBLIC
  • 27OPERATOR-OWNED
  • 2VENDOR-ONLY
  • 1UNAVAILABLE
03

Limitations

read these before you cite it
  1. This is not a model benchmark. It evaluates shipped products with tools, permissions and an operator — not foundation models. Two products on the same model can score differently, and usually do.
  2. Documentation is not a trace. The proof grade on every criterion says which one decided it. 16 criteria rest on the vendor's word alone, and are labelled DOCS CLAIMED wherever they appear.
  3. Leash comes from one sample. 42 Claude Code sessions · one operator · median 15 · max 92. It is a scale to read your own number against — not an industry benchmark, and not a claim about any other product or person. No contributed sessions yet.
  4. Capability is a judgement, made in public. Every criterion carries its reasoning, its source, a confidence and a date, and every change to one is on the record. 32 verdicts have already moved.
  5. Uncertain is not a soft no. 2 criteria could not be decided either way on the available evidence. They score zero and are shown as UNCERTAIN, never folded into NO.
  6. Vote totals are not a survey. They are self-selected visitors, hardened against stuffing but not representative of anyone.
04

Cite it

isitanagent.com. "Is it actually an agent?" 1.0, 2026-08-11.
25 of 30 shipped AI products pass a five-criterion agent test.
Dataset: https://isitanagent.com/api/dataset.json (CC BY 4.0).

Corrections are the point: file evidence in court and the dataset changes with your reason attached.