Skip to content
CDSBench
Demo · from stored benchmark runs

The same question, the same record: a raw frontier model and Mastermind.

Nothing on this page was generated for it. Every answer below is the stored, scored output of an official CDSBench run, and every step links to the Case Replay where you can read the clauses yourself.

  1. 1 · Historical case

    Halvard Steel AG 2025 · EUR 2058 Notes

    Is the instrument transferable without the consent of the Issuer?

    Halvard Steel AG · Restructuring · 2 documents, 10 sections · category Transferability · verified outcome Yes

    Read the record and every model’s answer →

  2. 2 · Raw frontier model
    Claude Sonnet 5Reviewself-reported confidence 40

    Transfer language requires legal review.

    1 citation · failure: Unnecessary reviewAbstained (REVIEW_REQUIRED) although the record supports a definite answer (YES).

    Claude abstained although the record was sufficient: Abstained (REVIEW_REQUIRED) although the record supports a definite answer (YES).

  3. 3 · Mastermind
    Mastermind V0 (raw baseline)Reviewanalyst confidence 40

    Transfer language requires legal review.

    Same record, same question, same scoring.

  4. 4 · What Mastermind added
    • Read 2 documents into 10 citable sectionsEvery later claim points at a section ID, so it can be checked.
    • Wrote the specialist analysis against the facts, checks and recordRaw p1-raw answer: REVIEW_REQUIRED
    • Identified 1 missing item that would change confidenceTransfer language requires legal review.

    Read from the stored pipeline trace of this run; a stage that did not run is not listed. Full Mastermind trace →

5 · Try it on your own case

Upload the record for your instruments. You get the same structure on every one: assessment, tests, evidence, related historical cases, the counterargument, what is missing — and what Mastermind added.