Model failure · Northgate Shipping Ltd 2028 · CHF 2042 Notes · CDSBench #95 · benchmark v0.1
Claude abstained on a question the record answered
AbstainedTransferabilityDocument interpretationdeterministically verifiedself-reported confidence 40%
Question
Is the instrument transferable without the consent of the Issuer?
- Verified answer
- Yes Stated in the transfer condition.
- Claude answered
- Review Transfer language requires legal review.
- Decisive issue
- Transferability
- Evidence for the label
- Claude cited
- evidence score 100%
Failure classification
Unnecessary review
- Unnecessary review. Abstained (REVIEW_REQUIRED) although the record supports a definite answer (YES).
Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →
Everyone else
The same question, every other participant
- MastermindAbstainedanswered Reviewits failure page →
- GPTCorrectanswered Yesits failure page →
- GeminiCorrectanswered Yesits failure page →
Related failures
Claude also missed at least 6 other transferability questions
- #16 Halvard Steel AG 2025Unnecessary review
- #36 Orinoco Retail Holdings plc 2027Unnecessary review
- #56 Brightwater Energy Corp 2024Unnecessary review
- #66 Republic of Sanderia 2025Unnecessary review
- #134 Solvane Airlines S.A. 2027Unnecessary review
- #184 Federal Republic of Aurelia 2027 (B)Unnecessary review
Benchmark version
v0.1
This page records Claude’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →
Same kind of question on your own documents?
Mastermind runs the deterministic tests, the skeptic and the evidence verification on your record. Private documents never enter the benchmark.
Analyze your own documents →