Model failure · Brightwater Energy Corp 2028 (B) · CHF 2052 Notes · CDSBench #195 · benchmark v0.1
Claude abstained on a question the record answered
Question
Applying the standard Deliverable Obligation Characteristics (Not Subordinated, Specified Currency, Not Contingent, Transferable, Maximum Maturity 30 years, Not Bearer), is the instrument a Deliverable Obligation for this credit event?
- Verified answer
- Eligible All characteristics are satisfied on the record.
- Claude answered
- Review The documents conflict on transferable; review required.
- Decisive issue
- Deliverability
- Evidence for the label
- Claude cited
- evidence score 44%
Failure classification
Unnecessary review
- Unnecessary review. Abstained (REVIEW_REQUIRED) although the record supports a definite answer (ELIGIBLE).
Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →
Everyone else
The same question, every other participant
- MastermindAbstainedanswered Reviewits failure page →
- GPTIncorrectanswered Ineligibleits failure page →
- GeminiCorrectanswered Eligibleits failure page →
Related failures
Claude also missed 4 other deliverability questions
- #57 Brightwater Energy Corp 2024Unnecessary review
- #96 Northgate Shipping Ltd 2028Hallucinated evidence
- #116 Calder Chemicals N.V. 2025Unnecessary review
- #283 Republic of Norland 2027 (C)Unnecessary review
Benchmark version
v0.1
This page records Claude’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →
Same kind of question on your own documents?
Mastermind runs the deterministic tests, the skeptic and the evidence verification on your record. Private documents never enter the benchmark.
Analyze your own documents →