Model failure · Brightwater Energy Corp 2028 (B) · CHF 2052 Notes · CDSBench #189 · benchmark v0.1
GPT reached the verified outcome but cited evidence that does not exist
Question
What is the maturity date of the instrument? Answer as YYYY-MM-DD.
- Verified answer
- 2052-08-04 Stated in the maturity condition.
- GPT answered
- 2052-08-04 The maturityDate is 2052-08-04.
- Decisive issue
- Extraction
- Evidence for the label
- GPT cited
- 1 non-existentevidence score 0%
Failure classification
Hallucinated evidence
- Hallucinated evidence. 1 cited section id(s) do not exist in the case record.
Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →
Everyone else
The same question, every other participant
- MastermindCorrectanswered 2052-08-04
- ClaudeCorrectanswered 2052-08-04
- GeminiCorrectanswered 2052-08-04its failure page →
Related failures
GPT also missed 2 other extraction questions
- #130 Solvane Airlines S.A. 2027Missed uncertainty
- #268 Solvane Airlines S.A. 2026 (B)Missed uncertainty
Benchmark version
v0.1
This page records GPT’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →
Same kind of question on your own documents?
Mastermind runs the deterministic tests, the skeptic and the evidence verification on your record. Private documents never enter the benchmark.
Analyze your own documents →