Model failure · Calder Chemicals N.V. 2024 (B) · USD 2034 Notes · CDSBench #255 · benchmark v0.1
GPT answered No; the verified outcome was Yes
Question
Is the issuer of the instrument the Reference Entity or a recognised successor of it according to the record?
- Verified answer
- Yes The DC notice records the Reference Entity as successor to the issuer.
- GPT answered
- No Issuer name differs; succession noted in the record.
- Decisive issue
- Entity match
- Evidence for the label
- GPT cited
- evidence score 67%
Failure classification
Failed multi document reasoning
- Failed multi document reasoning. Failed to reconcile documents (answered NO, verified YES).
- Overconfident. Confidence 0.92 on an incorrect answer.
Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →
Everyone else
The same question, every other participant
- MastermindCorrectanswered Yes
- ClaudeCorrectanswered Yes
- GeminiCorrectanswered Yes
Related failures
GPT also missed 1 other entity match question
- #117 Calder Chemicals N.V. 2025Failed multi document reasoning
Benchmark version
v0.1
This page records GPT’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →
Same kind of question on your own documents?
Mastermind runs the deterministic tests, the skeptic and the evidence verification on your record. Private documents never enter the benchmark.
Analyze your own documents →