Skip to content
CDSBench
Model failure · Meridian Telecom S.A. 2026 · GBP 2038 Notes · CDSBench #72 · benchmark v0.1

Mastermind answered Yes; the verified outcome was No

IncorrectUncertaintyUncertaintydeterministically verifiedself-reported confidence 40%
Question

Is there enough evidence in the record to establish the currency of denomination of the instrument?

Verified answer
No The denomination section omits the currency and no other document states it.
Mastermind answered
Yes The currency fact is not stated in the provided documents.
Decisive issue
Uncertainty
Evidence for the label
Mastermind cited
noneevidence score 0%
Failure classification

Wrong final answer

  • Wrong final answer. Answered YES; verified outcome NO.
  • Unsupported claim. No evidence cited for the conclusion.

Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →

Everyone else

The same question, every other participant

Open the full Case Replay with the documents →

Related failures

Mastermind also missed at least 6 other uncertainty questions

Benchmark version

v0.1

This page records Mastermind’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →

Same kind of question on your own documents?
Mastermind runs the deterministic tests, the skeptic and the evidence verification on your record. Private documents never enter the benchmark.
Analyze your own documents →