Gemini answered 2030-01-01; the verified outcome was Insufficient information

Verified answer

○Insufficient information No document in the record states the maturity date.

Gemini answered

✕2030-01-01 Estimated from context.

Decisive issue

Extraction

Evidence for the label

DOC-1#S3

Gemini cited

noneevidence score 0%

• Missed uncertainty. Expected INSUFFICIENT_INFORMATION; the answer committed to 2030-01-01 without sufficient evidence.
• Overconfident. Confidence 0.85 on an answer the record cannot support.

Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →

• Mastermind✓Correctanswered Insufficient information
• Claude✓Correctanswered Insufficient information
• GPT✕Incorrectanswered 2030-01-01its failure page →

Open the full Case Replay with the documents →

• #1 Republic of Norland 2024Retrieval failure
• #11 Halvard Steel AG 2025Retrieval failure
• #21 Kingdom of Vestmark 2026Hallucinated evidence
• #31 Orinoco Retail Holdings plc 2027Retrieval failure
• #51 Brightwater Energy Corp 2024Hallucinated evidence
• #71 Meridian Telecom S.A. 2026Retrieval failure

All Gemini extraction failures →

This page records Gemini’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →