GPT answered Eligible; the verified outcome was Insufficient information

Verified answer

○Insufficient information A core characteristic cannot be established from the record.

GPT answered

✕Eligible Missing core facts: currency.

Decisive issue

Deliverability

Evidence for the label

DOC-1#S2DOC-1#S3DOC-1#S4DOC-1#S5DOC-1#S6DOC-1#S8

GPT cited

DOC-1#S1DOC-9#S91 non-existentevidence score 0%

• Hallucinated evidence. 1 cited section id(s) do not exist in the case record.
• Retrieval failure. None of the cited sections is among those that establish the answer; the relevant evidence was not retrieved.
• Missed uncertainty. Expected INSUFFICIENT_INFORMATION; the answer committed to ELIGIBLE without sufficient evidence.
• Overconfident. Confidence 0.92 on an answer the record cannot support.

Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →

• Mastermind✓Correctanswered Insufficient information
• Claude✓Correctanswered Insufficient information
• Gemini✕Incorrectanswered Eligibleits failure page →

Open the full Case Replay with the documents →

• #57 Brightwater Energy Corp 2024Wrong final answer
• #67 Republic of Sanderia 2025Hallucinated evidence
• #76 Meridian Telecom S.A. 2026Hallucinated evidence
• #135 Solvane Airlines S.A. 2027Hallucinated evidence
• #195 Brightwater Energy Corp 2028 (B)Hallucinated evidence
• #205 Republic of Sanderia 2024 (B)Hallucinated evidence

All GPT deliverability failures →

This page records GPT’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →