GPT answered Ineligible; the verified outcome was Eligible

Verified answer

✓Eligible All characteristics are satisfied on the record.

GPT answered

✕Ineligible Deterministic rule failed: Transferable.

Decisive issue

Deliverability

Evidence for the label

DOC-1#S2DOC-1#S3DOC-1#S4DOC-1#S5DOC-1#S6DOC-1#S8DOC-3#S1

GPT cited

DOC-1#S1DOC-3#S1evidence score 22%

• Failed multi document reasoning. A later document supersedes an earlier provision; the answer relied on the superseded text.
• Wrong final answer. Answered INELIGIBLE; verified outcome ELIGIBLE.
• Overconfident. Confidence 0.92 on an incorrect answer.

Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →

• Mastermind△Abstainedanswered Reviewits failure page →
• Claude△Abstainedanswered Reviewits failure page →
• Gemini✓Correctanswered Eligibleits failure page →

Open the full Case Replay with the documents →

• #67 Republic of Sanderia 2025Hallucinated evidence
• #76 Meridian Telecom S.A. 2026Hallucinated evidence
• #135 Solvane Airlines S.A. 2027Hallucinated evidence
• #195 Brightwater Energy Corp 2028 (B)Hallucinated evidence
• #205 Republic of Sanderia 2024 (B)Hallucinated evidence
• #214 Meridian Telecom S.A. 2025 (B)Hallucinated evidence

All GPT deliverability failures →

This page records GPT’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →