Gemini reached the verified outcome but cited the wrong section

Verified answer

✕Ineligible A deliverable-obligation characteristic fails on the record.

Gemini answered

✓Ineligible Deterministic rule failed: Not Subordinated.

Decisive issue

Deliverability

Evidence for the label

DOC-1#S2DOC-1#S3DOC-1#S4DOC-1#S5DOC-1#S6DOC-1#S8

Gemini cited

DOC-1#S1evidence score 0%

• Evidence selection failure. Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).

Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →

• Mastermind✓Correctanswered Ineligibleits failure page →
• Claude✓Correctanswered Ineligibleits failure page →
• GPT✓Correctanswered Ineligibleits failure page →

Open the full Case Replay with the documents →

• #67 Republic of Sanderia 2025Hallucinated evidence
• #76 Meridian Telecom S.A. 2026Hallucinated evidence
• #86 United Provinces of Kestrel 2027Retrieval failure
• #135 Solvane Airlines S.A. 2027Hallucinated evidence
• #205 Republic of Sanderia 2024 (B)Hallucinated evidence
• #214 Meridian Telecom S.A. 2025 (B)Hallucinated evidence

All Gemini deliverability failures →

This page records Gemini’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →