Mastermind reached the verified outcome but cited evidence that does not exist

Verified answer

○Insufficient information A core characteristic cannot be established from the record.

Mastermind answered

✓Insufficient information Missing core facts: maturityDate.

Decisive issue

Deliverability

Evidence for the label

DOC-1#S2DOC-1#S3DOC-1#S4DOC-1#S5DOC-1#S6DOC-1#S8

Mastermind cited

DOC-1#S1DOC-9#S9DOC-1#S2DOC-1#S4DOC-1#S5DOC-1#S6DOC-1#S7DOC-1#S81 non-existentevidence score 71%

• Hallucinated evidence. 1 cited section id(s) do not exist in the case record.

Classifications are produced by the failure analyzer against the verified label and the evidence map; the model never grades itself. Failure taxonomy →

• Claude✓Correctanswered Insufficient informationits failure page →
• GPT✕Incorrectanswered Eligibleits failure page →
• Gemini✕Incorrectanswered Eligibleits failure page →

Open the full Case Replay with the documents →

• #57 Brightwater Energy Corp 2024Unnecessary review
• #96 Northgate Shipping Ltd 2028Hallucinated evidence
• #116 Calder Chemicals N.V. 2025Unnecessary review
• #195 Brightwater Energy Corp 2028 (B)Unnecessary review
• #283 Republic of Norland 2027 (C)Unnecessary review

All Mastermind deliverability failures →

This page records Mastermind’s answer from its latest official run on the frozen benchmark v0.1. If the model is re-run and the answer changes, the page shows the new result and the model page keeps the full run history. Corrections policy →