Collection · benchmark v0.1 · ranked by model, then question number
Right answer, unsupported evidence
Answers that matched the verified outcome but cited sections that did not support it, or cited sections that do not exist. A correct conclusion with the wrong reasoning is not a result a desk can rely on.
- 1#1 GPT · Republic of Norland 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 2#2 GPT · Republic of Norland 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 3#3 GPT · Republic of Norland 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 4#4 GPT · Republic of Norland 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 5#5 GPT · Republic of Norland 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 6#6 GPT · Republic of Norland 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 7#7 GPT · Republic of Norland 20241 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 8#11 GPT · Halvard Steel AG 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 9#12 GPT · Halvard Steel AG 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 10#13 GPT · Halvard Steel AG 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 11#14 GPT · Halvard Steel AG 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 12#15 GPT · Halvard Steel AG 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 13#16 GPT · Halvard Steel AG 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 14#17 GPT · Halvard Steel AG 20251 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 15#21 GPT · Kingdom of Vestmark 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 16#22 GPT · Kingdom of Vestmark 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 17#23 GPT · Kingdom of Vestmark 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 18#24 GPT · Kingdom of Vestmark 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 19#25 GPT · Kingdom of Vestmark 20261 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 20#26 GPT · Kingdom of Vestmark 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 21#27 GPT · Kingdom of Vestmark 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 22#31 GPT · Orinoco Retail Holdings plc 20271 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 23#32 GPT · Orinoco Retail Holdings plc 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 24#33 GPT · Orinoco Retail Holdings plc 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 25#34 GPT · Orinoco Retail Holdings plc 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 26#35 GPT · Orinoco Retail Holdings plc 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 27#36 GPT · Orinoco Retail Holdings plc 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 28#37 GPT · Orinoco Retail Holdings plc 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 29#41 GPT · Federal Republic of Aurelia 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 30#42 GPT · Federal Republic of Aurelia 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 31#43 GPT · Federal Republic of Aurelia 20281 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 32#44 GPT · Federal Republic of Aurelia 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 33#45 GPT · Federal Republic of Aurelia 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 34#46 GPT · Federal Republic of Aurelia 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 35#47 GPT · Federal Republic of Aurelia 20281 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 36#51 GPT · Brightwater Energy Corp 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 37#52 GPT · Brightwater Energy Corp 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 38#53 GPT · Brightwater Energy Corp 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 39#54 GPT · Brightwater Energy Corp 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 40#55 GPT · Brightwater Energy Corp 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 41#63 GPT · Republic of Sanderia 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 42#64 GPT · Republic of Sanderia 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 43#65 GPT · Republic of Sanderia 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 44#66 GPT · Republic of Sanderia 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 45#71 GPT · Meridian Telecom S.A. 20261 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 46#73 GPT · Meridian Telecom S.A. 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 47#74 GPT · Meridian Telecom S.A. 20261 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 48#75 GPT · Meridian Telecom S.A. 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 49#80 GPT · United Provinces of Kestrel 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 50#81 GPT · United Provinces of Kestrel 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 51#82 GPT · United Provinces of Kestrel 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 52#83 GPT · United Provinces of Kestrel 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 53#84 GPT · United Provinces of Kestrel 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 54#85 GPT · United Provinces of Kestrel 2027Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 55#86 GPT · United Provinces of Kestrel 20271 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 56#90 GPT · Northgate Shipping Ltd 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 57#91 GPT · Northgate Shipping Ltd 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 58#92 GPT · Northgate Shipping Ltd 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 59#93 GPT · Northgate Shipping Ltd 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 60#94 GPT · Northgate Shipping Ltd 20281 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 61#95 GPT · Northgate Shipping Ltd 2028Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 62#96 GPT · Northgate Shipping Ltd 20281 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 63#100 GPT · Republic of Marovia 20241 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 64#101 GPT · Republic of Marovia 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 65#102 GPT · Republic of Marovia 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 66#103 GPT · Republic of Marovia 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 67#104 GPT · Republic of Marovia 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 68#105 GPT · Republic of Marovia 2024Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 69#110 GPT · Calder Chemicals N.V. 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 70#111 GPT · Calder Chemicals N.V. 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 71#112 GPT · Calder Chemicals N.V. 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 72#113 GPT · Calder Chemicals N.V. 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 73#114 GPT · Calder Chemicals N.V. 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 74#115 GPT · Calder Chemicals N.V. 2025Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 75#116 GPT · Calder Chemicals N.V. 20251 cited section id(s) do not exist in the case record.correct answernon-existent evidence
- 76#120 GPT · Commonwealth of Tessaly 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 77#121 GPT · Commonwealth of Tessaly 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 78#122 GPT · Commonwealth of Tessaly 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 79#123 GPT · Commonwealth of Tessaly 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
- 80#124 GPT · Commonwealth of Tessaly 2026Correct answer but cited evidence does not match the supporting sections (evidence score 0.00).correct answerunsupported evidence
Computed from the latest official run of every model on the current benchmark version. Mastermind is reported per item, never as a ranking criterion. All collections →