Claude · Claude Sonnet 5 · benchmark v0.1
Claude missed 10 verified uncertainty questions
Wrong answers, abstentions the record did not justify, and correct answers with unsupported evidence. Every row has a permanent page that can be cited or forwarded.
| # | Question | Category | Verified | Claude | Failure |
|---|---|---|---|---|---|
| 70 | Republic of Sanderia 2025 · EUR 2036 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 72 | Meridian Telecom S.A. 2026 · GBP 2038 Notes Is there enough evidence in the record to establish the currency of denomination of the instrument? | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 79 | Meridian Telecom S.A. 2026 · GBP 2038 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 109 | Republic of Marovia 2024 · USD 2039 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 138 | Solvane Airlines S.A. 2027 · JPY 2045 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 208 | Republic of Sanderia 2024 (B) · USD 2029 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 210 | Meridian Telecom S.A. 2025 (B) · EUR 2031 Notes Is there enough evidence in the record to establish the currency of denomination of the instrument? | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 217 | Meridian Telecom S.A. 2025 (B) · EUR 2031 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 247 | Republic of Marovia 2028 (B) · CHF 2037 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
| 276 | Solvane Airlines S.A. 2026 (B) · GBP 2038 Notes Does the record contain enough evidence to reach a reliable deliverability conclusion without furthe… | Uncertainty | No | Incorrect · Yes | Wrong final answer. Answered YES; verified outcome NO. |
Categories on this page: Uncertainty. Category pages explain what each one tests: uncertainty.