Loading dataset
Updated
| result_id | benchmark | benchmark_release_date | model | model_version | organization | country | model_access | model_release_date | training_compute_flop | score | score_unit | score_fraction | higher_is_better | stderr | result_date | reported_by | source | source_url | evaluation_setup | notes | epoch_file |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 262FWwUwrjPpxVN8G8sDZT | Mystery Game Puzzles | 2026-07-30 | GPT-5 | gpt-5-2025-08-07_low | OpenAI | United States of America | API access | 2025-08-07 | 66,000,000,000,000,000,000,000,000 | 0.16 | fraction | 0.16 | true | 0.0368452949177471 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 298stsbTPpZp7toZsS5cp8 | OTIS Mock AIME 2024-2025 | 2024-12-19 | GPT-5 nano | gpt-5-nano-2025-08-07_low | OpenAI | United States of America | API access | 2025-08-07 | ∅ | 0.466666666666667 | fraction | 0.466666666666667 | true | 0.0752101433090355 | 2026-07-13 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 2AbeCjy9w4KJWKhbKjtFTJ | Mystery Game Puzzles | 2026-07-30 | Claude Opus 4.1 | claude-opus-4-1-20250805_24K | Anthropic | United States of America | API access | 2025-08-05 | ∅ | 0.21 | fraction | 0.21 | true | 0.0409360180740332 | 2026-07-25 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 2CP56MmAkTeFXXT8pSGre4 | MirrorCode | 2026-06-26 | Grok 4.7 | grok-4.7_xhigh | xAI | United States of America | API access | 2026-09-21 | ∅ | 0.544444444444444 | fraction | 0.544444444444444 | true | 0.114395890455411 | 2026-10-29 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mirrorcode.csv |
| 2CdomqtBVz2it7a2Zx2G2t | GPQA diamond | 2023-11-20 | GPT-5.5 | gpt-5.5_low | OpenAI | United States of America | API access | 2026-04-23 | ∅ | 0.906565656565657 | fraction | 0.906565656565657 | true | 0.0175326583777217 | 2026-05-05 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 2Nf4PQvFjvbixGhtQXGQoS | MirrorCode | 2026-06-26 | Claude Opus 4.8 | claude-opus-4-8_max | Anthropic | United States of America | API access | 2026-05-28 | ∅ | 0.655555555555556 | fraction | 0.655555555555556 | true | 0.108460446386391 | 2026-10-21 | Epoch AI | Epoch AI | ∅ | ∅ | mirrorcode.csv | |
| 2QAt4ptgGkLtcbVL3hdAvL | FrontierMath-Tiers-1-3-v2-Private | 2026-06-12 | Claude Haiku 5.5 | claude-haiku-5-5_max | Anthropic | United States of America | API access | 2026-10-07 | ∅ | 0.750877192982456 | fraction | 0.750877192982456 | true | 0.0256644541023295 | 2026-10-07 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | frontiermath_tiers_1_3_v2.csv |
| 2RiSB2ii5kf2Q6fDBv2P3E | MATH level 5 | 2021-03-05 | o3-mini | o3-mini-2025-01-31_medium | OpenAI | United States of America | API access | 2025-01-31 | ∅ | 0.95166163141994 | fraction | 0.95166163141994 | true | 0.00465191785762158 | 2025-01-31 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | math_level_5.csv |
| 2UmuBfhBvYbbnTg5BnQqov | FrontierMath-Tier-4-v2-Private | 2026-06-12 | GPT-5.5 Instant | gpt-5.5-instant | OpenAI | United States of America | API access | 2026-05-05 | ∅ | 0.024390243902439 | fraction | 0.024390243902439 | true | 0.024390243902439 | 2026-08-02 | Epoch AI | Epoch AI | ∅ | ∅ | frontiermath_tier_4_v2.csv | |
| 2WxRbjq5ZWTgiXZPqYUG4R | FrontierMath-Tier-4-v2-Private | 2026-06-12 | GPT-5 mini | gpt-5-mini-2025-08-07_high | OpenAI | United States of America | API access | 2025-08-07 | ∅ | 0.121951219512195 | fraction | 0.121951219512195 | true | 0.0517395205746254 | 2026-06-12 | Epoch AI | Epoch AI | ∅ | ∅ | frontiermath_tier_4_v2.csv | |
| 2a2uhidAfksbnAJC8yUrZK | Mystery Game Puzzles | 2026-07-30 | GPT-5.1 | gpt-5.1-2025-11-13_none | OpenAI | United States of America | API access | 2025-11-13 | ∅ | 0.15 | fraction | 0.15 | true | 0.0358870281282637 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 2bhYPjF6VRWc5CeERGq8g5 | GPQA diamond | 2023-11-20 | Kimi K3.1 Pro | kimi-k3.1-pro-together_max | Moonshot | China | Open weights (restricted use) | 2026-10-23 | 20,001,000,000,000,000,000,000,000 | 0.941919191919192 | fraction | 0.941919191919192 | true | 0.014394467867935 | 2026-11-06 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 2c4rvmf5N7QXTugrFLMZ83 | SimpleQA Verified | 2025-09-09 | Claude Opus 4.7 | claude-opus-4-7_xhigh | Anthropic | United States of America | API access | 2026-04-16 | ∅ | 0.517 | fraction | 0.517 | true | 0.0158101537298333 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | simpleqa_verified.csv | |
| 2e2NePZeU3iB4wvhwCaTci | Mystery Game Puzzles | 2026-07-30 | GPT-5.4 Nano | gpt-5.4-nano-2026-03-17_high | OpenAI | United States of America | API access | 2026-03-17 | ∅ | 0.05 | fraction | 0.05 | true | 0.021904291355759 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 2eMHpXXR9h7P2oNPDQkTBY | FrontierMath-2025-02-28-Private | 2025-02-28 | GPT-5 nano | gpt-5-nano-2025-08-07_high | OpenAI | United States of America | API access | 2025-08-07 | ∅ | 0.0827586206896552 | fraction | 0.0827586206896552 | true | 0.0162068838583677 | 2025-10-30 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | frontiermath.csv |
| 2ekT2UzaebvmGprKvmeeEa | FrontierMath-2025-02-28-Private | 2025-02-28 | o1-mini | o1-mini-2024-09-12_high | OpenAI | United States of America | API access | 2024-09-12 | ∅ | 0.0137931034482759 | fraction | 0.0137931034482759 | true | 0.00686066309342303 | 2025-03-06 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | frontiermath.csv |
| 2f8Vn5QBdJnc9i5y9jzXS7 | OTIS Mock AIME 2024-2025 | 2024-12-19 | Qwen3.8 Max (0902) | qwen3.8-max-0902_xhigh | Alibaba | China | API access | 2026-09-01 | ∅ | 1 | fraction | 1 | true | 0 | 2026-09-02 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 2fQJP3brRApfBdQq7Zy3bm | OTIS Mock AIME 2024-2025 | 2024-12-19 | Llama 3.1-405B | Llama-3.1-405B-Instruct | Meta AI | United States of America | Open weights (restricted use) | 2024-07-23 | 38,000,000,000,000,000,000,000,000 | 0.0972222222222222 | fraction | 0.0972222222222222 | true | 0.0321864460916234 | 2025-02-25 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 2gzNF2d53h2oCKDnojLtSP | GPQA diamond | 2023-11-20 | Qwen3-30B-A3B-Thinking (Jul 2025) | qwen3-30b-a3b-thinking-2507 | Alibaba | China | Open weights (unrestricted) | 2025-07-30 | 648,000,000,000,000,000,000,000 | 0.700757575757576 | fraction | 0.700757575757576 | true | 0.0283278976135455 | 2026-08-30 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 2hH2GAPUFaJR7pfVKhhicg | SWE-Bench verified | 2024-08-13 | Claude Opus 4.6 | claude-opus-4-6 | Anthropic | United States of America | API access | 2026-02-05 | ∅ | 0.787190082644628 | fraction | 0.787190082644628 | true | 0.0186235373030529 | 2026-02-18 | Epoch AI | Epoch AI | ∅ | ∅ | swe_bench_verified.csv | |
| 2hbbp8z6PhB7c2T33os9q5 | FrontierMath-Tier-4-v2-Private | 2026-06-12 | Claude Opus 4.6 | claude-opus-4-6_max | Anthropic | United States of America | API access | 2026-02-05 | ∅ | 0.268292682926829 | fraction | 0.268292682926829 | true | 0.0700556420309516 | 2026-06-11 | Epoch AI | Epoch AI | ∅ | ∅ | frontiermath_tier_4_v2.csv | |
| 2jKf4iEfVQnHkgAwEtD9Nn | Chess Puzzles | 2025-12-10 | Claude Fable 5 | claude-fable-5_low | Anthropic | United States of America | API access | 2026-06-09 | ∅ | 0.31 | fraction | 0.31 | true | 0.0464823198711732 | 2026-10-13 | Epoch AI | Epoch AI | ∅ | ∅ | chess_puzzles.csv | |
| 2o8XZ8V6W5jKD7TuY4frux | FrontierMath-Tier-4-2025-07-01-Private | 2025-07-11 | Claude Sonnet 4.5 | claude-sonnet-4-5-20250929 | Anthropic | United States of America | API access | 2025-09-29 | ∅ | 0.0208333333333333 | fraction | 0.0208333333333333 | true | 0.0208333333333333 | 2025-09-29 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | frontiermath_tier_4.csv |
| 2pSDjMSGDh4HsAxkqUuNQP | GPQA diamond | 2023-11-20 | GPT-5 nano | gpt-5-nano-2025-08-07_high | OpenAI | United States of America | API access | 2025-08-07 | ∅ | 0.694444444444444 | fraction | 0.694444444444444 | true | 0.027594508998251 | 2025-10-30 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 2t26VSNdsAE5pefQEMP25x | GPQA diamond | 2023-11-20 | Claude 3.7 Sonnet | claude-3-7-sonnet-20250219_64K | Anthropic | United States of America | API access | 2025-02-24 | 33,500,000,000,000,000,000,000,000 | 0.797348484848485 | fraction | 0.797348484848485 | true | 0.0265068831230601 | 2025-05-26 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 2vg9qw9pd8zSyRMu9YNiVm | OTIS Mock AIME 2024-2025 | 2024-12-19 | Claude 2.1 | claude-2.1 | Anthropic | United States of America | API access | 2023-11-21 | ∅ | 0.0194444444444444 | fraction | 0.0194444444444444 | true | 0.0104775158766287 | 2025-03-07 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 2wd9khVKiBzsAMUquz2R5s | MATH level 5 | 2021-03-05 | DeepSeek-R1 (May 2025) | DeepSeek-R1-0528 | DeepSeek | China | Open weights (unrestricted) | 2025-05-28 | 3,300,000,000,000,000,000,000,000 | 0.966389728096677 | fraction | 0.966389728096677 | true | 0.00421561617356365 | 2025-05-29 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | math_level_5.csv |
| 2xMn6dbY9mw4pmkh8Tz9Gn | OTIS Mock AIME 2024-2025 | 2024-12-19 | QwQ-32B | QwQ-32B | Alibaba | China | Open weights (unrestricted) | 2025-03-05 | 3,510,000,000,000,000,000,000,000 | 0.591666666666667 | fraction | 0.591666666666667 | true | 0.0634896396543116 | 2026-08-28 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 2xNPhKLsiWLHQBLLDGU4VJ | OTIS Mock AIME 2024-2025 | 2024-12-19 | Claude 3.5 Sonnet | claude-3-5-sonnet-20240620 | Anthropic | United States of America | API access | 2024-06-20 | 27,000,000,000,000,000,000,000,000 | 0.0652777777777778 | fraction | 0.0652777777777778 | true | 0.02229313181566 | 2025-02-25 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 2xfFf6KZAp2gUWYhHGkFgs | SimpleQA Verified | 2025-09-09 | DeepSeek V4 Pro 0813 | deepseek-v4-pro-0813_max | DeepSeek | China | Open weights (unrestricted) | 2026-08-13 | 9,702,000,000,000,000,000,000,000 | 0.529058116232465 | fraction | 0.529058116232465 | true | 0.0158083946657066 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | simpleqa_verified.csv | |
| 2y5jXmHGjyEyZvGjNDtRZe | Mystery Game Puzzles | 2026-07-30 | Qwen 3.6 Flash | qwen3.6-flash | Alibaba | China | ∅ | 2026-04-27 | ∅ | 0.12 | fraction | 0.12 | true | 0.032659863237109 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 2z7kL9DpfvY44T9Wo99FYx | FrontierMath-Tier-4-v2-Private | 2026-06-12 | Gemini 2.5 Pro (Jun 2025) | gemini-2.5-pro | Google DeepMind | United States of America | API access | 2025-06-17 | ∅ | 0 | fraction | 0 | true | 0 | 2026-06-11 | Epoch AI | Epoch AI | ∅ | ∅ | frontiermath_tier_4_v2.csv | |
| 2z8ecBVZbXKHtpyFyxpJyB | GPQA diamond | 2023-11-20 | Doubao-Seed-2.0 Pro | doubao-seed-2.0-pro-260215_high | ByteDance | China | API access | 2026-02-14 | ∅ | 0.881944444444444 | fraction | 0.881944444444444 | true | 0.019429399729069 | 2026-10-28 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 3542DFKGpjD6k8AZfGKD7W | EBR-bench | 2026-07-01 | GPT-5.2 | gpt-5.2-2025-12-11_xhigh | OpenAI | United States of America | API access | 2025-12-11 | ∅ | 0.230159 | fraction | 0.230159 | true | ∅ | 2026-06-26 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | ebr_bench.csv |
| 37pJqPpXTE6ia9ikmmGPJ4 | OTIS Mock AIME 2024-2025 | 2024-12-19 | Claude Opus 4.8 | claude-opus-4-8_max | Anthropic | United States of America | API access | 2026-05-28 | ∅ | 0.983333333333333 | fraction | 0.983333333333333 | true | 0.0141019018704442 | 2026-06-07 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 3CGChL5vNDM6Df5C8Z8owN | OTIS Mock AIME 2024-2025 | 2024-12-19 | Gemma 3 1B | gemma-3-1b-it | Google DeepMind | United States of America | Open weights (restricted use) | 2025-03-12 | 12,000,000,000,000,000,000,000 | 0.0111111111111111 | fraction | 0.0111111111111111 | true | 0.00536281832868568 | 2026-08-28 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 3D8aaFBLZwQcnWHYKwvnmq | OTIS Mock AIME 2024-2025 | 2024-12-19 | GPT-5 | gpt-5-2025-08-07_high | OpenAI | United States of America | API access | 2025-08-07 | 66,000,000,000,000,000,000,000,000 | 0.913888888888889 | fraction | 0.913888888888889 | true | 0.0365887218675541 | 2025-10-29 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 3GzYKQW2K4iijm6a73rVeh | FrontierMath-2025-02-28-Private | 2025-02-28 | Claude Sonnet 4.5 | claude-sonnet-4-5-20250929_59K | Anthropic | United States of America | API access | 2025-09-29 | ∅ | 0.134948096885813 | fraction | 0.134948096885813 | true | 0.0201329873756761 | 2025-11-13 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | frontiermath.csv |
| 3JJ4ChNxMo8CGAh3HrKNrw | SimpleQA Verified | 2025-09-09 | DeepSeek V4.1 Flash | deepseek-v4.1-flash_max | DeepSeek | China | Open weights (unrestricted) | 2026-09-09 | 4,320,000,000,000,000,000,000,000 | 0.429 | fraction | 0.429 | true | 0.0156589975478702 | 2026-10-13 | Epoch AI | Epoch AI | ∅ | ∅ | simpleqa_verified.csv | |
| 3L22tfAid5ZM42p92tqC73 | Mystery Game Puzzles | 2026-07-30 | Gemini 3.6 Flash | gemini-3.6-flash_minimal | Google DeepMind | United States of America | API access | 2026-07-21 | ∅ | 0.25 | fraction | 0.25 | true | 0.0435194139889245 | 2026-08-05 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 3NYyCGnM6XhgytjyVGtwh8 | MATH level 5 | 2021-03-05 | GPT-5 mini | gpt-5-mini-2025-08-07_medium | OpenAI | United States of America | API access | 2025-08-07 | ∅ | 0.967900302114804 | fraction | 0.967900302114804 | true | 0.00385347574735366 | 2025-08-20 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | math_level_5.csv |
| 3PVdaSEYFJKgYUgHnF4DBu | Mystery Game Puzzles | 2026-07-30 | Claude Sonnet 5.5 | claude-sonnet-5-5_max | Anthropic | United States of America | API access | 2026-09-28 | ∅ | 0.65 | fraction | 0.65 | true | 0.0479372485441102 | 2026-09-29 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 3Q6osT8EYezayG7yfxkSpr | GPQA diamond | 2023-11-20 | GPT-5.2 | gpt-5.2-2025-12-11_high | OpenAI | United States of America | API access | 2025-12-11 | ∅ | 0.881944444444444 | fraction | 0.881944444444444 | true | 0.0191385827763392 | 2025-12-11 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 3QBsxKkbF2R2LEXTd6HDrJ | SimpleQA Verified | 2025-09-09 | GPT-5.4 Nano | gpt-5.4-nano-2026-03-17_high | OpenAI | United States of America | API access | 2026-03-17 | ∅ | 0.117 | fraction | 0.117 | true | 0.0101692878027133 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | simpleqa_verified.csv | |
| 3QjP5HPi8tKUzHtNJktfv4 | OTIS Mock AIME 2024-2025 | 2024-12-19 | gpt-oss-120b | openai/gpt-oss-120b_high | OpenAI | United States of America | Open weights (unrestricted) | 2025-08-05 | 4,940,000,000,000,000,000,000,000 | 0.888888888888889 | fraction | 0.888888888888889 | true | 0.0446334365561327 | 2025-12-11 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 3QtkFWzSLzd4hgYGsNd5cL | Mystery Game Puzzles | 2026-07-30 | Qwen 3.6 Flash | qwen3.6-flash_none | Alibaba | China | ∅ | 2026-04-27 | ∅ | 0.18 | fraction | 0.18 | true | 0.0386122919665369 | 2026-08-27 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
| 3S6fjGAMKWKK3zcdxkmh9H | OTIS Mock AIME 2024-2025 | 2024-12-19 | Gemini 1.5 Pro (May 2024) | gemini-1.5-pro-001 | Google DeepMind | United States of America | API access | 2024-05-14 | ∅ | 0.0680555555555556 | fraction | 0.0680555555555556 | true | 0.0189303429551488 | 2025-02-25 | Epoch AI | Epoch AI | ∅ | ∅ | otis_mock_aime_2024_2025.csv | |
| 3UbYVQELDHAcQgu7sTTnRf | GPQA diamond | 2023-11-20 | Magistral Small 1.2 | magistral-small-2509 | Mistral AI | France | Open weights (unrestricted) | 2025-09-18 | ∅ | 0.476010101010101 | fraction | 0.476010101010101 | true | 0.0259934626984534 | 2026-08-30 | Epoch AI | Epoch AI | ∅ | ∅ | gpqa_diamond.csv | |
| 3VDhPT5WvzjJZkRc36Kuvi | MATH level 5 | 2021-03-05 | o3-mini | o3-mini-2025-01-31_high | OpenAI | United States of America | API access | 2025-01-31 | ∅ | 0.96487915407855 | fraction | 0.96487915407855 | true | 0.00426526346198467 | 2025-02-13 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | math_level_5.csv |
| 3ZnPtGRJkvqHk8wvWWRgCe | Mystery Game Puzzles | 2026-07-30 | Claude Opus 4.8 | claude-opus-4-8_xhigh | Anthropic | United States of America | API access | 2026-05-28 | ∅ | 0.31 | fraction | 0.31 | true | 0.0464823198711732 | 2026-07-26 | Epoch AI | Epoch AI | ∅ | ∅ | ∅ | mystery_game_puzzles.csv |
50 of 7,449 rows loaded
