264 Closed vs. Open-Source Models – Performance = Gap Closing…China Rising, per Epoch AI… Performance on MATH Level 5 Test, Open vs. Closed LLMs by Year Released – 6/23-4/25, per Epoch AI Note: MATH Level 5 pass@1 refers to the accuracy of an AI model on the MATH benchmark, a dataset of high school competition-level mathematics problems. Level 5 indicates the most challenging problems in the benchmark. ‘pass@1’ measures whether the model correctly solves the problem on its first attempt. Source: Epoch AI (5/25) DeepSeek R1 (1/25) scored 93% vs. o3- mini’s (1/25) score of 95% Non-Downloadable (Closed) Downloadable (Open) AI Monetization Threats = Rising Competition + Open-Source Momentum + China’s Rise
