265 …Closed vs. Open-Source Models – Performance = Gap Closing…China Rising, per Artificial Analysis AI Model Performance by Provider – 1/25, per Artificial Analysis AI Monetization Threats = Rising Competition + Open-Source Momentum + China’s Rise Artificial Analysis Quality Index Score 0 50 100 Coding Quantitative Reasoning Reasing & Knowledge Scientific Reasoning & Knowledge DeepSeek OpenAI Anthropic Meta Alibaba Open Closed Closed Open Open Note: Scores are out of 100. The models for each company that are measured: for OpenAI, o1; for Alibaba, Qwen 2.5 72B; for Meta, Llama 3.1 405B; for Anthropic, Claude 3.5 Sonnet. The tests used are HumanEval, MATH-500, MMLU and GPQA Diamond. Source: Artificial Analysis via NBC News, ‘Why DeepSeek is different, in three charts’ (1/25)
