Skip to content
Interconnects (Nathan Lambert)·· 20d agoAI score42

Artificial Analysis v5 index weights coding, science and knowledge work equally

Artificial Analysis v5 and the benchmarker's dilemma

Summary

Artificial Analysis updated its Intelligence Index to v5, weighting knowledge work, coding, science and general each at 25%, drawing on benchmarks including AA-Briefcase, FrontierCode 2.0, Terminal-Bench 4.0 and HLE-Diamond. Nathan Lambert writes that the ranking looks reasonable but shows strain, with eight closed models ahead of the best open-weight model, Kimi K3.1 Pro, and that private benchmarks reduce community scrutiny.

This site provides summaries and links to the originals only.

Source: Interconnects (Nathan Lambert) · interconnects.ai