Interconnects (Nathan Lambert)·· 20d agoAI score42
Artificial Analysis v5 index weights coding, science and knowledge work equally
Artificial Analysis v5 and the benchmarker's dilemma
Summary
Artificial Analysis updated its Intelligence Index to v5, weighting knowledge work, coding, science and general each at 25%, drawing on benchmarks including AA-Briefcase, FrontierCode 2.0, Terminal-Bench 4.0 and HLE-Diamond. Nathan Lambert writes that the ranking looks reasonable but shows strain, with eight closed models ahead of the best open-weight model, Kimi K3.1 Pro, and that private benchmarks reduce community scrutiny.
This site provides summaries and links to the originals only.
Source: Interconnects (Nathan Lambert) · interconnects.ai