Meta Engineering · ML Applications·· 7d agoAI score58
Meta details TLX, a Triton extension for explicit GPU warp-group control
How We Built TLX: A Hardware-Native GPU Compiler for Production ML at Scale
Summary
Meta Engineering introduced Triton Low-Level Extensions (TLX), which adds explicit warp-group and cluster-level orchestration to Triton while keeping its programming model. TLX targets NVIDIA Hopper and Blackwell and AMD MI300/MI350x. Meta reports 20-25% end-to-end MFU on GEM training across thousands of Blackwell GPUs, up to two-thirds lower compute-intensive latency in RecSys inference, and production use in LLM pretraining.
This site provides summaries and links to the originals only.
Source: Meta Engineering · ML Applications · engineering.fb.com