Skip to content
Meta Engineering · ML Applications·· 7d agoAI score58

Meta details TLX, a Triton extension for explicit GPU warp-group control

How We Built TLX: A Hardware-Native GPU Compiler for Production ML at Scale

Summary

Meta Engineering introduced Triton Low-Level Extensions (TLX), which adds explicit warp-group and cluster-level orchestration to Triton while keeping its programming model. TLX targets NVIDIA Hopper and Blackwell and AMD MI300/MI350x. Meta reports 20-25% end-to-end MFU on GEM training across thousands of Blackwell GPUs, up to two-thirds lower compute-intensive latency in RecSys inference, and production use in LLM pretraining.

This site provides summaries and links to the originals only.

Source: Meta Engineering · ML Applications · engineering.fb.com