Meta Engineering · ML Applications·· 19d agoAI score58
Meta deploys LLM-generated JiTTests in production to catch bugs before code lands
Catching Bugs Before They Land: JiTTesting’s Human-on-the-Loop Approach at Full Scale
Summary
Meta said its Catching JiTTests system has moved from research prototype to production infrastructure, using LLMs to generate executable tests for risky code changes before they land. It combines intent-aware and dodgy diff test-generation workflows with an LLM-as-Judge ensemble and rule-based RubFake filtering, plus human-on-the-loop review. 589 engineers engaged, with a 60% true-positive rate.
This site provides summaries and links to the originals only.
Source: Meta Engineering · ML Applications · engineering.fb.com