Skip to content
Nov 14, 2026Sat
  1. NVIDIA Technical Blog40

    NVIDIA shows serving GLM-5.3 across two DGX Stations with vLLM

    NVIDIA's technical blog describes serving a frontier-scale model across two DGX Stations linked by ConnectX-8 RDMA, exposing one endpoint while tensor parallelism splits weights and computation across both GPUs. The model used is NVIDIA GLM-5.3 NVFP4, a quantized version of Z.ai's mixture-of-experts model, which no longer fits on a single machine.

Nov 12, 2026Thu
  1. Google AI (The Keyword)82

    Google launches Gemini Decisions API powered by Gemini Decision 1

    Google introduced the Gemini Decisions API, built on its new Gemini Decision 1 model and available through the Gemini API in Google AI Studio. It scores up to 1,000 yes/no, multiple-choice and rubric questions in a single pass over text, images, audio, video and PDFs, returning probabilities at 150-250 ms end-to-end latency and $0.10 per 1M input tokens, with no output tokens billed.

    Why it matters: A cheap, low-latency scoring endpoint for routing, policy checks and grading could replace custom classifiers and cut inference costs for teams building agent and multimodal pipelines.

  2. Meta Engineering · ML Applications42

    Meta details Intelligent Delivery system for allocating ad-ranking compute

    Meta Engineering described Intelligent Delivery, an ML-driven system that allocates compute across its ads serving stack toward a system-wide optimum. It has delivered about 10% incremental ranking performance on top of model and system advancements from 2017 through the first half of 2026. In that half, AI agents contributed to roughly 20% of its optimizations.

Nov 11, 2026Wed
  1. Meta Engineering · ML Applications58

    Meta details TLX, a Triton extension for explicit GPU warp-group control

    Meta Engineering introduced Triton Low-Level Extensions (TLX), which adds explicit warp-group and cluster-level orchestration to Triton while keeping its programming model. TLX targets NVIDIA Hopper and Blackwell and AMD MI300/MI350x. Meta reports 20-25% end-to-end MFU on GEM training across thousands of Blackwell GPUs, up to two-thirds lower compute-intensive latency in RecSys inference, and production use in LLM pretraining.

Nov 10, 2026Tue
  1. Google AI (The Keyword)60

    Google Cloud launches Gemini for healthcare

    Google Cloud announced Gemini for healthcare, an AI solution that unifies fragmented clinical, operational and administrative data. It connects to electronic health records, billing platforms, clinical guidelines and Medicare datasets, and orchestrates multi-step workflows such as medical records synthesis and prior authorization review within guardrails and human oversight. It is initially in preview with partners including HCA Healthcare, Highmark Health and Northwell Health.

    Why it matters: Google's entry into clinical workflow automation with named health-system partners signals a push to convert cloud AI into operational healthcare contracts, a segment where rivals are also competing.

Oct 30, 2026Fri
  1. Meta Engineering · ML Applications58

    Meta deploys LLM-generated JiTTests in production to catch bugs before code lands

    Meta said its Catching JiTTests system has moved from research prototype to production infrastructure, using LLMs to generate executable tests for risky code changes before they land. It combines intent-aware and dodgy diff test-generation workflows with an LLM-as-Judge ensemble and rule-based RubFake filtering, plus human-on-the-loop review. 589 engineers engaged, with a 60% true-positive rate.

Oct 28, 2026Wed
  1. Meta Engineering · ML Applications40

    Meta details PrivacyLib, a shared library enforcing privacy at data access

    Meta Engineering published a deep dive on PrivacyLib, a common library running inside the clients of hundreds of its data and processing systems. Systems integrate once, and new privacy requirements ship as modules reusing that integration, replacing per-system implementations that could take months. PrivacyLib performs billions of checks per second and includes an Agent Observability module for internal AI agents.

Oct 27, 2026Tue
  1. Meta Engineering · ML Applications58

    Meta unveils liquid-cooled 102.4T switch rack and open AI networking stack at OCP Summit

    At the 2026 OCP Global Summit, Meta detailed networking behind its Muse Wonder and Muse Spark models and its gigawatt-scale Prometheus cluster. Highlights include IcePack, its first liquid-cooled network rack with 102.4T IceCube switches (128×800G, Broadcom Tomahawk 6C or NVIDIA Spectrum-6), the Flattened Planar Fabric scale-out design, the petabit-scale BAG super-spine, the Tahan Ethernet scale-up switch for MTIA 300, and open-sourced MetaRoCE.

Oct 23, 2026Fri
  1. Amazon Science58

    Amazon releases TorchNeuron, an open-source PyTorch backend for AWS Trainium

    Amazon announced TorchNeuron, an open-source backend that translates PyTorch code into operations runnable on AWS Trainium chips, with minimal or no code changes for code already running on other accelerators. It adds an optional "adaptive eager" mode that groups and compiles operations, plus multi-level caching; a shared compilation service cut time to first training step by about a third in a 64-process test.

Oct 19, 2026Mon
Oct 13, 2026Tue
  1. Ollama Blog55

    Ollama Cloud models now run inside Fly.io Sprites sandboxes

    Ollama Cloud now works inside Fly.io Sprites, sandboxed Linux virtual machines with persistent disks. A new Ollama Connector routes calls through a Fly.io gateway that injects the API key, so code in a Sprite never sees it. Claude Code, Codex and Gemini CLI are supported out of the box, and Sprites can call Ollama cloud models including kimi-k3, glm-5.3 and deepseek-v4.1-flash.

  2. Amazon Science75

    AWS priming cuts hybrid model pretraining cost by over 99%

    Amazon Web Services researchers introduced priming, a method that reuses pretrained Transformer weights to build hybrid state space models, cutting pretraining cost by more than 99% and using under 0.5% of the source model's token budget. A 32-billion-parameter Gated KalmaNet hybrid matched its source Transformer on reasoning while decoding up to twice as fast at 128,000-token context. Code and models were released under Apache 2.0.

    Why it matters: Cheap, controlled architecture experiments could accelerate the shift away from pure Transformers for long-context agents, where KV-cache memory costs dominate serving economics.

Sep 29, 2026Tue
  1. Ollama Blog65

    Ollama 0.35 adds Jev-style decision models via /v1/systemone endpoint

    Ollama released version 0.35 with support for decision models built on TypeSafe's Jev API. A new /v1/systemone endpoint sends text as state plus named questions, and a locally running model answers all in one request. Three models launch: Bespoke Labs' open-source 9B nimble, plus Together AI's experimental 4B tev1 and 0.8B tev1:0.8b. Ollama says nimble averaged 91ms per decision locally on an M5 Max.

Aug 31, 2026Mon