Skip to content
Nov 14, 2026Sat
  1. NVIDIA Technical Blog40

    NVIDIA shows serving GLM-5.3 across two DGX Stations with vLLM

    NVIDIA's technical blog describes serving a frontier-scale model across two DGX Stations linked by ConnectX-8 RDMA, exposing one endpoint while tensor parallelism splits weights and computation across both GPUs. The model used is NVIDIA GLM-5.3 NVFP4, a quantized version of Z.ai's mixture-of-experts model, which no longer fits on a single machine.

Nov 11, 2026Wed
  1. Meta Engineering · ML Applications58

    Meta details TLX, a Triton extension for explicit GPU warp-group control

    Meta Engineering introduced Triton Low-Level Extensions (TLX), which adds explicit warp-group and cluster-level orchestration to Triton while keeping its programming model. TLX targets NVIDIA Hopper and Blackwell and AMD MI300/MI350x. Meta reports 20-25% end-to-end MFU on GEM training across thousands of Blackwell GPUs, up to two-thirds lower compute-intensive latency in RecSys inference, and production use in LLM pretraining.

Oct 27, 2026Tue
  1. Meta Engineering · ML Applications58

    Meta unveils liquid-cooled 102.4T switch rack and open AI networking stack at OCP Summit

    At the 2026 OCP Global Summit, Meta detailed networking behind its Muse Wonder and Muse Spark models and its gigawatt-scale Prometheus cluster. Highlights include IcePack, its first liquid-cooled network rack with 102.4T IceCube switches (128×800G, Broadcom Tomahawk 6C or NVIDIA Spectrum-6), the Flattened Planar Fabric scale-out design, the petabit-scale BAG super-spine, the Tahan Ethernet scale-up switch for MTIA 300, and open-sourced MetaRoCE.

Oct 24, 2026Sat
  1. Ollama Blog62

    Ollama adds text-to-speech with Gradium's Phonon models

    Ollama now converts text to speech, starting with Phonon, a family of small text-to-speech models from Gradium. It is available on macOS, with Windows and Linux support coming soon. On a MacBook Pro with M5 Max, Ollama ran 35% faster than Gradium's own runtime, matching the reference implementation's word error rate. Phonon is Apache 2.0; the 40M models are CC BY-NC 4.0.

Oct 19, 2026Mon
Sep 29, 2026Tue
  1. Ollama Blog65

    Ollama 0.35 adds Jev-style decision models via /v1/systemone endpoint

    Ollama released version 0.35 with support for decision models built on TypeSafe's Jev API. A new /v1/systemone endpoint sends text as state plus named questions, and a locally running model answers all in one request. Three models launch: Bespoke Labs' open-source 9B nimble, plus Together AI's experimental 4B tev1 and 0.8B tev1:0.8b. Ollama says nimble averaged 91ms per decision locally on an M5 Max.

Aug 31, 2026Mon