Skip to content
TodayNov 17, 2026Tue2items
  1. NVIDIA Technical Blog42

    NVIDIA says Vera Rubin NVL72 leads MLPerf Endpoints v1.0 agentic inference

    NVIDIA's technical blog states that its Vera Rubin NVL72 system leads agentic inference performance on MLPerf Endpoints v1.0. The benchmark uses coding and enterprise workflows through an API to measure the balance between serving capacity and responsiveness, reflecting agent workloads that carry growing conversation histories and mix reasoning, tool calls and responses.

Nov 14, 2026Sat
  1. NVIDIA Technical Blog40

    NVIDIA shows serving GLM-5.3 across two DGX Stations with vLLM

    NVIDIA's technical blog describes serving a frontier-scale model across two DGX Stations linked by ConnectX-8 RDMA, exposing one endpoint while tensor parallelism splits weights and computation across both GPUs. The model used is NVIDIA GLM-5.3 NVFP4, a quantized version of Z.ai's mixture-of-experts model, which no longer fits on a single machine.

Nov 12, 2026Thu
  1. Google AI (The Keyword)82

    Google launches Gemini Decisions API powered by Gemini Decision 1

    Google introduced the Gemini Decisions API, built on its new Gemini Decision 1 model and available through the Gemini API in Google AI Studio. It scores up to 1,000 yes/no, multiple-choice and rubric questions in a single pass over text, images, audio, video and PDFs, returning probabilities at 150-250 ms end-to-end latency and $0.10 per 1M input tokens, with no output tokens billed.

    Why it matters: A cheap, low-latency scoring endpoint for routing, policy checks and grading could replace custom classifiers and cut inference costs for teams building agent and multimodal pipelines.

Nov 11, 2026Wed
  1. Meta Engineering · ML Applications58

    Meta details Your algorithm, letting users steer Facebook Feed and Reels with natural language

    Meta described Your algorithm, a system that lets Facebook users state in their own words what they want in Feed and Reels. A page shows an LLM-written Lately Summary and prefilled Interested In and Not Interested In lists; edits are validated by a smaller model, mapped to clean topic names and saved to a shared store both surfaces read. Changes apply through retrieval, reranking and on-device cache invalidation.

Oct 19, 2026Mon
Oct 16, 2026Fri
  1. Ollama Blog80

    Reflection's open-weight Beam model launches on Ollama with limited-time free access

    Reflection released Beam, its first open-weight model, on October 16, 2026, and Ollama is offering it free for a limited time as a day-zero partner, with zero data retention on its cloud endpoint. Beam is a mixture-of-experts model with about 501 billion total parameters and 23 billion active per token, a 1 million token context window, and an Apache 2.0 license, aimed at coding, reasoning and long-running agentic tasks.

    Why it matters: A 501B-parameter Apache 2.0 model with a 1M-token context, distributed free through Ollama, lowers the barrier for teams building coding and long-horizon agent workflows without local inference infrastructure.

Oct 13, 2026Tue
  1. Amazon Science75

    AWS priming cuts hybrid model pretraining cost by over 99%

    Amazon Web Services researchers introduced priming, a method that reuses pretrained Transformer weights to build hybrid state space models, cutting pretraining cost by more than 99% and using under 0.5% of the source model's token budget. A 32-billion-parameter Gated KalmaNet hybrid matched its source Transformer on reasoning while decoding up to twice as fast at 128,000-token context. Code and models were released under Apache 2.0.

    Why it matters: Cheap, controlled architecture experiments could accelerate the shift away from pure Transformers for long-context agents, where KV-cache memory costs dominate serving economics.

Sep 29, 2026Tue
  1. Ollama Blog65

    Ollama 0.35 adds Jev-style decision models via /v1/systemone endpoint

    Ollama released version 0.35 with support for decision models built on TypeSafe's Jev API. A new /v1/systemone endpoint sends text as state plus named questions, and a locally running model answers all in one request. Three models launch: Bespoke Labs' open-source 9B nimble, plus Together AI's experimental 4B tev1 and 0.8B tev1:0.8b. Ollama says nimble averaged 91ms per decision locally on an M5 Max.