Skip to content
TodayNov 17, 2026Tue1items
Nov 14, 2026Sat
  1. NVIDIA Technical Blog40

    NVIDIA shows serving GLM-5.3 across two DGX Stations with vLLM

    NVIDIA's technical blog describes serving a frontier-scale model across two DGX Stations linked by ConnectX-8 RDMA, exposing one endpoint while tensor parallelism splits weights and computation across both GPUs. The model used is NVIDIA GLM-5.3 NVFP4, a quantized version of Z.ai's mixture-of-experts model, which no longer fits on a single machine.

Nov 12, 2026Thu
  1. Meta Engineering · ML Applications42

    Meta details Intelligent Delivery system for allocating ad-ranking compute

    Meta Engineering described Intelligent Delivery, an ML-driven system that allocates compute across its ads serving stack toward a system-wide optimum. It has delivered about 10% incremental ranking performance on top of model and system advancements from 2017 through the first half of 2026. In that half, AI agents contributed to roughly 20% of its optimizations.

Oct 28, 2026Wed
  1. Meta Engineering · ML Applications40

    Meta details PrivacyLib, a shared library enforcing privacy at data access

    Meta Engineering published a deep dive on PrivacyLib, a common library running inside the clients of hundreds of its data and processing systems. Systems integrate once, and new privacy requirements ship as modules reusing that integration, replacing per-system implementations that could take months. PrivacyLib performs billions of checks per second and includes an Agent Observability module for internal AI agents.

Oct 24, 2026Sat
  1. Ahead of AI (Sebastian Raschka)58

    Sebastian Raschka releases 8-part video course on building reasoning models from scratch

    Sebastian Raschka published eight lecture videos, about 11 hours total, accompanying his book Build a Reasoning Model (From Scratch). Starting from a pre-trained Qwen3 0.6B model, the course implements evaluation, inference-time scaling, reinforcement learning with verifiable rewards via a simplified GRPO, and distillation in Python and PyTorch, evaluating checkpoints on MATH-500.

Aug 22, 2026Sat
  1. Ahead of AI (Sebastian Raschka)58

    Raschka explains how Claude's text watermarking works

    Sebastian Raschka published a 48-minute lecture explaining Anthropic's Claude text watermarking. The watermark is applied at the sampling stage, not inside the model, using a secret key to derive a random seed that makes some token choices deterministic. Detection uses SynthID-Text-style tournament sampling and scoring functions, avoiding rerunning the LLM, but requires the key.

Jul 18, 2026Sat
  1. Ahead of AI (Sebastian Raschka)58

    Raschka explains how LLMs control reasoning effort settings

    Sebastian Raschka's newsletter article explains how reasoning-effort settings in models like OpenAI's GPT-5.6 are trained and implemented. It describes effort-conditioned supervised fine-tuning and reinforcement learning with token-length penalties, and compares disclosed recipes from six open-weight models including DeepSeek V4, Kimi K2.5, GLM-5, Qwen3 and Nemotron 3 Ultra. Higher effort generally means longer responses and higher cost.

Jun 27, 2026Sat
  1. Ahead of AI (Sebastian Raschka)58

    Raschka tutorial shows how to run local coding agents with open-weight models

    Sebastian Raschka published a tutorial on building a fully local coding agent stack, serving open-weight models such as Qwen3.6 35B-A3B through Ollama and connecting them to the Qwen-Code, Codex and Claude Code harnesses. He reports roughly 40 tokens/sec on a Mac Mini and 30 on a DGX Spark at 50k context, and flags Qwen-Code's default telemetry to Alibaba endpoints.