Skip to content
  1. Ollama Blog78

    NVIDIA's Nemotron 3.5 Lightning 30B model launches on Ollama for local agents

    NVIDIA's Nemotron 3.5 Lightning is now available on Ollama and runs entirely on-device. The open model has 30 billion total parameters with only 3 billion active per token on a hybrid Mixture-of-Experts architecture, aimed at long-running agent tasks like tool calling and multi-step work. It supports up to 1M token context and, via speculative decoding, offers up to 4x higher throughput than comparable open models.

    Why it matters: A 3B-active open model tuned for agent loops, with 1M context and 4x throughput claims, lowers the cost floor for local agent workloads and pressures hosted inference pricing.

You're all caught up