NVIDIA's Nemotron 3.5 Lightning 30B model launches on Ollama for local agents
NVIDIA's Nemotron 3.5 Lightning is now available on Ollama and runs entirely on-device. The open model has 30 billion total parameters with only 3 billion active per token on a hybrid Mixture-of-Experts architecture, aimed at long-running agent tasks like tool calling and multi-step work. It supports up to 1M token context and, via speculative decoding, offers up to 4x higher throughput than comparable open models.
Why it matters: A 3B-active open model tuned for agent loops, with 1M context and 4x throughput claims, lowers the cost floor for local agent workloads and pressures hosted inference pricing.