Skip to content
Ollama Blog·Selected AI score78

NVIDIA's Nemotron 3.5 Lightning 30B model launches on Ollama for local agents

NVIDIA Nemotron 3.5 Lightning

Summary

NVIDIA's Nemotron 3.5 Lightning is now available on Ollama and runs entirely on-device. The open model has 30 billion total parameters with only 3 billion active per token on a hybrid Mixture-of-Experts architecture, aimed at long-running agent tasks like tool calling and multi-step work. It supports up to 1M token context and, via speculative decoding, offers up to 4x higher throughput than comparable open models.

Why it matters

A 3B-active open model tuned for agent loops, with 1M context and 4x throughput claims, lowers the cost floor for local agent workloads and pressures hosted inference pricing.

This site provides summaries and links to the originals only.

Source: Ollama Blog · ollama.com