Skip to content

Technology

On-device AI Latest news

Small models, local inference tools and chips for phones, PCs and other devices.

1 selectionsPast 30 days 0items Total indexed: 6items

Updated

On-device AI selections

Aug 11, 2026TueIssue 1–1 items
  1. Ollama Blog78

    NVIDIA's Nemotron 3.5 Lightning 30B model launches on Ollama for local agents

    NVIDIA's Nemotron 3.5 Lightning is now available on Ollama and runs entirely on-device. The open model has 30 billion total parameters with only 3 billion active per token on a hybrid Mixture-of-Experts architecture, aimed at long-running agent tasks like tool calling and multi-step work. It supports up to 1M token context and, via speculative decoding, offers up to 4x higher throughput than comparable open models.

    Why it matters: A 3B-active open model tuned for agent loops, with 1M context and 4x throughput claims, lowers the cost floor for local agent workloads and pressures hosted inference pricing.