Skip to content

Technology

Deployment & engineering Latest news

Inference acceleration, memory and costs, deployment and infrastructure choices.

3 selectionsPast 30 days 2items Total indexed: 39items

Updated

Deployment & engineering selections

Nov 12, 2026ThuIssue 1–3 items
  1. Google AI (The Keyword)82

    Google launches Gemini Decisions API powered by Gemini Decision 1

    Google introduced the Gemini Decisions API, built on its new Gemini Decision 1 model and available through the Gemini API in Google AI Studio. It scores up to 1,000 yes/no, multiple-choice and rubric questions in a single pass over text, images, audio, video and PDFs, returning probabilities at 150-250 ms end-to-end latency and $0.10 per 1M input tokens, with no output tokens billed.

    Why it matters: A cheap, low-latency scoring endpoint for routing, policy checks and grading could replace custom classifiers and cut inference costs for teams building agent and multimodal pipelines.

Nov 10, 2026Tue
  1. Google AI (The Keyword)60

    Google Cloud launches Gemini for healthcare

    Google Cloud announced Gemini for healthcare, an AI solution that unifies fragmented clinical, operational and administrative data. It connects to electronic health records, billing platforms, clinical guidelines and Medicare datasets, and orchestrates multi-step workflows such as medical records synthesis and prior authorization review within guardrails and human oversight. It is initially in preview with partners including HCA Healthcare, Highmark Health and Northwell Health.

    Why it matters: Google's entry into clinical workflow automation with named health-system partners signals a push to convert cloud AI into operational healthcare contracts, a segment where rivals are also competing.

Oct 13, 2026Tue
  1. Amazon Science75

    AWS priming cuts hybrid model pretraining cost by over 99%

    Amazon Web Services researchers introduced priming, a method that reuses pretrained Transformer weights to build hybrid state space models, cutting pretraining cost by more than 99% and using under 0.5% of the source model's token budget. A 32-billion-parameter Gated KalmaNet hybrid matched its source Transformer on reasoning while decoding up to twice as fast at 128,000-token context. Code and models were released under Apache 2.0.

    Why it matters: Cheap, controlled architecture experiments could accelerate the shift away from pure Transformers for long-context agents, where KV-cache memory costs dominate serving economics.