Skip to content
NVIDIA Technical Blog· Fatima Fall·· 4d agoAI score40

NVIDIA shows serving GLM-5.3 across two DGX Stations with vLLM

When One GPU Isn’t Enough: Serving GLM-5.3 Across Two NVIDIA DGX Stations with vLLM

Summary

NVIDIA's technical blog describes serving a frontier-scale model across two DGX Stations linked by ConnectX-8 RDMA, exposing one endpoint while tensor parallelism splits weights and computation across both GPUs. The model used is NVIDIA GLM-5.3 NVFP4, a quantized version of Z.ai's mixture-of-experts model, which no longer fits on a single machine.

This site provides summaries and links to the originals only.

Source: NVIDIA Technical Blog · developer.nvidia.com