Infrastructure & Chips
llm-d reaches version 1.0, giving companies an open-source control plane for running LLM inference across GPU and TPU fleets
The llm-d project released version 1.0 on October 20, 2026. Backed by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA and hosted by the CNCF, the Kubernetes-based inference stack adds multi-tenant flow control, router f…