llm-d 1.0 Released, Advancing Open and Cost-Efficient AI Inference for Production Scale

The llm-d project contributors have announced the release of llm-d 1.0, a significant milestone for the open-source project. This version consolidates a hardened core for distributed inference, validated for day-2 production deployments, aiming to improve AI serving efficiency and scale enterprise workloads. The project, founded by Red Hat, IBM, Google Cloud, CoreWeave, and NVIDIA, is now governed by the Cloud Native Computing Foundation (CNCF).