NVIDIA Open Sources Full Run:ai Platform
Following its acquisition of Run:ai in 2024, NVIDIA released the full Run:ai platform as open source software, as detailed in a company blog post. The software provides workload scheduling and GPU resource management for AI systems running on Kubernetes.
The release includes four components that can be used separately. KAI Scheduler handles GPU aware scheduling, GPU Fractioning Operator divides GPU memory among workloads, KAI Resource Management controls quotas and capacity across teams, and Workload Map provides a common structure for managing different Kubernetes workload types.
The source code is available through the NVIDIA DSX AI Factory organization on GitHub. An integrated version is also available through NVIDIA NGC as a Community Product with a Helm chart. It does not require a paid Run:ai subscription, but it does not include NVIDIA enterprise support.
Crusoe, Mirantis, Nebius, OpenNebula Systems, Rafay, Saturn Cloud, Spectro Cloud, and vCluster are integrating the open source platform into their services. NVIDIA will continue offering commercial versions through Mission Control, NVIDIA AI Enterprise, and selected cloud marketplaces.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Silicon Brief or Daily AI Brief.
Also, consider following us on social media:
More from Data Centers
Oct 20 San Francisco Mall AI Data Center Plan Faces Permit Freeze Oct 20 Elice Shares Plunge 33% in Seoul Trading Debut Oct 20 OpenAI stops pushing for China chip export limits, Politico reports Oct 20 G42 and AMI Labs Explore World Models for Physical AI Oct 20 Google to Fund Grid Upgrades for Expanded Arkansas Data CenterSilicon Brief
Weekly coverage of AI hardware developments including chips, GPUs, cloud platforms, and data center technology.
Whitepaper
Tensordyne Napier: What If One Rack Could Do the Work of Nine?
Tensordyne
This Tensordyne whitepaper presents Napier, an inference-focused AI processor and rack-scale system based on the company’s TDN Math logarithmic number system. It examines infrastructure requirements for large mixture-of-experts and agentic models, compares major inference architecture approaches, and details the TDN AIP processor, TDN72 pod, TDN Link fabric, and Napier Ultra configuration. The paper reports simulation-based performance, cost, and accuracy-validation results, including Tensordyne’s projected comparison of one Napier rack with a nine-rack Nvidia Rubin plus Groq deployment; the chip is reported as taped out and in fabrication.
Read moreYou may also like
NVIDIA expands stock buyback by $150 billion
NVIDIA Commits $250 Million in Compute to UK AI Safety Research
Zesty launches automated fractional GPUs for Kubernetes
OpenSearch Report Finds 83% of Organizations Run or Plan AI Workloads
Scality Launches AI Inference Factory for On Premises Deployment
Daily AI Brief: the AI news that matters, in your inbox.