NVIDIA Buying Run:ai To Make AI Computing Resources More Efficient

By Amit Chowdhry • Apr 26, 2024

NVIDIA announced it is buying Run:ai to help customers use AI computing resources more efficiently. Run:ai is a Kubernetes-based workload management and orchestration software provider.

AI deployments are becoming more challenging, with workloads distributed across cloud, edge, and on-premises data center infrastructure.

Managing/orchestrating generative AI (GenAI), recommender systems, search engines, and other workloads requires sophisticated scheduling to optimize system performance and underlying infrastructure performance.

And Run:ai enables enterprise customers to manage their computing infrastructure, whether on premises, in the cloud or in hybrid environments.

The company built an open platform on Kubernetes, which is the orchestration layer for modern AI and cloud infrastructure. It supports all popular Kubernetes variants and integrates with third-party AI tools and frameworks.

Run:ai customers include some of the largest enterprises across multiple industries, which use the Run:ai platform to manage data-center-scale GPU clusters.

NVIDIA will continue offering Run:ai’s products under the same business model. And NVIDIA will continue investing in the Run:ai product roadmap, including enabling NVIDIA DGX Cloud, an AI platform co-engineered with leading clouds for enterprise developers, offering an integrated, full-stack service optimized for generative AI.

NVIDIA HGX, DGX, and DGX Cloud customers will also gain access to Run:ai’s capabilities for their AI workloads, particularly for large language model deployments. Run:ai’s solutions are already integrated with NVIDIA DGX, NVIDIA DGX SuperPOD, NVIDIA Base Command, NGC containers, and NVIDIA AI Enterprise software, among other products. And NVIDIA’s accelerated computing platform and Run:ai’s platform will continue supporting a broad ecosystem of third-party solutions, giving customers choice and flexibility.

KEY QUOTE:

“Run:ai has been a close collaborator with NVIDIA since 2020 and we share a passion for helping our customers make the most of their infrastructure. We’re thrilled to join NVIDIA and look forward to continuing our journey together.”

  • Omri Geller, Run:ai cofounder and CEO