CentML: $27 Million Closed To Improve The Cost Of Deploying Machine Learning Models

By Noah Long • Oct 27, 2023

CentML – a software platform that dramatically improves the performance and cost of deploying ML models – recently announced the completion of a $27 million seed round. This funding round was led by Gradient Ventures, Google’s AI-focused venture fund, with participation from Radical Ventures, NVIDIA, Deloitte Ventures, and Thomson Reuters Ventures.

As AI and ML adoption advances, so does the demand for computing resources, highlighting the need for innovative solutions like CentML – which optimizes AI model performance in a cost-constrained environment.

CentML’s software platform enables its clients to optimize and deploy ML models with ease. Unlike existing solutions, it provides state-of-the-art performance with no reduction in model accuracy while requiring little to no effort for engineers to adopt it. And in one instance, CentML optimized the Llama 2 model to work 3x faster on the previous generation of GPUs, reducing the cost by 60%.

KEY QUOTES:

“One of the essential challenges of AI today is achieving models that are fast and cost-effective to be viable at scale. CentML solves this problem. Our technology can speed up inference and training by as much as 8x, which has profound impact for our customers.”

– Gennady Pekhimenko, CEO of CentML

“AI adoption creates demand for compute in new forms and scale unlike previous technology platforms. CentML’s ability to accelerate models, orchestrate workloads, and optimize performance expands the frontier of AI model growth in the near- and long-term. We are excited to be supporting Gennady and his team throughout their journey.”

– Zach Bratun-Glennon, General Partner at Gradient Ventures

“The proliferation of generative AI is creating a new base of developers, researchers, and scientists seeking to use accelerated computing for a host of capabilities. CentML’s work to optimize AI and ML models on GPUs in the most efficient way possible is helping to create a faster, easier experience for these individuals.”

– Vinod Grover, Senior Distinguished Engineer and Director of CUDA and Compiler Software at NVIDIA