Substrate Labs: AI Infrastructure Company Closes $8 Million In Seed Funding

By Amit Chowdhry • Jun 25, 2024

AI infrastructure company Substrate Labs announced an $8 million seed round to deliver APIs that enable developers to build more modular AI systems, accelerating a new era of software development. The funding round was led by Lightspeed Venture Partners, with participation from South Park Commons, Craft Ventures, Guillermo Rauch (Vercel), Immad Akhund (Mercury), Will Gaybrick (Stripe), and others.

Headed by co-founder and CEO Rob Cheung and co-founder Ben Guo, the company also announced the official launch of its API, which is optimized for running ensembles of models.

Developers integrating AI are finding the most success when they split a problem into tasks and deploy the best model for each task at hand. However, the majority lack access to internal infrastructure that can run dozens of AI models in modular pipelines, meaning they are stuck trying to use a single large AI model for every task or stitching together solutions across various API vendors and GPU service providers. These approaches result in AI applications that are unreliable, slow and expensive due to low GPU utilization.

Through Stripe’s developer-first strategy in their DNA, the Substrate team is developing a powerful API for AI that utilizes curated open-source AI models across various modalities like text, images, audio, and semantic vectors, and optimizes these models to run at scale with special emphasis on how quickly one model’s outputs can be used as another’s inputs.

Substrate’s infrastructure is deeply integrated with SDKs that make it easy to create graph relations between models on the Substrate platform, enabling developers to build complex multi-inference AI workflows in several lines of code, with fewer data round trips and maximum parallelism. The company’s early customers include Substack and Maven.

KEY QUOTES:

“The AI market will inevitably move from training models to using inference that puts models to work—a massive market that today is far too inefficient. Rob and Ben are strong engineers with over a decade of experience designing APIs and scaling systems at organizations like Stripe, Substack and Venmo. They’re in a strong position to abstract away the complexity around operationalizing the right AI model for each job, enabling engineers to optimize development with sophisticated tools previously available only at large tech giants.”

– Nnamdi Iregbulem, partner at Lightspeed Venture Partners

“New AI models offer enormous potential, but the tools developers have access to today are impeding the deployment of intelligence into software systems. We built Substrate to help developers create AI-integrated programs intuitively, in the same way they create any other program: by relating small semantic tasks to each other to automate work. The tooling we’ve created will enable any company—not just tech behemoths—to run dozens of branching ML models in a single request.”

– Rob Cheung, co-founder and CEO

“We chose to partner with Substrate because we knew they would enable us to quickly leverage the capabilities of modern ML models without dedicating significant engineering resources to the task. We’ve integrated Substrate in our internal systems to categorize and recommend content as well as creator-facing tools, and we’re excited to continue exploring new use cases.”

– Jairaj Sethi, Substack CTO

“Over the past year, we’ve explored various tools to power course recommendations on Maven. Substrate has been a breath of fresh air because their product is so clearly focused on providing the simplest possible developer experience.”

– Shreyans Bhansali, Maven CTO