Patronus AI: $17 Million Raised To Deploy Reliable LLMs At Scale

By Amit Chowdhry • May 31, 2024

Patronus AI recently announced it raised $17 million in Series A funding, bringing the total amount raised to $20 million.

This funding round was led by Glenn Solomon at Notable Capital with participation from Lightspeed Venture Partners, Datadog, Gokul Rajaram, Factorial Capital, and several leading AI executives.

Launched by machine learning executives from Meta, Anand Kannappan, and Rebecca Qian, Patronus AI is the first automated evaluation and security platform that helps companies detect large language model (LLM) mistakes at scale. Utilizing proprietary AI, this platform enables enterprise development teams to score model performance and generate adversarial test cases, benchmark models, and more. Patronus AI automates and scales the manual and costly model evaluation methods prevalent in the enterprise today, enabling organizations to confidently deploy LLMs while minimizing the risk of model failures and misaligned outputs.

Since the company’s launch in late 2023, the company has released industry research shedding light on the pervasive accuracy and safety problems inherent with LLM use. And the first is FinanceBench, the industry’s first benchmark for LLM performance on financial questions. The research revealed that popular models such as OpenAI’s GPT-4-Turbo, only got 19 percent of answers right when reading an entire SEC filing. Patronus AI also released CopyrightCatcher, the first Copyright Detection API for LLMs, showing that LLMs are capable of plagiarizing content without the proper guardrails.

A number of large Fortune 500 companies already utilize Patronus AI to implement their generative AI initiatives safely within their organizations. And Patronus AI plans to use the additional funding to scale its AI research, engineering, and sales teams, train evaluation models, and develop new industry standard benchmarks.

KEY QUOTES:

“Model hallucinations and safety risks are here to stay. What enterprises need is transparency into model performance and accuracy in order to circumvent risks. For the first time, we’re giving companies a way to truly understand what they are working with so they can deploy LLMs with confidence. It’s the only path to innovation.”

  • Anand Kannappan, CEO, Patronus AI

“The intense interest among enterprises to bring LLM-based applications to market makes this one of the fastest growing markets we’ve ever seen at Notable Capital. Despite this swelling demand, the persistent issues of accuracy and safety in large language models pose risks that large enterprises cannot afford to take. Patronus AI is not only tackling this issue with their industry-first platform, their groundbreaking research is improving the reliability of AI outputs and setting new industry benchmarks for responsible AI use. Anand and Rebecca’s background in AI research are precisely what the industry needs at this critical juncture, and we’re thrilled to help them scale their solutions to any organization in need.”

  • Glenn Solomon, Managing Partner, Notable Capital