Accenture announced it has invested through Accenture Ventures in Martian, a technology company that has built a patent-pending large language model (LLM) router. For any prompt, Martian’s router will find and use the LLM, which will give users the best result at the lowest cost.
With this investment, Accenture plans to integrate Martian’s advanced model router offering into its proprietary “switchboard” services. These services can customize large-language models (LLMs) for specific data sources and use cases, enhancing the impact of AI systems.
The rapid expansion of AI systems and large language models has created a complex landscape where each model presents unique tradeoffs in performance, cost, and speed. Martian’s model router addresses these challenges by searching across a vast number of LLMs to dynamically route prompts to the model that will yield the highest-quality results based on specific performance and technical requirements for each enterprise. This router also improves reliability; prompts are automatically rerouted to other providers when a model or provider becomes unavailable, significantly reducing downtime.
Launched in November 2023, Accenture’s switchboard service enables clients to test, evaluate, deploy, and control the most potent combination of LLMs for their needs. And integrating Martian’s dynamic router capabilities, clients will be able to open up access to AI systems with customized models tailored to unique prompts and requirements, ensuring optimal performance and cost-efficiency. The new LLMs will be automatically added in and analyzed as they become available, helping ensure that outputs will be accurate and current. Switchboard services can be applied to emerging technologies like quantum as well.
Martian is the latest company to join Accenture Ventures’ Project Spotlight, which is an engagement and investment program focused on working with companies that create or apply disruptive enterprise technologies. And Project Spotlight brings promising startups into Accenture’s innovation network, giving them exposure to real business problems we’re solving for our clients and helping them tailor, refine and scale their solutions for maximum impact.
The terms of the investment were not disclosed.
KEY QUOTES:
“Many of our clients are looking to reap the benefits of generative AI in a responsible way that takes into account customized requirements, performance and cost. The capabilities of Accenture’s switchboard services and Martian’s dynamic LLM routing simplify the user experience and will allow enterprises to experiment with generative AI and LLMs in order to find the perfect fit for their business needs.”
-Lan Guan, chief AI officer at Accenture
”We’re always exploring ways to accelerate our leadership in applying generative AI technology to create and protect growth and relevance for clients, with creativity at the core. We believe Martian’s novel approach and capabilities can help our clients and people build dynamic AI systems fit for today and tomorrow.”
-Dan Garrison, chief technology officer for Accenture Song
“The vast majority of enterprises building Gen AI applications are in early stages and finding that output accuracy is often too low to justify going into production. By integrating our technology with Accenture’s switchboard services, we can substantially boost accuracy so enterprises see quality results that exceed production threshold. Accenture’s technology and expertise will be critical as Martian continues to grow and simplify large language model management for enterprises.”
-Shriyash Upadhyay, co-founder of Martian
