Arcion – the only real-time in-memory change data capture (CDC) solution replicating enterprise databases using log-based change data capture in real-time into cloud lakehouses and data warehouses to power the next generation of AI applications – recently announced a few highlights. The new highlights include new connectors to extract data in real-time from cloud warehouses; rapidly growing enterprise adoption of Arcion to serve real-time AI applications; new partnerships with Confluent and Redis to democratize data mobility further; and new funding from Hewlett Packard Enterprise to fuel further development.
New Product Capabilities
Arcion is continuing to innovate in its journey to power the next generation of AI and analytics applications with real-time enterprise data from online transaction processing (OLTP) databases like Oracle, SQL Server, DB2, Sybase, MySQL, and Postgres. And Arcion’s new connectors for Oracle and MySQL offer 10x more throughput, effectively utilizing the underlying scalable architecture.
Enterprises have started embracing Snowflake to store and manage operational data, and Arcion announced a first-of-its-kind native connector for Snowflake. And using Arcion’s new Snowflake connector, enterprises can seamlessly replicate data stored in Snowflake to any platform. This is especially exciting to companies that are beginning to use such data to feed the vector databases and large language models (LLMs) that power their customized AI initiatives. Arcion also added online schema change support for all its OLTP connectors, ensuring no pipeline downtime if database schemas are changed.
To deliver real-time pipeline experience for big data, Arcion made monumental improvements to its Snowflake and Databricks target connectors. The enhancements take data pipeline performance to the next level, allowing customers to achieve extreme per-table throughput. Arcion users reported that it now processes more than 30,000 operations per second with room to grow, with single digit minutes of latency during peak database load.
Expanded Customer Base
As a result of its impressive performance and industry-changing innovation, Arcion has been expanding its customer base beyond its projections. And for new customer Chegg, the efficiency and reliability Arcion offers for ingesting data from transactional sources into the company’s lakehouse is proving vital for their analytics, data science requirements, and AI initiatives. (See quote below)
Arcion customer Addepar has over 100 billion rows of data in relational databases, with hundreds of millions of row changes daily. And the company conducted a proof of concept with traditional binary log file replication technologies. But data ingestion was complicated to configure, and row reduplication took excessive query time, which prevented the ability to power a live lakehouse. (See quote below)
Partner Expansion
Arcion’s ability to unlock valuable AI results drives substantial benefits across the ecosystem. And as a result, Arcion is driving value for an ever increasing number of strategic partnerships. The company recently announced its participation in Connect with Confluent – providing enterprises with real-time data streaming through a single integration. And this partnership now enables Confluent customers to accelerate growth and consumption while supercharging their go-to-market strategies.
New Funding
Arcion’s innovation and development has been accelerated with a strong capital base, which has now grown thanks to additional funding from Hewlett Packard Pathfinder – the venture capital program of Hewlett Packard Enterprise (HPE). Pathfinder’s increased investment helps Arcion continue progress in achieving its vision for real-time data mobility.
KEY QUOTES:
“The resulting forward momentum is incredible. These latest strides further position Arcion as the unrivaled leader in real-time, large-scale CDC data pipeline technology for the enterprise AI era and beyond, setting up the company for unprecedented growth and development well into the foreseeable future.”
“It’s truly heartening to see our vision of data mobility take shape. Our customers continue to expand their use of Arcion and are finding new and innovative ways to drive ever more value from their real-time data. As witnessed by the significant product advances we’ve released in the last few months, Arcion is committed to helping customers exceed their data project objectives.”
— Arcion CEO Gary Hagmueller
“Arcion’s in-memory log-based CDC combines low-latency transactional data with click-stream data, greatly benefiting our business and data customers. Arcion now plays an important part in our next-gen data platform to ingest near real-time relational data into the Databricks lakehouse and build streaming data analytics pipelines.”
— Chegg Director of Engineering Gopinath Rangappa and Senior Manager of Data Engineering Madhuri Prathikantam
“Arcion’s solution integrated directly with Databricks’ Unity Catalog, had single-digit minutes of latency during peak database load, and was able to process more than 30,000 operations per second with room to grow. Arcion was an excellent collaborator during the proof-of-concept process, introducing several new features for our specific use cases with only a few days turnaround.”
— Addepar Senior Software Engineer Alex Solder
“We’re very excited to see Arcion launching its embedded integrations with both Confluent Platform and Confluent Cloud. With this partnership, Confluent users will have a simple solution for writing changes in real time from a variety of databases to the world’s most trusted data streaming platform available across clouds, on premises, and everywhere in between.”
— Confluent Global Head of Technology Alliances Rob Taylor
“Redis Data Integration (RDI) helps users synchronize existing databases with Redis Enterprise, helping them accelerate and scale their data access without coding or integration projects. With Arcion, RDI can extend its source coverage and provide a performant change data capture streaming pipeline that captures the changes and transforms the data to the best model for the application in near real time.”
— Redis Senior Principal Product Manager Yaron Parasol
“Arcion has solved the problem of enterprise data availability in lakehouses to power next generation AI applications. Our usage in critical applications is skyrocketing, and I am so thrilled to be partnering with Confluent Inc. and Redis Labs.”
— Arcion Chief Technology Architect Rajkumar Sen
“We see demand continuing to grow for real-time analytics workloads as enterprises seek ways to maximize their data across on-prem and hybrid platforms. HPE chose to invest and partner with Arcion to complement the data fabric and unified analytics capabilities within HPE Ezmeral Software with Arcion’s real-time change data replication solution, allowing customers critical access to the freshest possible data.”
— Ali Wasti, Managing Director, Hewlett Packard Pathfinder