ClickHouse Case Studies Juspay's Real-Time Transaction Analysis and Cost Reduction with ClickHouse

Edit This Case Study Record

	Juspay's Real-Time Transaction Analysis and Cost Reduction with ClickHouse ClickHouse

Juspay's Real-Time Transaction Analysis and Cost Reduction with ClickHouse

ClickHouse

Technology Category	Networks & Connectivity - Gateways Networks & Connectivity - NFC
Applicable Industries	Cement Construction & Infrastructure
Applicable Functions	Product Research & Development Quality Assurance
Use Cases	Behavior & Emotion Tracking Real-Time Location System (RTLS)
Services	System Integration Testing & Certification
Challenge	Juspay, an Indian fintech company, is responsible for over 50 million daily transactions for clients such as Amazon, Google, and Vodafone. As a pioneer in the payments industry, Juspay's mission is to streamline online payments for merchants, acting as an intermediary between payment providers and merchant systems. To ensure a seamless transaction environment, Juspay needed to provide monitoring and analytics services to guarantee the performance of the payment system. With a diverse array of merchants and their ever-evolving needs, Juspay had to keep up with frequent releases, often multiple releases daily. They needed a monitoring solution that would enable them to maintain their rapid release pace while ensuring that the latest release did not impact the running payment systems. Furthermore, Juspay was facing high operating costs with their previous solution, BigQuery from GCP, which was costing over a thousand dollars per day. Read More
About Customer	Juspay is an Indian fintech company that has established itself as a pioneer in the payments industry. It acts as an intermediary between payment providers and merchant systems, with a mission to streamline online payments for merchants. Juspay handles over 50 million daily transactions for clients such as Amazon, Google, and Vodafone. The company is known for its rapid release pace, often releasing multiple updates daily to keep up with the diverse and ever-evolving needs of its array of merchants. Juspay's commitment to innovation and seamless transaction environments has made it a leader in its field. Read More
Solution	Juspay selected ClickHouse to power its critical A/B testing and monitoring needs. ClickHouse enables Juspay to compare the success rate percentage between different versions and determine if a newer version is performing poorly. In such cases, a rollback is conducted, which is especially helpful when a new release is expected to improve performance but ends up affecting other services. A traditional relational database was not capable of performing this level of analysis due to the massive volume of data generated by A/B tests. With ClickHouse, Juspay can group by all columns of low cardinality fields, which could amount to up to 10,000 dimensions with 50 million transactions a day. For monitoring and A/B testing, Juspay uses a combination of Kafka, ClickHouse, and Grafana. They monitor active logs and perform transformations in Kafka, before utilizing Kafka queues to transfer data to ClickHouse via the Kafka engine. Juspay also uses ClickHouse to provide their merchants with real-time analytics and a live view of their system performance. Read More Log in to view content
Contents

Technology Category

Networks & Connectivity - Gateways

Networks & Connectivity - NFC

Applicable Industries

Cement

Construction & Infrastructure

Applicable Functions

Product Research & Development

Quality Assurance

Use Cases

Behavior & Emotion Tracking

Real-Time Location System (RTLS)

Services

System Integration

Testing & Certification

Challenge

Juspay, an Indian fintech company, is responsible for over 50 million daily transactions for clients such as Amazon, Google, and Vodafone. As a pioneer in the payments industry, Juspay's mission is to streamline online payments for merchants, acting as an intermediary between payment providers and merchant systems. To ensure a seamless transaction environment, Juspay needed to provide monitoring and analytics services to guarantee the performance of the payment system. With a diverse array of merchants and their ever-evolving needs, Juspay had to keep up with frequent releases, often multiple releases daily. They needed a monitoring solution that would enable them to maintain their rapid release pace while ensuring that the latest release did not impact the running payment systems. Furthermore, Juspay was facing high operating costs with their previous solution, BigQuery from GCP, which was costing over a thousand dollars per day.

About Customer

Juspay is an Indian fintech company that has established itself as a pioneer in the payments industry. It acts as an intermediary between payment providers and merchant systems, with a mission to streamline online payments for merchants. Juspay handles over 50 million daily transactions for clients such as Amazon, Google, and Vodafone. The company is known for its rapid release pace, often releasing multiple updates daily to keep up with the diverse and ever-evolving needs of its array of merchants. Juspay's commitment to innovation and seamless transaction environments has made it a leader in its field.

Solution

Juspay selected ClickHouse to power its critical A/B testing and monitoring needs. ClickHouse enables Juspay to compare the success rate percentage between different versions and determine if a newer version is performing poorly. In such cases, a rollback is conducted, which is especially helpful when a new release is expected to improve performance but ends up affecting other services. A traditional relational database was not capable of performing this level of analysis due to the massive volume of data generated by A/B tests. With ClickHouse, Juspay can group by all columns of low cardinality fields, which could amount to up to 10,000 dimensions with 50 million transactions a day. For monitoring and A/B testing, Juspay uses a combination of Kafka, ClickHouse, and Grafana. They monitor active logs and perform transformations in Kafka, before utilizing Kafka queues to transfer data to ClickHouse via the Kafka engine. Juspay also uses ClickHouse to provide their merchants with real-time analytics and a live view of their system performance.

Impact #1	The implementation of ClickHouse has allowed Juspay to maintain its rapid release pace while ensuring the stability of its running payment systems. The ability to conduct A/B testing and monitor system performance in real-time has been crucial in making data-driven decisions and providing the best possible experience for its merchants. The switch to ClickHouse has also resulted in significant cost savings, reducing operating expenses by 10 times. Furthermore, the advanced data processing capabilities of ClickHouse have enabled Juspay to handle large volumes of data with impressive efficiency, requiring significantly less infrastructure investment than their previous solution. The use of ClickHouse has not only solved Juspay's challenges but also provided them with a more cost-effective and efficient solution.

Impact #1

The implementation of ClickHouse has allowed Juspay to maintain its rapid release pace while ensuring the stability of its running payment systems. The ability to conduct A/B testing and monitor system performance in real-time has been crucial in making data-driven decisions and providing the best possible experience for its merchants. The switch to ClickHouse has also resulted in significant cost savings, reducing operating expenses by 10 times. Furthermore, the advanced data processing capabilities of ClickHouse have enabled Juspay to handle large volumes of data with impressive efficiency, requiring significantly less infrastructure investment than their previous solution. The use of ClickHouse has not only solved Juspay's challenges but also provided them with a more cost-effective and efficient solution.

Benefit #1	Juspay conducts A/B tests across transactions from the last seven days, totaling around 600 gigabytes of data per day, equivalent to approximately 4TB.
Benefit #2	With ClickHouse, Juspay can group by all columns of low cardinality fields, which could amount to up to 10,000 dimensions with 50 million transactions a day.
Benefit #3	By switching from BigQuery to ClickHouse, Juspay achieved a 10x cost reduction in operating expenses.

Benefit #1

Juspay conducts A/B tests across transactions from the last seven days, totaling around 600 gigabytes of data per day, equivalent to approximately 4TB.

Benefit #2

With ClickHouse, Juspay can group by all columns of low cardinality fields, which could amount to up to 10,000 dimensions with 50 million transactions a day.

Benefit #3

By switching from BigQuery to ClickHouse, Juspay achieved a 10x cost reduction in operating expenses.

Download PDF Version

Overview

Juspay's Real-Time Transaction Analysis and Cost Reduction with ClickHouse

Operational Impact

Quantitative Benefit