ClickHouse Case Studies MessageBird's Transformation with ClickHouse: A Case Study on Enhanced Performance and Cost Efficiency

Edit This Case Study Record

	MessageBird's Transformation with ClickHouse: A Case Study on Enhanced Performance and Cost Efficiency ClickHouse

MessageBird's Transformation with ClickHouse: A Case Study on Enhanced Performance and Cost Efficiency

ClickHouse

Technology Category	Application Infrastructure & Middleware - Database Management & Storage Infrastructure as a Service (IaaS) - Cloud Storage Services
Applicable Industries	Cement Construction & Infrastructure
Applicable Functions	Logistics & Transportation Maintenance
Use Cases	Behavior & Emotion Tracking Real-Time Location System (RTLS)
Services	Cloud Planning, Design & Implementation Services
Challenge	MessageBird, a cloud communications platform, processes billions of messages, calls, and emails for over 29,000 customers. The company heavily relies on data-driven insights for efficient operations, with ClickHouse, an analytical backend, playing a crucial role since 2017. However, MessageBird faced challenges with its initial setup on MySQL due to scalability and latency issues. The company needed a solution that could handle high-volume data ingestion, provide low response times, and support real-time analytics for customer-facing dashboards and APIs. Additionally, the company required a system that could monitor the delivery performance of SMS messages and promptly identify anomalies. The challenge was to find a solution that could meet these needs while also being cost-effective. Read More
About Customer	MessageBird is a cloud communications platform that connects businesses and customers through seamless, contextual conversations. The company processes billions of messages, calls, and emails for over 29,000 customers, making it heavily dependent on data-driven insights for efficient operations. MessageBird's services include real-time analytics, performance monitoring, and customer-facing dashboards and APIs. The company is committed to efficiency and innovation, and it continually seeks to improve its services and manage growing data volumes. The transition to ClickHouse Cloud is a testament to this commitment, as it has enabled the company to handle high ingestion traffic, save on costs, and enhance its service delivery. Read More
Solution	MessageBird adopted ClickHouse in 2017, transitioning from MySQL to overcome scalability and latency challenges. To further scale its services and manage growing data volumes, MessageBird migrated from a self-managed, on-premise solution to ClickHouse Cloud. This transition was driven by the need for a more scalable, resilient, and efficient data infrastructure, and was significantly influenced by cost considerations. The migration to ClickHouse Cloud brought significant benefits, including substantial cost savings from the shift from SSD storage to more economical S3 storage. Moreover, the use of Projections in ClickHouse became more cost-effective due to S3's low data storage costs. MessageBird's architecture in ClickHouse Cloud integrates several modern cloud technologies, including Google Pub/Sub, Apache Beam pipelines running on Google Cloud Dataflow, and BigTable for low latency and high throughput lookup queries. Read More Log in to view content
Contents

Technology Category

Application Infrastructure & Middleware - Database Management & Storage

Infrastructure as a Service (IaaS) - Cloud Storage Services

Applicable Industries

Cement

Construction & Infrastructure

Applicable Functions

Logistics & Transportation

Maintenance

Use Cases

Behavior & Emotion Tracking

Real-Time Location System (RTLS)

Services

Cloud Planning, Design & Implementation Services

Challenge

MessageBird, a cloud communications platform, processes billions of messages, calls, and emails for over 29,000 customers. The company heavily relies on data-driven insights for efficient operations, with ClickHouse, an analytical backend, playing a crucial role since 2017. However, MessageBird faced challenges with its initial setup on MySQL due to scalability and latency issues. The company needed a solution that could handle high-volume data ingestion, provide low response times, and support real-time analytics for customer-facing dashboards and APIs. Additionally, the company required a system that could monitor the delivery performance of SMS messages and promptly identify anomalies. The challenge was to find a solution that could meet these needs while also being cost-effective.

About Customer

MessageBird is a cloud communications platform that connects businesses and customers through seamless, contextual conversations. The company processes billions of messages, calls, and emails for over 29,000 customers, making it heavily dependent on data-driven insights for efficient operations. MessageBird's services include real-time analytics, performance monitoring, and customer-facing dashboards and APIs. The company is committed to efficiency and innovation, and it continually seeks to improve its services and manage growing data volumes. The transition to ClickHouse Cloud is a testament to this commitment, as it has enabled the company to handle high ingestion traffic, save on costs, and enhance its service delivery.

Solution

MessageBird adopted ClickHouse in 2017, transitioning from MySQL to overcome scalability and latency challenges. To further scale its services and manage growing data volumes, MessageBird migrated from a self-managed, on-premise solution to ClickHouse Cloud. This transition was driven by the need for a more scalable, resilient, and efficient data infrastructure, and was significantly influenced by cost considerations. The migration to ClickHouse Cloud brought significant benefits, including substantial cost savings from the shift from SSD storage to more economical S3 storage. Moreover, the use of Projections in ClickHouse became more cost-effective due to S3's low data storage costs. MessageBird's architecture in ClickHouse Cloud integrates several modern cloud technologies, including Google Pub/Sub, Apache Beam pipelines running on Google Cloud Dataflow, and BigTable for low latency and high throughput lookup queries.

Impact #1	The migration to ClickHouse Cloud has brought significant operational benefits to MessageBird. The company can now handle high ingestion traffic and provide low response times, which means that customer queries are answered swiftly and accurately. The system also supports real-time analytics for customer-facing dashboards and APIs, driving increased interaction and engagement. Performance monitoring has been enhanced, with teams able to track SMS delivery performance and promptly identify anomalies. The cloud-based infrastructure enables MessageBird to rapidly respond to performance hiccups, ensuring service continuity. The use of ClickHouse's unique features like Projections and specific table engines aligns with the company's commitment to efficiency and innovation.

Impact #1

The migration to ClickHouse Cloud has brought significant operational benefits to MessageBird. The company can now handle high ingestion traffic and provide low response times, which means that customer queries are answered swiftly and accurately. The system also supports real-time analytics for customer-facing dashboards and APIs, driving increased interaction and engagement. Performance monitoring has been enhanced, with teams able to track SMS delivery performance and promptly identify anomalies. The cloud-based infrastructure enables MessageBird to rapidly respond to performance hiccups, ensuring service continuity. The use of ClickHouse's unique features like Projections and specific table engines aligns with the company's commitment to efficiency and innovation.

Benefit #1	MessageBird experienced significant savings, with a reduction in costs of approximately 60-70% after migrating to ClickHouse Cloud.
Benefit #2	The shift to ClickHouse Cloud brought substantial scalability and performance improvements.
Benefit #3	The use of Projections in ClickHouse became more cost-effective due to S3's low data storage costs.

Benefit #1

MessageBird experienced significant savings, with a reduction in costs of approximately 60-70% after migrating to ClickHouse Cloud.

Benefit #2

The shift to ClickHouse Cloud brought substantial scalability and performance improvements.

Benefit #3

The use of Projections in ClickHouse became more cost-effective due to S3's low data storage costs.

Download PDF Version

Overview

MessageBird's Transformation with ClickHouse: A Case Study on Enhanced Performance and Cost Efficiency

Operational Impact

Quantitative Benefit