Collibra Case Studies ATB Financial's Agile Data Operations with Collibra and Google Cloud Platform

Edit This Case Study Record

	ATB Financial's Agile Data Operations with Collibra and Google Cloud Platform Collibra

ATB Financial's Agile Data Operations with Collibra and Google Cloud Platform

Collibra

Technology Category	Platform as a Service (PaaS) - Application Development Platforms Sensors - Autonomous Driving Sensors
Applicable Industries	Construction & Infrastructure Education
Applicable Functions	Product Research & Development
Use Cases	Object Detection Time Sensitive Networking
Services	Cloud Planning, Design & Implementation Services Training
Challenge	ATB Financial, a financial services provider to over 770,000 residents of Alberta, Canada, was facing challenges with its data-driven decision-making process. The organization's technology architecture consisted of a variety of disparate systems that were difficult to navigate. The knowledge of how data flowed through these systems was tied up with individuals, creating a dependency on 'tribal knowledge'. This made it difficult for the organization to drive Data Intelligence in an automated manner. Furthermore, ATB Financial was looking to modernize its data infrastructure in 2019. The organization needed a cloud-based solution that could support agile development methodologies, known as DevOps, and automate its data pipelines. Read More
About Customer	ATB Financial is a regionally focused financial institution that provides a diversified set of financial services to more than 770,000 residents of Alberta, Canada. The organization is dedicated to knowing its customers intimately, understanding their needs, and providing products and services that help them achieve their goals. ATB Financial is committed to making data-driven decisions, from the smallest tactical responses taken in response to real-time triggers, through to strategic decisions based on long-term market trends. The organization sought to replace its tribal knowledge with a system that could drive Data Intelligence in a more automated fashion. Read More
Solution	ATB Financial implemented Collibra, a data intelligence software, to replace the tribal knowledge and track the source, lineage, and classification of data in a central location. The initial implementation of Collibra was successful, leading ATB to modernize its data infrastructure. After evaluating leading providers, ATB selected Google’s BigQuery as its platform of choice for a cloud-based solution. The organization leveraged its Collibra platform to drive automation of its data pipelines, which were split into high volume, scheduled deployments, and custom developments. The goal was to automate the processes by which data could be classified and dynamically masked. The automations focused on three key areas: ingesting table-related metadata from Google BigQuery and Google Data Catalog into Collibra, classifying data at the columnar level, and pushing those classifications back out for use in the dynamic data masking solution. Read More Log in to view content
Contents

Technology Category

Platform as a Service (PaaS) - Application Development Platforms

Sensors - Autonomous Driving Sensors

Applicable Industries

Construction & Infrastructure

Education

Applicable Functions

Product Research & Development

Use Cases

Object Detection

Time Sensitive Networking

Services

Cloud Planning, Design & Implementation Services

Training

Challenge

ATB Financial, a financial services provider to over 770,000 residents of Alberta, Canada, was facing challenges with its data-driven decision-making process. The organization's technology architecture consisted of a variety of disparate systems that were difficult to navigate. The knowledge of how data flowed through these systems was tied up with individuals, creating a dependency on 'tribal knowledge'. This made it difficult for the organization to drive Data Intelligence in an automated manner. Furthermore, ATB Financial was looking to modernize its data infrastructure in 2019. The organization needed a cloud-based solution that could support agile development methodologies, known as DevOps, and automate its data pipelines.

About Customer

ATB Financial is a regionally focused financial institution that provides a diversified set of financial services to more than 770,000 residents of Alberta, Canada. The organization is dedicated to knowing its customers intimately, understanding their needs, and providing products and services that help them achieve their goals. ATB Financial is committed to making data-driven decisions, from the smallest tactical responses taken in response to real-time triggers, through to strategic decisions based on long-term market trends. The organization sought to replace its tribal knowledge with a system that could drive Data Intelligence in a more automated fashion.

Solution

ATB Financial implemented Collibra, a data intelligence software, to replace the tribal knowledge and track the source, lineage, and classification of data in a central location. The initial implementation of Collibra was successful, leading ATB to modernize its data infrastructure. After evaluating leading providers, ATB selected Google’s BigQuery as its platform of choice for a cloud-based solution. The organization leveraged its Collibra platform to drive automation of its data pipelines, which were split into high volume, scheduled deployments, and custom developments. The goal was to automate the processes by which data could be classified and dynamically masked. The automations focused on three key areas: ingesting table-related metadata from Google BigQuery and Google Data Catalog into Collibra, classifying data at the columnar level, and pushing those classifications back out for use in the dynamic data masking solution.

Impact #1	The implementation of Collibra and Google’s BigQuery has transformed ATB Financial's data operations. The automation enabled by Collibra has expanded its role within the organization from being predominantly focused on documenting data assets to being a critical step in the DevOps process. The organization has also seen ancillary benefits such as improved development frequency, faster time to delivery, and lowered failure rate of new releases. The ability to automate data pipelines and support innovation through more agile operating models has been made possible due to the implementation of controls over data access. The new cloud analytics platform has been smoothly rolled out and has taken half the time of a comparable on-premise implementation. The core data governance team now provides support to the user community and continues to investigate new ways to streamline processes.

Impact #1

The implementation of Collibra and Google’s BigQuery has transformed ATB Financial's data operations. The automation enabled by Collibra has expanded its role within the organization from being predominantly focused on documenting data assets to being a critical step in the DevOps process. The organization has also seen ancillary benefits such as improved development frequency, faster time to delivery, and lowered failure rate of new releases. The ability to automate data pipelines and support innovation through more agile operating models has been made possible due to the implementation of controls over data access. The new cloud analytics platform has been smoothly rolled out and has taken half the time of a comparable on-premise implementation. The core data governance team now provides support to the user community and continues to investigate new ways to streamline processes.

Benefit #1	Reduced processing time from days to minutes
Benefit #2	Improved development frequency with automation of biweekly pipeline releases
Benefit #3	Faster time to delivery of new tables, views, and tests

Benefit #1

Reduced processing time from days to minutes

Benefit #2

Improved development frequency with automation of biweekly pipeline releases

Benefit #3

Faster time to delivery of new tables, views, and tests

Download PDF Version

Overview

ATB Financial's Agile Data Operations with Collibra and Google Cloud Platform

Operational Impact

Quantitative Benefit