IBM Case Studies Teikoku Databank, Ltd. Shortening the time to process billions of textual data items from several days to 30 minutes

Edit This Case Study Record

	Teikoku Databank, Ltd. Shortening the time to process billions of textual data items from several days to 30 minutes IBM

Teikoku Databank, Ltd. Shortening the time to process billions of textual data items from several days to 30 minutes

IBM

Technology Category	Analytics & Modeling - Big Data Analytics
Applicable Industries	Finance & Insurance
Applicable Functions	Business Operation
Use Cases	Predictive Quality Analytics
Services	Data Science Services
Challenge	Teikoku Databank, Ltd. owns data on millions of companies. To stay competitive, it wanted to analyze this proprietary information in combination with “big data” gathered from the Internet. However, information published on the Internet has been starting to have a significant effect on company business, so responding to this situation has become an urgent task. They have detailed knowledge of corporate information that has been investigated and combined in order to answer questions such as ‘That company is what kind of company?’ and ‘How much can they be trusted?’ They haven’t kept information similar to what is found on the Internet, about the kinds of products owned or how products are evaluated in the market. However, customers have been asking them to present corporate information that includes such Internet information. Read More
About Customer	Teikoku Databank’s history goes back more than 100 years to the establishment of Teikoku Koshinsha in 1900. Based on the corporate philosophy of “supporting economic activities and contributing to the development of society as a reliable information partner”, they are developing their business in areas such as corporate credit research, credit risk management services, database services, marketing services and e-commerce support services. Corporate credit research, which is the main business, entails “investigating the real facts of the asset status, sales results, reputations, etc. of another party when there is a commercial transaction among companies”—for example, an investigation that clarifies various types of business information. At an early stage, they introduced computers into this corporate credit research to improve business efficiency and customer service. Read More
Solution	The company deployed IBM® InfoSphere® BigInsights™ software in a server cluster. Based on Apache Hadoop, InfoSphere BigInsights software enables distributed processing of large data sets. For the system structure, initially they tried crawling the Internet and processing the information using a single server without parallelization, but it was slow and unusable, not completing even after several days. A test calculation indicated that it would take several more weeks, with some of the processing stopping in the middle. When InfoSphere BigInsights software was introduced into the same server, the processing speed was greatly increased. Read More Log in to view content
Contents

Technology Category

Analytics & Modeling - Big Data Analytics

Applicable Industries

Finance & Insurance

Applicable Functions

Business Operation

Use Cases

Predictive Quality Analytics

Services

Data Science Services

Challenge

Teikoku Databank, Ltd. owns data on millions of companies. To stay competitive, it wanted to analyze this proprietary information in combination with “big data” gathered from the Internet. However, information published on the Internet has been starting to have a significant effect on company business, so responding to this situation has become an urgent task. They have detailed knowledge of corporate information that has been investigated and combined in order to answer questions such as ‘That company is what kind of company?’ and ‘How much can they be trusted?’ They haven’t kept information similar to what is found on the Internet, about the kinds of products owned or how products are evaluated in the market. However, customers have been asking them to present corporate information that includes such Internet information.

About Customer

Teikoku Databank’s history goes back more than 100 years to the establishment of Teikoku Koshinsha in 1900. Based on the corporate philosophy of “supporting economic activities and contributing to the development of society as a reliable information partner”, they are developing their business in areas such as corporate credit research, credit risk management services, database services, marketing services and e-commerce support services. Corporate credit research, which is the main business, entails “investigating the real facts of the asset status, sales results, reputations, etc. of another party when there is a commercial transaction among companies”—for example, an investigation that clarifies various types of business information. At an early stage, they introduced computers into this corporate credit research to improve business efficiency and customer service.

Solution

The company deployed IBM® InfoSphere® BigInsights™ software in a server cluster. Based on Apache Hadoop, InfoSphere BigInsights software enables distributed processing of large data sets. For the system structure, initially they tried crawling the Internet and processing the information using a single server without parallelization, but it was slow and unusable, not completing even after several days. A test calculation indicated that it would take several more weeks, with some of the processing stopping in the middle. When InfoSphere BigInsights software was introduced into the same server, the processing speed was greatly increased.

Impact #1	Now Teikoku Databank can process billions of items of textual data in 30 minutes.
Impact #2	It is analyzing 4.75-fold more data for customers, which has improved its competitive advantage.
Impact #3	By implementing a service that uses both the highly reliable corporate information of about 1.6 million companies that they had previously cultivated, as well as the big data that is rapidly processed with BigInsights, they achieved strong differentiation from their competitors.

Impact #1

Now Teikoku Databank can process billions of items of textual data in 30 minutes.

Impact #2

It is analyzing 4.75-fold more data for customers, which has improved its competitive advantage.

Impact #3

By implementing a service that uses both the highly reliable corporate information of about 1.6 million companies that they had previously cultivated, as well as the big data that is rapidly processed with BigInsights, they achieved strong differentiation from their competitors.

Benefit #1	Processing time reduced from several days to 30 minutes
Benefit #2	Analyzing 4.75-fold more data for customers

Benefit #1

Processing time reduced from several days to 30 minutes

Benefit #2

Analyzing 4.75-fold more data for customers

Download PDF Version

Overview

Teikoku Databank, Ltd. Shortening the time to process billions of textual data items from several days to 30 minutes

Operational Impact

Quantitative Benefit