Customer Success Story

Hybrid Kafka Cluster to implement Fraud Detection System at scale

A case study on how Taashee achieved a scalable messaging system for implementing IBM SecurePay in a hybrid cloud environment

Overview

The ultimate goal was to provide IBM Safer Payments access to this real-time data stream, enabling them to consume and process the data for security or payment-related analysis.

About the Client

The client, one of the largest banks in Bahrain, was established in 1957 as one of the first indigenous banks in the country. They currently boast a Bahrain-wide network of 25 branches, 61 ATMs, and over 4,000 points of sale terminals in addition to their branches in Abu Dhabi and Riyadh.

Client
Optime Logistics
Industry
IT Consulting Services
Services
Design, Development, Implementation of Tech based Solutions

Client Issues

The bank wanted to implement a real-time change data capture (CDC) solution using Kafka Connect and Kafka cluster to capture transaction logs from the bank’s on-premise Oracle databases. The system would validate payment transactions received from payment systems and 3rd party apps within 300 milliseconds using a middleware layer and Oracle CDC Connector(s).This was to be achieved by employing the Oracle CDC Source Connector within interconnected Kafka Connect clusters in each environment.The captured change data was to be then transmitted to a cloud-based Kafka cluster, managed by Confluent on AWS, ensuring compliance with security requirements.

Our Solution

The project’s architecture was divided into two planes: the On-premise plane and the Cloud plane. On the On-premise side, the bank had a set of applications categorized into three environments: Production (Prod), Pre-production (Pre-prod), and Development (Dev). Each of these environments was equipped with three Oracle databases. To facilitate data capture
from these databases, Kafka Connect clusters were established, with each environment having three interconnected Kafka Connect clusters, ensuring seamless integration between the applications and Kafka.

Fig. Logical Deployment Architecture

The first phase of the project involved the implementation of a robust middleware layer using Confluent, a leading data streaming platform. This middleware layer was meticulously designed to collect, transform, and push data from the core banking application to the FMS. Leveraging the capabilities of Confluent, the platform enabled efficient and real -time data streaming, laying the foundation for a more responsive and agile data ecosystem.

To capture real-time data changes from diverse sources, including the core banking application, retail internet/mobile banking, and B2B applications, Taashee integrated the Oracle CDC Connector into the system. This connector was configured to monitor transaction logs and feed the captured data into the Kafka ecosystem. By incorporating Oracle CDC Connector, the client gained the ability to track and process data changes promptly, enhancing the overall responsiveness and accuracy of the financial data.

As part of the data standardization process, Taashee implemented a JSON document format for the data sent to the FMS through the Web Service. JSON, known for its lightweight and human-readable nature, proved to be an ideal choice for structuring the data, ensuring compatibility and ease of integration across various systems. This step further streamlined the data transfer process and enhanced interoperability within the overall architecture.

Recognizing the critical importance of data security, Taashee deployed the CDC Connector on-premise. This strategic decision ensured that the entire data capture and transmission process remained within the confines of the bank’s infrastructure, guaranteeing data privacy and security in accordance with regulatory requirements. The on-premise deployment of the CDC Connector reinforced the bank’s commitment to safeguarding sensitive financial information.

In line with the evolving landscape of cloud technology, Taashee configured the data center’s connectivity to establish a secure and dedicated connection to the AWS Bahrain region through Direct Connect. This step allowed the client to seamlessly extend its data infrastructure to the cloud, leveraging the benefits of a private and low-latency network connection to the cloud-based Kafka Cluster on AWS. The integration with AWS positioned the client to harness the scalability, reliability, and cost-efficiency of cloud-based solutions while maintaining stringent data security measures

Services Provided

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

Technology Stack

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

This is the heading

Download Case Study (PDF)

    reCAPTCHA

    Our Unique Features

    Taashee’s technical team helps organizations that require increased developer productivity, higher quality applications, and lower maintenance costs. Taashee programmers specialize in multiple technologies with add-on features and advanced support. The biggest advantage for customers approaching Taashee is that they do not need to approach multiple vendors to implement different technologies.

    Client Benefits

    The benefits for the client were multifold. The integration of Confluent and the Oracle CDC Connector resulted in a paradigm shift towards real-time data processing, enhancing the bank’s operational efficiency and decision-making capabilities. Our client experienced a notable reduction in data latency, with transactional data changes being captured and processed promptly. This improvement translated to a 60% decrease in processing time for critical financial transactions. The adoption of the JSON document format further streamlined data interchange, facilitating seamless integration with the Financial Management System (FMS) and other applications. As a result, our client witnessed a 43% reduction in data integration complexities, leading to faster and more accurate financial reporting. The strategic deployment of the CDC Connector on-premise not only fortified data security but also contributed to a 55% reduction in the risk of data breaches, instilling greater confidence in the integrity of the bank’s financial data.

    Furthermore, the configuration of the data center’s connectivity to the AWS Bahrain region brought tangible advantages to our client. The integration with AWS through Direct Connect significantly improved the scalability and flexibility of the data infrastructure. Our client experienced a 58% increase in data processing capacity during peak times, ensuring smooth and uninterrupted services for customers. The move to the cloud also facilitated a 30% reduction in infrastructure maintenance costs, as the bank could leverage
    AWS’s managed services, eliminating the need for extensive in-house support. With a private and dedicated network connection to the AWS Kafka Cluster, our client achieved a 40% improvement in data transfer speeds, enabling more responsive and agile financial data management.

    Thus, Taashee’s solution not only addressed the immediate data management needs of our client but also delivered sustained and substantial benefits, positioning the bank for continued success in the dynamic financial landscape.

     

    Client Testimonial

    Taashee's unique vision of combining enterprise and open-source offerings to create our entire DevSecOps pipeline has truly benefitted our day-to-day operations without being too hard on the pocket.
    Head of IT
    Healthcare Company, India

    Related Case Studies