You are on page 1of 16

Enterprise Event Streaming Platform Built by the Original Creators of Apache Kafka®

Unlocking the Power of Real-Time


Data: Command vs Event Driven
Architectures
About me.

Johnny Mirza - Staff Solutions Engineer - Confluent


Agenda
○ Overview - Event Driven Architecture
○ Whiteboard a Real-Time Event Streaming Scenario
○ Demo
Challenging old assumptions

Big Data Fast Data


The More the Better The Faster the Better

/
Value of Data

Value of Data
Age of Data Age of Data
We built systems optimised
for efficient storage…

Databases

Simple, static Slow, daily


queries batch processing

Data at rest
Zoom into the world of data integration…

Operational
Data Sources
Systems

Infrastructure
4

Browser mobile
Extract/Load Transform Reverse ETL
Logs

Telemetry

SaaS apps

… 4 SaaS
Applications
3
2
Systems of Record BI Tools

Core processing
systems Data Warehouses
1
External data

Unstructured data
Snowflake BigQuery Redshift Synapse
Real-Time Stream Processing

A Sale

Rich Front-End Customer


A shipment Experiences

Real-time &
Historical
Data

A Customer Real-Time Backend


Experience Operations

A Trade

The log!

Time

Pub/Sub - Storage - Processing


Capabilities of a data
streaming platform.

Process

Connect Data Topic

Store
Share

Govern
…shift the integration to the
Streaming Applications

Producers are Consumers are


Central
responsible for responsible for
Platform team
producing data consuming data
Moving to a scalable and truly decoupled
architecture.

“Integration”

Source Target

Source Target

Source Target

Source Target
Whiteboard Architecture
Demo
Learnings:

1. Data sources are growing. Data volumes


are growing. Current approach to
integration is not sustainable.

2. Kappa Architecture is the future of


Integration. (Event Driven Architecture)

3. Fast Data beats Slow Data.


Let’s
connect.

linkedin.com/in/johnnym

https://github.com/JohnnyMirza
Intrigued by Confluent Cloud?

New signups receive $400 to spend


within Confluent Cloud during their first
60 days
Promo code for new + existing users:
CC60COMM

Learn Apache Kafka®


with Confluent Ask questions, share knowledge
and chat with your fellow
community members!

cnfl.io/ask-the-community
15

You might also like