Spark

Confluent Data Streaming Platform vs. Databricks Data Intelligence Platform for Data Integration and Processing

This blog explores how Confluent and Databricks address data integration and processing in modern architectures. Confluent provides real-time, event-driven pipelines…

4 weeks ago

The Past, Present, and Future of Confluent (The Kafka Company) and Databricks (The Spark Company)

Confluent and Databricks have redefined modern data architectures, growing beyond their Kafka and Spark roots. Confluent drives real-time operational workloads;…

1 month ago

Fraud Detection in Mobility Services (Ride-Hailing, Food Delivery) with Data Streaming using Apache Kafka and Flink

Mobility services like Uber, Grab, and FREE NOW (Lyft) rely on real-time data to power seamless trips, deliveries, and payments.…

1 month ago

The Data Streaming Landscape 2025

Data streaming is a new software category. It has grown from niche adoption to becoming a fundamental part of modern…

6 months ago

The Data Streaming Landscape 2023

Data streaming is a new software category to process data in motion. Apache Kafka is the de facto standard used…

2 years ago

The Heart of the Data Mesh Beats Real-Time with Apache Kafka

If there were a buzzword of the hour, it would undoubtedly be "data mesh"! This new architectural paradigm unlocks analytic…

3 years ago

Kappa Architecture is Mainstream Replacing Lambda

Real-time data beats slow data. That's true for almost every use case. Nevertheless, enterprise architects build new infrastructures with the…

4 years ago

Can Apache Kafka Replace a Database?

Can and should Apache Kafka replace a database? How long can and should I store data in Kafka? How can…

5 years ago

Big Data Spain: Talk about KSQL – The Streaming SQL Engine for Apache Kafka

KSQL - The Open Source Streaming SQL Engine for Apache Kafka => Slides from my talk at Big Data Spain…

7 years ago

Machine Learning Trends of 2018 combined with the Apache Kafka Ecosystem

At OOP 2018 conference in Munich, I presented an updated version of my talk about building scalable, mission-critical microservices with…

7 years ago