-
- Technical
Change Data Capture (CDC) With Kafka® Connect and the Debezium PostgreSQL® Source Connector
After learning how to capture change data from an Apache Cassandra® database and produce event streams in Apache Kafka®, But now we need to speed up PostgreSQL® to be as fast as a Kafka.
Learn MorePaul Brebner
August 09, 2022 -
- Technical
Spinning Your Drones With Cadence and Apache Kafka®: How Many Drones Can We Fly?
In our Cadence Drone demonstration application blog series we have come up with we have a “New and Improved” Cadence+Kafka integration pattern, and push the boundaries of Cadence scalability to discover how many drones we can fly at once.
Learn MorePaul BrebnerJuly 22, 2022 -
- Technical
Spinning Your Drones With Cadence and Apache Kafka – Integration Patterns and New Cadence Features
Understand how the Drone and Order workflows interact, discover some extra Cadence+Kafka integration patterns, and explore some new Cadence features
Learn MorePaul BrebnerMay 17, 2022 -
- Technical
Spinning Your Drones With Cadence and Apache Kafka® – Architecture, Order and Delivery Workflows
In Part 3 of my Cadence blog series, we introduced the Drone Delivery Demo application, focusing on the Drone Workflow. In this blogpart we’ll look at the Drone Delivery from the perspective of the Order Workflows, understand how the Drone and Order workflows interact, discover some extra Cadence+Kafka integration patterns, and explore some new Cadence features
Learn MorePaul BrebnerApril 28, 2022 -
Spinning Your Drones with Cadence – Introduction
Let's build a new and more complex Cadence application for Drone Deliveries! This is the first part of a multi-part Cadence Drone series, and introduces the Drone Delivery problem, the main Drone Cadence Workflow, and an appendix on Drone movement.
Learn MorePaul BrebnerMarch 22, 2022 -
Redis™ Streams vs Apache Kafka®
The Redis Streams data type is newer than the Redis Pub/Sub data type, and is designed to support “disconnected” distributed streaming applications. The data type itself is essentially an append-only data structure, stored in memory—basically preserved messages!
Learn MorePaul BrebnerFebruary 16, 2022 -
- Technical
Redis™ Pub/Sub vs Apache Kafka®: Redis Pub/Sub Extras, Use Cases and Comparison With Apache Kafka
So what can we do to improve things if we need guaranteed message delivery and better scalability? “Stay tuned” for the next blog in this series when we will take a look at Redis Streams vs. Apache Kafka!
Learn MorePaul BrebnerFebruary 08, 2022 -
- Technical
Redis™️ Pub/Sub vs Apache Kafka®: An Introduction and Connected vs Disconnected Delivery
Redis Pub/Sub is the oldest style of messaging pattern supported by Redis, and uses a data type called a “channel” which supports typical Pub/Sub operations, such as Publish and Subscribe. It’s considered loosely coupled because publishers and subscribers don’t know about each other. Publishers publish messages to a channel (or multiple channels), and subscribers subscribe to 1 or more channels. A channel can have 0 or more subscribers, and the messages are delivered to all the current connected subscribers.
Learn MorePaul BrebnerFebruary 03, 2022 -
- Technical
Spinning Apache Kafka® Microservices With Cadence Workflows
In “Spinning your Workflows With Cadence!” we explored Cadence, a new scalable, developer-focused, open source workflow engine. Cadence is a great solution for highly fault-tolerant stateful workflow management, also known as “orchestration” (based on the idea of a conductor directing an orchestra). However, another popular architectural alternative for large-scale message-based distributed systems uses a loosely-coupled approach, known as “choreography” (based on the idea of dancers interacting with their immediate neighbours). Apache Kafka is a common example and enables large numbers of microservices to communicate with each other scalably and at low-latency, with no central state management required.
Learn MorePaul BrebnerJanuary 30, 2022