-
- Technical
Spinning Your Drones With Cadence and Apache Kafka – Integration Patterns and New Cadence Features
Understand how the Drone and Order workflows interact, discover some extra Cadence+Kafka integration patterns, and explore some new Cadence features
Learn MorePaul Brebner
May 17, 2022 -
- Technical
Spinning Your Drones With Cadence and Apache Kafka® – Architecture, Order and Delivery Workflows
In Part 3 of my Cadence blog series, we introduced the Drone Delivery Demo application, focusing on the Drone Workflow. In this blogpart we’ll look at the Drone Delivery from the perspective of the Order Workflows, understand how the Drone and Order workflows interact, discover some extra Cadence+Kafka integration patterns, and explore some new Cadence features
Learn MorePaul BrebnerApril 28, 2022 -
Spinning Your Drones with Cadence – Introduction
Let's build a new and more complex Cadence application for Drone Deliveries! This is the first part of a multi-part Cadence Drone series, and introduces the Drone Delivery problem, the main Drone Cadence Workflow, and an appendix on Drone movement.
Learn MorePaul BrebnerMarch 22, 2022 -
Redis™ Streams vs Apache Kafka®
The Redis Streams data type is newer than the Redis Pub/Sub data type, and is designed to support “disconnected” distributed streaming applications. The data type itself is essentially an append-only data structure, stored in memory—basically preserved messages!
Learn MorePaul BrebnerFebruary 16, 2022 -
- Technical
Redis™ Pub/Sub vs Apache Kafka®: Redis Pub/Sub Extras, Use Cases and Comparison With Apache Kafka
So what can we do to improve things if we need guaranteed message delivery and better scalability? “Stay tuned” for the next blog in this series when we will take a look at Redis Streams vs. Apache Kafka!
Learn MorePaul BrebnerFebruary 08, 2022 -
- Technical
Redis™️ Pub/Sub vs Apache Kafka®: An Introduction and Connected vs Disconnected Delivery
Redis Pub/Sub is the oldest style of messaging pattern supported by Redis, and uses a data type called a “channel” which supports typical Pub/Sub operations, such as Publish and Subscribe. It’s considered loosely coupled because publishers and subscribers don’t know about each other. Publishers publish messages to a channel (or multiple channels), and subscribers subscribe to 1 or more channels. A channel can have 0 or more subscribers, and the messages are delivered to all the current connected subscribers.
Learn MorePaul BrebnerFebruary 03, 2022 -
- Technical
Spinning Apache Kafka® Microservices With Cadence Workflows
In “Spinning your Workflows With Cadence!” we explored Cadence, a new scalable, developer-focused, open source workflow engine. Cadence is a great solution for highly fault-tolerant stateful workflow management, also known as “orchestration” (based on the idea of a conductor directing an orchestra). However, another popular architectural alternative for large-scale message-based distributed systems uses a loosely-coupled approach, known as “choreography” (based on the idea of dancers interacting with their immediate neighbours). Apache Kafka is a common example and enables large numbers of microservices to communicate with each other scalably and at low-latency, with no central state management required.
Learn MorePaul BrebnerJanuary 30, 2022 -
- Technical
Spinning Your Workflows With Cadence!
Let’s start with the most basic Cadence concept, workflows. I’ll be using the cadence java client which requires you to download it and configure it to compile in your IDE of choice (I use Eclipse and Maven, and for simplicity I’ve omitted the imports). There’s a bunch of java client examples which inspired mine. First we need a workflow interface and implementation.
Learn MorePaul BrebnerDecember 17, 2021 -
Comparison of Apache Kafka Connect, Plus Elasticsearch™/Kibana™ vs. PostgreSQL®/Apache Superset Pipelines: Conclusions (Pipeline Series Part 10)
Note that for these pipeline experiments I used Instaclustr managed Open Distro for Elasticsearch (Apache 2 license), but Instaclustr now offers Managed OpenSearch.
Learn MorePaul BrebnerDecember 10, 2021