-
- Dev Rel
- Technical
Spinning Your Drones With Cadence and Apache Kafka – Integration Patterns and New Cadence Features – Part 5
Understand how the Drone and Order workflows interact, discover some extra Cadence+Kafka integration patterns, and explore some new Cadence features
Learn MorePaul BrebnerMay 17, 2022 -
- Dev Rel
- Technical
Spinning Your Drones With Cadence and Apache Kafka® – Architecture, Order and Delivery Workflows – Part 4
In Part 3 of my Cadence blog series, we introduced the Drone Delivery Demo application, focusing on the Drone Workflow. In this blogpart we’ll look at the Drone Delivery from the perspective of the Order Workflows, understand how the Drone and Order workflows interact, discover some extra Cadence+Kafka integration patterns, and explore some new Cadence features
Learn MorePaul BrebnerApril 28, 2022 -
- Dev Rel
Spinning Your Drones with Cadence – Introduction – Part 3
Let's build a new and more complex Cadence application for Drone Deliveries! This is the first part of a multi-part Cadence Drone series, and introduces the Drone Delivery problem, the main Drone Cadence Workflow, and an appendix on Drone movement.
Learn MorePaul BrebnerMarch 22, 2022 -
- Dev Rel
- Technical
Spinning Apache Kafka® Microservices With Cadence Workflows – Part 2
In “Spinning your Workflows With Cadence!” we explored Cadence, a new scalable, developer-focused, open source workflow engine. Cadence is a great solution for highly fault-tolerant stateful workflow management, also known as “orchestration” (based on the idea of a conductor directing an orchestra). However, another popular architectural alternative for large-scale message-based distributed systems uses a loosely-coupled approach, known as “choreography” (based on the idea of dancers interacting with their immediate neighbours). Apache Kafka is a common example and enables large numbers of microservices to communicate with each other scalably and at low-latency, with no central state management required.
Learn MorePaul BrebnerFebruary 21, 2022 -
- Dev Rel
Redis™ Streams vs Apache Kafka®
The Redis Streams data type is newer than the Redis Pub/Sub data type, and is designed to support “disconnected” distributed streaming applications. The data type itself is essentially an append-only data structure, stored in memory—basically preserved messages!
Learn MorePaul BrebnerFebruary 16, 2022 -
- Dev Rel
- Technical
Redis™ Pub/Sub vs Apache Kafka®: Redis Pub/Sub Extras, Use Cases and Comparison With Apache Kafka
So what can we do to improve things if we need guaranteed message delivery and better scalability? “Stay tuned” for the next blog in this series when we will take a look at Redis Streams vs. Apache Kafka!
Learn MorePaul BrebnerFebruary 08, 2022 -
- Dev Rel
- Technical
Redis™️ Pub/Sub vs Apache Kafka®: An Introduction and Connected vs Disconnected Delivery
Redis Pub/Sub is the oldest style of messaging pattern supported by Redis, and uses a data type called a “channel” which supports typical Pub/Sub operations, such as Publish and Subscribe. It’s considered loosely coupled because publishers and subscribers don’t know about each other. Publishers publish messages to a channel (or multiple channels), and subscribers subscribe to 1 or more channels. A channel can have 0 or more subscribers, and the messages are delivered to all the current connected subscribers.
Learn MorePaul BrebnerFebruary 03, 2022 -
- Dev Rel
- Technical
Spinning Your Workflows With Cadence! Part 1
Let’s start with the most basic Cadence concept, workflows. I’ll be using the cadence java client which requires you to download it and configure it to compile in your IDE of choice (I use Eclipse and Maven, and for simplicity I’ve omitted the imports). There’s a bunch of java client examples which inspired mine. First we need a workflow interface and implementation.
Learn MorePaul BrebnerDecember 17, 2021 -
- Dev Rel
Comparison of Apache Kafka Connect, Plus Elasticsearch™/Kibana™ vs. PostgreSQL®/Apache Superset Pipelines: Conclusions (Pipeline Series Part 10)
Note that for these pipeline experiments I used Instaclustr managed Open Distro for Elasticsearch (Apache 2 license), but Instaclustr now offers Managed OpenSearch.
Learn MorePaul BrebnerDecember 10, 2021