-
- Dev Rel
- Technical
How to Use MongoDB® Clients and FerretDB® With Instaclustr for PostgreSQL®
1. What is FerretDB®? When I first heard about FerretDB, my initial thought was what on earth is a ferret?! From my childhood I vaguely recalled that ferrets, weasels, and stoats were the “baddies” from “The Wind in the Willows”, but that was about it (see endnote [1]). Departing the animal kingdom (for the time...
Learn MorePaul BrebnerAugust 30, 2023 -
- Dev Rel
- Technical
Machine Learning Over Streaming Kafka® Data—Part 3: Introduction to Batch Training and TensorFlow Results
In Part 2 of this series, we introduced the steps needed for batch training in TensorFlow with some example Python code. In this next part we’ll have a look at some performance metrics and explore the results. 1. Performance Metrics Sometimes accuracy is all that matters! (Source: Shutterstock) It took me a reasonable amount of...
Learn MorePaul BrebnerAugust 23, 2023 -
- Dev Rel
An Introduction to Apache Kafka® Metrics for Developers
The Flying Scotsman was the first steam locomotive to break the 100 miles per hour speed record (161 km/h way back in 1934) (Source: Shutterstock) The Flying Scotsman was a 1900’s (in service 1923-1963) steam locomotive built for speed and scale—the steam era equivalent of Big Data cloud technologies today. It was big (100 tons, 21m long,...
Learn MorePaul BrebnerAugust 02, 2023 -
- Dev Rel
- Technical
Machine Learning Over Streaming Kafka® Data—Part 2: Introduction to Batch Training and TensorFlow
As I mentioned in Part 1 of this series, we are looking at Machine Learning (ML) over streaming Apache Kafka® data. But rather than just jumping in—and immediately going over a fast-flowing waterfall (in a barrel, which people have actually attempted!)—I first need to get a good understanding of TensorFlow with some “still” (static and unchanging) data and batch learning to start with. This will be easier and repeatable before we encounter Kafka and streaming and changing data.
Learn MorePaul BrebnerJuly 26, 2023 -
- Dev Rel
- Technical
Machine Learning Over Streaming Apache Kafka® Data Part 1: Introduction
1. Introduction (Source: Shutterstock) Viewing online cat media is linked with procrastination (Emotion regulation, procrastination, and watching cat videos online: Who watches Internet cats, why, and to what effect?)—this blog almost ended here! Recently I came across 2 use cases of real-time Kafka Machine Learning (ML). Have you ever wondered why TikTok is so...
Learn MorePaul BrebnerJuly 12, 2023 -
- Dev Rel
- Popular
Improving Apache Kafka® Performance and Scalability With the Parallel Consumer: Part 2
In the second part of Improving Apache Kafka® Performance and Scalability With the Parallel Consumer, we continue our investigations with, a trace of a “slow consumer” example, how to achieve 1 million TPS in theory, some experimental results, what else do we know about the Kafka Parallel Consumer, and finally, if you should use it in production.
Learn MorePaul BrebnerMay 04, 2023 -
- Dev Rel
- Popular
Improving Apache Kafka® Performance and Scalability With the Parallel Consumer: Part 1
Apache Kafka® is a high-throughput, low-latency distributed streaming platform. It enables messages to be sent from multiple distributed producers via the distributed Kafka cluster and topics, to multiple distributed consumers. Here’s a photo I took in Berlin of a very old machine that has a similar architecture; I’ll reveal what it does later.
Learn MorePaul BrebnerApril 20, 2023 -
- Dev Rel
- Technical
Exploring Karapace—the Open Source Schema Registry for Apache Kafka®: Part 6—Forward, Transitive, and Full Schema Compatibility
This is part 6 of Exploring Karapace, how does Apache Kafka's schema registry allow backward, forwards and transitive compatibility?
Learn MorePaul BrebnerMarch 23, 2023 -
- Dev Rel
- Technical
Exploring Karapace—the Open Source Schema Registry for Apache Kafka®: Part 5—Schema Evolution and Backward Compatibility
So what happens when the unchangeable forms (schemas) meet the inevitability of change? Let’s dip our toes in the water and find out.
Learn MorePaul BrebnerMarch 10, 2023