Blogs

Filter

Technical Technical — Elasticsearch Technical — Kafka

Building a Real-Time Tide Data Processing Pipeline: Using Apache Kafka, Kafka Connect, Elasticsearch, and Kibana—Part 2

Wednesday 11th November 2020 by Paul Brebner

In Part 1 of this blog we built a simple real-time data processing pipeline to take streaming tidal data from NOAA stations using Kafka connectors, and graph them in Elasticsearch and Kibana. We also tried viewing the data on a Kibana map but ran into a problem! In Part 2 we add the missing geo_points […]

Technical Technical — Elasticsearch Technical — Kafka

Building a Real-Time Tide Data Processing Pipeline: Using Apache Kafka, Kafka Connect, Elasticsearch, and Kibana—Part 1

Thursday 5th November 2020 by Paul Brebner

ApacheCon @Home is over for 2020 and was a resounding success, with close to 6,000 attendees from every continent. As a Platinum Sponsor, Instaclustr ran an ApacheCon Booth and this blog was originally presented on 30 September, 2020 as a booth talk. I was one of the 1% attending from Australasia: This, unfortunately, meant I […]

Feature Releases Technical — Kafka

General Availability of Apache Kafka and Kafka Connect 2.5.1

Thursday 22nd October 2020 by Paul Aubrey

Instaclustr is pleased to announce the release of Apache Kafka version 2.5.1 on the Instaclustr Managed Platform. The new version is also available paired with version 2.5.1 of Kafka Connect. Apache Kafka is the leading distributed event streaming platform and is open source under the Apache 2.0 License. Instaclustr provides our customers managed and supported […]
kafka connect

Technical Technical — Kafka

Your Complete Guide to Kafka Streams

Wednesday 14th October 2020 by Michael Carter

Kafka Streams is a client library providing organizations with a particularly efficient framework for processing streaming data. It offers a streamlined method for creating applications and microservices that must process data in real-time to be effective. Using the Streams API within Apache Kafka, the solution fundamentally transforms input Kafka topics into output Kafka topics. The […]
Kafka Streams

Feature Releases Technical — Kafka

Dedicated ZooKeeper for Apache Kafka

Monday 12th October 2020 by Paul Aubrey

Instaclustr is pleased to announce the release of dedicated ZooKeeper nodes as an additional optional feature of our managed Apache Kafka offering. ZooKeeper is used for the management and coordination of nodes in Kafka. Dedicated ZooKeeper nodes provide customer benefits in situations that require high performance and reliability: Improvements to reliability in failure scenarios (primarily […]
Kafka ZooKeeper