-
- Apache Kafka
- Technical
Scaling Apache Kafka® Connect Streaming Data Processing (Pipeline Series Part 5)
In Part 4 of this blog series, we started exploring Kafka Connector task scalability by configuring a new scalable load generator for our real-time streaming data pipeline, discovering relevant metrics, and configuring Prometheus and Grafana monitoring. We are now ready to increase the load and scale the number of Kafka Connector tasks and demonstrate the...
Learn MorePaul BrebnerJanuary 25, 2021 -
- Elasticsearch
- Technical
Getting to Know ELK Stack: Exploring the Power of Logstash
As a new member of the Product Team here at Instaclustr, I wanted to explore our offerings by connecting Logstash with our Managed Elasticsearch and Kibana. Having had no prior experience with the ELK Stack, and wanting to find out more about the power of Elasticsearch, I thought “How hard could it be?”
Learn MoreShane DucksburyJanuary 21, 2021 -
- Apache Kafka
- Technical
Monitoring Apache Kafka® Connect Pipeline Metrics with Prometheus (Pipeline Series Part 4)
In Part 3 of this blog series, we looked at Apache Camel Kafka Connector to see if it is more or less robust than the connectors we tried in Part 1 and Part 2. Now we start exploring Kafka Connect task scaling. In this blog we will: Change the data source so we can easily...
Learn MorePaul BrebnerJanuary 21, 2021 -
- Popular
- Elasticsearch
- Technical
Changes to Elasticsearch™ Licensing
Yesterday, Elastic announced they would moving their “Apache 2.0-licensed source code in Elasticsearch and Kibana to be dual licensed under Server Side Public License (SSPL) and the Elastic License” (read their full announcement here). This change means that components of Elasticsearch or Kibana in subsequent versions (7.11 and onwards) are no longer under an OSI-approved...
Learn MoreBen BromheadJanuary 15, 2021 -
- Team
Instaclustr Insights: Meet Paris Larkins
Instaclustr Insights provide meaningful insights into team members’ work lives. This time it is Paris Larkins – Graduate Software Engineer, Instaclustr. What does your role at Instaclustr entail? My role at Instaclustr entails managing, maintaining, enhancing, and implementing Instaclustr’s development security practices. This ranges from tracking and prioritizing discovered vulnerabilities, responding to security incidents, helping...
Learn MoreInstaclustrJanuary 04, 2021 -
- Elasticsearch
- Technical
What Is Elasticsearch™?
Elasticsearch is an open source scalable search and analytics engine. It takes the open source search engine Apache Lucene and enables it to scale across many machines in a cluster to handle large volumes of data at high speed. Much like the index at the back of a book, the core data structure of Lucene...
Learn MoreInstaclustrDecember 21, 2020 -
- Apache Kafka
- Technical
Getting to Know Apache Camel Kafka Connectors (Pipeline Series Part 3)
In Part 1 and Part 2 of this blog series we started a journey building a real-time pipeline to acquire, ingest, graph, and map public tidal data using Apache Kafka, Kafka Connect, Elasticsearch, and Kibana. In this blog, we resume that journey and take an Apache “Camel” (Kafka Connector) through the desert (or the Australian Outback) to see if it is more or less robust than the connectors we previously tried.
Learn MorePaul BrebnerDecember 17, 2020 -
- Apache Cassandra
- Technical
The Instaclustr LDAP Plugin for Apache Cassandra® 2.0, 3.0, and 4.0
LDAP (Lightweight Directory Access Protocol) is a common vendor-neutral and lightweight protocol for organizing authentication of network services. Integration with LDAP allows users to unify the company's security policies when one user or entity can log in and authenticate against a variety of services.
Learn MoreStefan MiklosovicDecember 09, 2020 -
- Team
Instaclustr Insights: Meet Tessa Jensen
Instaclustr Insights provide meaningful insights into team members’ work lives. This time it is Tessa Jensen – Technical Operations Manager, Instaclustr. What does your role at Instaclustr entail? I am one of the managers in our growing Technical Operations team. My responsibilities include the day to day management of our TechOps engineers, which includes, but...
Learn MoreInstaclustrNovember 23, 2020