Technical Technical — Kafka Thursday 9th July 2020

Instaclustr Managed Kafka Connect Enhancements: Pre-Built Cassandra Connector and GCP Support

By Michael Carter

Instaclustr is pleased to announce a couple of key enhancements to our Managed Kafka Connect service. Following the recent release of the Kafka Connect service on the Instaclustr Managed Platform, we have been working on incremental enhancements, adding features for rapid integration of Kafka with other data systems, and supporting new platforms. Two enhancements among them that some of our customers will be excited about are:

  • Managed Kafka Connect service on GCP cloud
  • Availability of a pre-built and fully supported Cassandra Connector

Instaclustr Managed Kafka Connect Service Availability on GCP Cloud

Is your application and data infrastructure deployed on GCP? If yes, we are happy to share that you can now use our Managed Kafka Connect service to accelerate your enterprise integration strategy by rapidly deploying Kafka Connect clusters to build data pipelines integrating Kafka with the rest of your GCP based data ecosystem. A key advantage of using Instaclustr managed services is that you can focus your effort and time on building your core business applications, while we manage the operations of your data layer technologies with industry leading SLAs on reliability, scalability, and performance.

Our Managed Kafka Connect service on GCP comes with the same platform capabilities that are offered for the rest of our offerings such as Apache Cassandra and Apache Kafka. All Kafka Connect specific features available on AWS and Azure are available on GCP. For the full list of our Managed Kafka Connect service, read the General Availability announcement blog.

Availability of a Pre-Built Cassandra Connector

We have now added a Cassandra Connector, open sourced by lenses.io with an Apache 2.0 license, as a pre-built and fully supported Connector on Kafka Connect clusters created on the Instaclustr Managed Platform. It enables rapid, no-code integration of Apache Kafka and Apache Cassandra to build data pipelines that seamlessly move data into Apache Cassandra.

This integration is an important part of any use case where Kafka plays the role of a streaming buffer sitting in front of a Cassandra database. Particularly, this integration finds its use where there are streaming applications, stream processing platforms, or analytics engines writing data to a Cassandra database through a Kafka cluster.

This Cassandra Connector can also be configured to use Cassandra as a source, but a degree of caution should be adopted to match how the Connector reads with your Cassandra data model and the performance of your cluster.

This is the second pre-built Connector offered on the Instaclustr Platform following the AWS S3 connector, developed and open sourced by Instaclustr with an Apache 2.0 license, that was released a few weeks ago. Similar to AWS S3 Connector, it requires no coding or custom scripts and most of the deployment procedure is automated. You are only required to configure a handful of parameters as per your requirements and the deployment environment. More details of our pre-built Cassandra Connector can be found on our Cassandra Connector support page.

If you want to know more about the Instaclustr Managed Kafka Connect service or to understand how Kafka Connect fits into your integration strategy, or how to deploy your customized Connector on our platform, please contact our Support team.