Managed Kafka Connect

Instaclustr provides a fully managed service for Kafka Connect—SOC 2 certified and hosted on AWS, Azure, or GCP.

We customize and optimize the configuration of your Kafka Connect deployment so you can focus on the unique features of your applications rather than the data layer. Data available for stream processing will flow seamlessly via Kafka Connect from data sources and sinks into your open source Apache Kafka instance.

Overview of Managed Kafka Connect

Organizations operating their data architecture in a distributed mode often require robust stream processing through solutions like Apache Kafka. If you use Kafka, you’ll need a fault-tolerant way to bring in data for stream processing in real time so that data can then flow to the correct Kafka topic.

As a component of the open source Apache Kafka project, Kafka Connect serves as a robust framework for hosting connectors and managing connector configuration.

Instaclustr allows you to reliably and robustly deploy Kafka Connect. Your Managed Kafka Connect instance will integrate with your Managed Apache Kafka instance with us or your Kafka deployment elsewhere, in a clustered configuration with high fault tolerance and with the ability to prevent node failure. The ecosystem of pre-built connectors available with Kafka Connect makes it easy for you to get data from the relevant sink connector and source connector in the form that you require.

Get Kafka Connect fully managed and hosted on all major clouds, in our cloud account or yours.

Our comprehensive management includes deployment, configuration, ongoing maintenance, upgrades, monitoring, and support. All you need to do is use Kafka Connect.

Receive prompt and definitive technical support and advice from our technical operations and support staff in the USA and Australia who are available to you at all times.

We have developed a number of open source connectors for Kafka Connect and have experts on staff ready to attend to your needs.

We provide a 99.99% availability SLA for production clusters of Kafka Connect.

Instaclustr’s solutions and processes are independently audited and certified against the Service Organisation Control – Type 2 (SOC 2) standards.

These regular audits assure the security, confidentiality, integrity, privacy, and availability of your data.

For reliability Kafka Connect is best run in distributed mode as a cluster. We deploy and manage a robust cluster with bundled connectors so you can quickly take your event-driven architecture to the next level.

Bundled with our Kafka Connect are connectors for Cassandra, S3, and Elasticsearch. We built and contributed to these open source connectors to benefit the whole community of Kafka users.

As well as the bundled connectors you can deploy your own custom developed connectors, connectors from the open source ecosystem, or connectors that you have licensed.

We can also build the custom connectors you require.

We collect and monitor hundreds of different metrics from every node we manage, so we can proactively oversee your cluster and you get easy access to the Kafka Connect metrics needed to effectively maintain your application.

The Instaclustr Managed Platform includes a Terraform Provider for our managed services. It provides a flexible set of resources for provisioning and managing Instaclustr based clusters via the use of Terraform.

If you’d like to know more you can read about the Terraform Provider on our blog, or you can dive right into the examples on GitHub.

Instaclustr offers managed mirroring via MirrorMaker 2 to mirror data between geographical regions, create active/active topologies, or create an additional copy of your data in another region with a failover cluster.

Our Technical Operations team takes full, end to end, responsibility for the availability of the mirroring service. See our support documentation for how to set up mirroring.

At Instaclustr you are never locked-in because everything we do is open source. Our Managed Kafka Connect is completely licensed under the Apache 2.0 license.

Read more about our Open Source Commitment.

We support both Run In Your Own Account (RIYOA) and Run In Instaclustr’s Account (RIIA) for our Managed Kafka Connect.

On our managed platform, Kafka Connect can be provisioned on AWS, GCP, and Azure and is bundled up with a host of additional features ready for enterprise deployment.

Benefits of Managed kafka connect

Instaclustr’s Managed Kafka Connect service empowers you to more easily import data from a source connector to the appropriate Kafka topics, and unite outgoing data from Kafka topics to the correct sink connector. Kafka Connect has a low barrier to entry, especially when you take advantage of a managed service for both Apache Kafka and Kafka Connect.

Take advantage of the full power of open source Apache Kafka and Kafka Connect through our managed service so you can spend less time worrying about your data layer and more time building the unique features of your applications.

Kafka Connect enables a fast, event-driven architecture to robustly allow data flow between multiple services.

Deploying Kafka Connect as a distributed cluster means it can scale with your workloads without impacting your Kafka performance.

Use connectors to make sure data is reaching your analytics and search stack at the same time it’s pushed to other parts of your infrastructure.

Easy to use connectors and a clean REST API make Kafka Connect a fast way to build robust event-driven architectures

You can use vendor and community created open source connectors with Kafka Connect.

We bundle an open source Elasticsearch connector, Cassandra connector, and an S3 storage connector with every deployment.

Robust connectors can catch exceptions gracefully and can even store them in secondary topics for inspection so you never lose or skip unaware over data.

Kafka Connect is open source under the Apache 2.0 License and part of the Apache Kafka project which is governed by the Apache Software Foundation.

This provides customers with a clear roadmap and a community of no lock-in vendors, experts, and training providers for an enterprise-class software project.