Kubernetes is one of the emerging platforms that enables companies to run and manage containerized applications globally. Apache Kafka is a very popular choice for messaging and event streaming in modern Cloud Native applications. Kafka is traditionally well suited to run on statically defined clusters but running it on container orchestrated clusters like Kubernetes is becoming more common. While Kubernetes is a great choice for running stateless applications, running stateful applications such as Kafka on Kubernetes can have its own unique challenges.
This talk will review different approaches for running stateful applications like Kafka on Kubernetes. We will then review the popular approach of deploying Kafka on Kubernetes using operators. In the second half, we will run a demo on how to deploy a production-ready Kafka cluster in Kubernetes and close with how to deploy Prometheus in Kubernetes to monitor a cluster. By the end of the talk, you will have enough knowledge to deploy Kafka on Kubernetes.
Presenter- Zeke Dean, Senior Consultant, Instaclustr