From the course: Deploying and Running Apache Kafka on Kubernetes

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

High availability in Kubernetes

High availability in Kubernetes

- [Tutor] Apache Kafka is designed to be highly available. It's a distributed event log that uses replication to make sure that even if one broker goes down, your events are not lost. So far we have seen how to deploy Kafka on Kubernetes successfully, but how do you make sure that Kafka is working with Kubernetes and not against it? Well, Kubernetes runs each of the pods on a node where each node is a physical or virtual machine. In general, a Kubernetes cluster is made up of multiple nodes. Although some basic installs only have one node. Normally your application workloads such as Kafka are deployed onto nodes denoted as the worker nodes. In a production system, you can expect to have multiple worker nodes. This means that if you have a problem with one of your nodes, as long as Kubernetes has spread the pods out only a subset of your pods are affected. We can control how Kubernetes distributes pods using affinity and…

Contents