To run Apache Kafka as Docker image, the simplest way is to use the Strimzi project which provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.
In this tutorial we will learn how to start a Single Node with Single Broker Kafka Cluster and produce/consume messages with it.
In Kafka, there are three types of clusters:
• Single node–single broker
• Single node–multiple broker
• Multiple node–multiple broker
An example diagram of a single node– single broker cluster is shown in the following picture:
In this tutorial we will learn how to start a Single Node with Mutiple Broker Kafka Cluster and produce/consume messages with it.
In this tutorial we will learn how to set up a Maven project to run a Kafka Java Consumer and Producer.
this is the second tutorial about creating a Java Producer an Consumer with Apache Kafka. In the first tutorial we have learnt how to set up a Maven project to run a Kafka Java Consumer and Producer (Kafka Tutorial: Creating a Java Producer and Consumer ) Now we will code a more advanced use case, when custom Java types are used in messaging.
You can use the kafka-topics.sh –describe option to know which is the leader for a Kafka topic and the broker instances acting as replicas for the topic, along with the number of partitions of a Kafka Topic that has been created with.
Welcome to Apache Kafka Cheatsheet! This is the most complete Apache Kafka cheatsheet. Enjoy it!
Every message your producers send to a Kafka partition has an offset—a sequential index number that identifies each message. To keep track of which messages have already been processed, your consumer needs to commit the offsets of the messages that were processed.
Kafka topics can be consumed using a single-threaded Consumer or using a multi-threaded Consumer. In this tutorial we will learn the differences between them.
In this tutorial we will learn how to get started quickly with Apache Kafka on OpenShift. The same concepts apply if you want to run Apache Kafka on any Kubernates compliant environment
In order to kickstart Apache Kafka on OpenShift, we will install the Strimzi Operator. The project Strimzi (https://strimzi.io/) simplifies the process of running Apache Kafka in a Kubernetes cluster in various deployment configurations.
Let’s create a new OpenShift project named ‘kafka-demo’