Getting started with Apache Kafka

In this tutorial we will learn how to start a Single Node with Single Broker Kafka Cluster and produce/consume messages with it.

In Kafka, there are three types of clusters:

• Single node–single broker

• Single node–multiple broker

• Multiple node–multiple broker

An example diagram of a single node– single broker cluster is shown in the following picture:

Read more

Kafka Tutorial: Creating a Java Producer and Consumer using Serializers and Deserializers

this is the second tutorial about creating a Java Producer an Consumer with Apache Kafka. In the first tutorial we have learnt how to set up a Maven project to run a Kafka Java Consumer and Producer (Kafka Tutorial: Creating a Java Producer and ConsumerNow we will code a more advanced use case, when custom Java types are used in messaging.

Read more

How Kafka commits messages

Every message your producers send to a Kafka partition has an offset—a sequential index number that identifies each message. To keep track of which messages have already been processed, your consumer needs to commit the offsets of the messages that were processed.

Read more

Apache Kafka on OpenShift quickstart guide

In this tutorial we will learn how to get started quickly with Apache Kafka on OpenShift. The same concepts apply if you want to run Apache Kafka on any Kubernates compliant environment

In order to kickstart Apache Kafka on OpenShift, we will install the Strimzi Operator. The project Strimzi (https://strimzi.io/) simplifies the process of running Apache Kafka in a Kubernetes cluster in various deployment configurations.

Let’s create a new OpenShift project named ‘kafka-demo’

Read more

Accessing Apache Kafka on OpenShift using its REST API

In this tutorial we will learn how access an Apache Kafka cluster running on OpenShift / Kubernetes using the Kafka Bridge.

The Apache Kafka Bridge includes a RESTful interface that let HTTP-based clients to interact with a Kafka cluster. This can simplify accessing the Kafka cluster which might be running on a Cloud Environment such as Kubernates or OpenShift.

In order to complete this tutorial, install the Strimzi Operator, the Kafka cluster and a Topic as discussed in this tutorial: Apache Kafka on OpenShift quickstart guide

Read more