Kafka (Apache Stream Processing Platform)

Introduction

Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written in Java and Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. Kafka can connect to external systems (for data import/export) via Kafka Connect, and provides the Kafka Streams libraries for stream processing applications.

--(Wikipedia.org 2023)

Run in Container

It's possible to run Kafka in a Docker container, or any container platform. Because Kafka depends on multiple separate components to run simultaneously, it's preferable to deploy Kafka using some kind of container compose system.

There's an example repository to deploy the system.

References

Web Links

Note Links