Kafka (Apache Stream Processing Platform)
Introduction
Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written in Java and Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. Kafka can connect to external systems (for data import/export) via Kafka Connect, and provides the Kafka Streams libraries for stream processing applications.
Run in Container
It's possible to run Kafka in a Docker container, or any container platform. Because Kafka depends on multiple separate components to run simultaneously, it's preferable to deploy Kafka using some kind of container compose system.
There's an example repository to deploy the system.
References
Web Links
- Wikipedia Contributors. "Apache Kafka". Wikipedia, the free encyclopedia. 2023
- johntango. "JohnKafka". Github.com. 2023