Skip to content

Latest commit

 

History

History
60 lines (37 loc) · 2.29 KB

File metadata and controls

60 lines (37 loc) · 2.29 KB

Kafka

Key Points

TODO: port Kafka notes here

  • A Kafka topic is divided into partitions
    • each partition can then be split across different brokers (servers) for horizontal scaling
  • Messages inside a partition are sequentially ordered
  • Partitions enable parallelism for a topic
  • Consumer Group - multiple clients that subscribe using the same consumer group will split reading the messages of that topic between them
    • Messages from a partition go to only one client in a given consumer group
    • More partitions than consumers will result in some consumers reading messages from multiple partitions

Nagios-Plugin-Kafka with Kerberos support

HariSekhon/Nagios-Plugin-Kafka

API monitoring plugin does full pub-sub unique message with Kerberos support. Written in Scala.

Readme Card

Nagios Plugins for Kafka API written in Python & Perl

HariSekhon/Nagios-Plugins

Readme Card

Kafka on Kubernetes

https://strimzi.io/

Diagrams

From the HariSekhon/Diagrams-as-Code repo:

Kafka Pub/Sub

Kafka Pub/Sub

Kafka Flink Elasticsearch

Kafka Flink Elasticsearch

Kafka 101

Kafka 101