awesome-kafka
github.com/nayekabhishek1/awesome-kafka ↗A curated list about Apache Kafka
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me books resources from awesome-kafka"
Installation instructions →What's inside
Books
- A fast-paced introduction to every aspect of working with Kafka you need to really reap its benefits.
- By the end of the book, you'll be ready to use Kafka Streams in your projects to reap the benefits of the insight your data holds quickly and easily.
- Designing Data-Intensive Applications
- Effective Kafka - a hands-on guide to building robust and scalable event-driven applications
a hands-on guide to building robust and scalable event-driven applications
- Event Streaming with Kafka Streams and ksqlDB
- Kafka: The Definitive Guide
UI / Cluster management
- AKHQ - Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more.
Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more.
- Kafdrop - Kafdrop is a web UI for viewing Kafka topics and browsing consumer groups. The tool displays information such as brokers, topics, partitions, consumers, and lets you view messages.
Kafdrop is a web UI for viewing Kafka topics and browsing consumer groups. The tool displays information such as brokers, topics, partitions, consumers, and lets you view messages.
- Kafka Eagle - A easy and high-performance monitoring system, as well as offsets or metadata and other kafka information.
A easy and high-performance monitoring system, as well as offsets or metadata and other kafka information.
- Klustr - Monitoring tool and graphic visualizer for Apache Kafka that helps you track key metrics about your cluster in real-time.
Monitoring tool and graphic visualizer for Apache Kafka that helps you track key metrics about your cluster in real-time.
- Kowl - Kowl is a modern Kafka Web UI for exploring Kafka messages, configurations and more with a focus on a good UI/UX. Written in Go & React.
Kowl is a modern Kafka Web UI for exploring Kafka messages, configurations and more with a focus on a good UI/UX. Written in Go & React.
- Remora - Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command.Integrations with Cloudwatch and Datadog.Authentication recently added.
Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command.Integrations with Cloudwatch and Datadog.Authentication recently added.
Articles
Talks / Presentations
- Apache Kafka and the Next 700 Stream Processing Systems by Jay Kreps
- Apache Kafka: Real-time Streaming and Data Pipelines with Apache Kafka by Joe Stein
- Building a Real-time Data Pipeline: Apache Kafka at LinkedIn
- Chris Curtin - AJUG - Apache Kafka
AJUG - Apache Kafka
- Developing Real-Time Data Pipelines with Apache Kafka
- Developing with the Go client for Apache Kafka
Schema
- Confluent Schema Registry - Confluent Schema Registry for Kafka.
Confluent Schema Registry for Kafka.
- Javro is an interface allowing you to write Avro schemas with ease, to validate it, and to preview it into JSON format with samples.
- Karapace - Karapace (Aiven) is the open source schema registry you can run on your own platforms. Alternative (compatible replacement) for Confluent Schema Registry, supports Avro and JSON Schema.
Karapace (Aiven) is the open source schema registry you can run on your own platforms. Alternative (compatible replacement) for Confluent Schema Registry, supports Avro and JSON Schema.
Clients
- Franz-go - franz-go is a feature complete client written in native Go.)
franz-go is a feature complete client written in native Go.)
- KafkaFlow - A .NET framework to create Kafka based applications, simple to use and extend.
A .NET framework to create Kafka based applications, simple to use and extend.
- kafkajs - A modern Apache Kafka client for node.js
A modern Apache Kafka client for node.js
- Kafka Rust - Rust client for Apache Kafka.
Rust client for Apache Kafka.
- librdkafka - The Apache Kafka C/C++ library.
The Apache Kafka C/C++ library.
Configurations
- Julie - An operational manager for Apache Kafka (Automation, GitOps, SelfService)
An operational manager for Apache Kafka (Automation, GitOps, SelfService)
- kafka-gitops - Manage Apache Kafka topics and generate ACLs through a desired state file.
Manage Apache Kafka topics and generate ACLs through a desired state file.
- Kafka Specs - Tool to ease and automate Apache Kafka cluster configuration management.
Tool to ease and automate Apache Kafka cluster configuration management.
- kattlo - Kattlo gives a way to manage topics, ACLs, users, schemas, ksqlDB, employing a evolutionary configuration. Easy to understand, easy to write and easy to apply.
Kattlo gives a way to manage topics, ACLs, users, schemas, ksqlDB, employing a evolutionary configuration. Easy to understand, easy to write and easy to apply.
CLI / Tools
- Kafkacat - Generic command line non-JVM Apache Kafka producer and consumer.
Generic command line non-JVM Apache Kafka producer and consumer.
- Kafkacli - CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry).
CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry).
- Kafka Shell - ⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.
⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.
Showing a sample of 71 resources. View the full list on GitHub →