awesome-streaming

Reliable UDP unicast, multicast, and IPC message transport.

Unified platform for big data stream and batch processing.

Distributed engine for stateful computation over bounded and unbounded data streams.

Retired distributed, fault-tolerant stream processing engine originally developed at Twitter.

Distributed pub-sub messaging and event streaming platform.

Cloud-native messaging and streaming platform for event-driven applications.

Reactive Streams implementation built on Akka actors.

Unified programming model and language-specific SDKs for batch and streaming data processing.

Retired programming model and runtime for streaming analytics on gateways and edge devices.

Stream processing library included with Apache Kafka.

Open-source toolkit for concurrent, distributed, resilient applications, forked from Akka 2.6.

Retired distributed streaming machine learning framework.

Fully managed service for ingesting and processing real-time data streams on AWS.

Fully managed service for serverless real-time analytics in the cloud and at the edge.

Historical distributed stream processing framework built on Apache Mesos.

Fully managed service for running Apache Beam batch and streaming pipelines.

Discontinued proprietary platform for distributed stream processing and real-time analytics.

GStreamer-based toolkit with open-source components and proprietary NVIDIA libraries for real-time AI streaming analytics and multi-sensor processing.

Distributed service for collecting, aggregating, and moving large amounts of log-like data.

Distributed system for reliable nearline data streaming between heterogeneous systems at scale.

End-to-end data pipeline tool combining ingestion, SQL and Python transformations, and data quality checks.

LinkedIn's retired, previous-generation Kafka-to-HDFS pipeline.

Incremental data transformation engine for continuously updated AI and agent workloads.

LinkedIn source-agnostic distributed change data capture system.

Single-binary feature server for querying fresh per-entity counters and aggregates without a message broker.

Data generation platform for producing synthetic event streams.

Code-first distributed workflow engine for microservice orchestration and business process automation.

Visual tool for defining and running real-time decision algorithms.

Platform for real-time streaming search.

Airbnb serverless framework for real-time security log analysis and alerting.

Automated message queue orchestration for scaled-up benchmarking.

Apache Storm performance and stress test.

Benchmarks for low-latency stream processing systems including Storm, Spark, and Flink.