awesome-olap

Columnar format for in-memory Apache Arrow processing.

Row-oriented serialization for data streaming purpose.

Hadoop distributed file system, the original large-scale storage layer for the big data ecosystem.

Atomicity, Consistency, Isolation, Durability — the four guarantees that define correct database transaction behavior.

Family of algorithms that trade exact accuracy for speed when finding the closest vectors in high-dimensional space.

Blog from the autonomous testing platform covering distributed systems correctness, fault injection, and database reliability.

Single Instruction Multiple Data — CPU instruction-level parallelism that processes multiple columnar values in a single clock cycle.

Talk on how Arrow's columnar memory layout enables SIMD-accelerated batch processing in query engines.

Carbone et al. (2017) on Flink's state backend, incremental checkpointing, and exactly-once fault tolerance.

Leading international forum for database researchers and practitioners.

The Apache Software Foundation's official conference (formerly ApacheCon).

The Data Streaming Event focused on Apache Kafka and real-time data streaming.

The world's largest data, analytics, and AI conference.

Technical conference on data engineering, infrastructure, and analytics.

The world's largest gathering of dbt users and analytics engineering practitioners.

Open-source ELT platform with 300+ pre-built connectors for syncing data to your warehouse.

Reverse ETL platform for syncing data warehouse data to CRMs, ad tools, and other SaaS.

SQL-based transformation framework that runs inside your warehouse; the standard tool for the T in ELT.

Open-source CDC (Change Data Capture) platform that streams row-level changes from databases like PostgreSQL, MySQL, and MongoDB into Kafka and downstream systems.

Reactive stream processing library for JVM, built on the actor model.

Low-level in-memory columnar data format with zero-copy access across languages via gRPC/IPC interfaces.

High-level SQL and DataFrame query engine built on Apache Arrow, written in Rust.

Unified SDK for cross-language stream and batch processing. Available in Go, Python, Java, Scala and TypeScript.

Stateful stream processing with exactly-once semantics, supporting event time and out-of-order data.

Lightweight stream processing library embedded in the Kafka client, no separate cluster required.

Co-founder and CTO of ClickHouse

PMC member for Apache Arrow, DataFusion, and Parquet

PMC member of Apache Arrow and DataFusion. Author of "How Query Engines Work"

PMC member on Apache Avro, Airflow, Druid, Iceberg, and Parquet

Co-founder and CTO of Imply, co-creator of Apache Druid

Co-creator of DuckDB, CEO of DuckDB Labs

Platform for programmatically authoring, scheduling, and monitoring data pipelines as DAGs.

Data orchestration platform with an asset-centric approach, lineage tracking, and built-in observability.

MPP analytical database with MySQL-compatible interface, optimized for high-concurrency queries and real-time data ingestion.

Real-time OLAP database optimized for streaming ingestion, time-series analytics, and sub-second queries on high-cardinality data.

Distributed, wide-column NoSQL database on top of HDFS, modeled after Google Bigtable.

Distributed OLAP datastore for user-facing real-time analytics, designed for low-latency queries at high concurrency.

Fully managed petabyte-scale data warehouse on AWS.

Unified analytics service combining data integration, warehousing, and big data on Azure.