awesome-system-design

Graduate level course on distributed systems from MIT (2020).

[Free 👍] - Awesome book that talks about designing sytem architecture with microservices in depth, includes most relevant topics in this regard.

IBM Article about CAP Theorem, Microservices and NoSQL DBs.

Undergraduate course on distributed systems from UCSC (2020).

[Paid 💵] - Goes in depth to explain various resources we use when working with distributed systems, as well as how it came to be and what problems it aims to solve.

[Paid 💵] - Book that talks about disitributed systems as well as lightly demonstrating some code of what it looks like.

Key-Value and Document database, highly performant, scalable and secure.

Fast, reliable and fully managed graph database service.

[3.3k ⭐] - In memory caching with ACID properties.

[10k ⭐] - Multi-model (many data types in a single database), ACID key-value store. Easily scalable and fault tolerant.

[10k ⭐] - Flexible database for documents, key-value, graphs. Uses its own query language, AQL.

Facebook-born project very fast, easily scalable, with option to include consistency with each operation.

Popular choice for amazon customers, supports lambda functions, highly scalable.

Popular choice for Microsoft's Azure customers. Supports internal and external traffics, ipv6, monitorining and the standard load balancing set of features.

One of the top choices for load balancing when it comes to in-house servers. Top security measures built in, comprehensive reports and monitoring outbound traffic for data loss prevention.

Scalable load balancing by Cloudflare, feature fast failover and a dashboard.

If you're a digitalocean customer, this is a good option, very cheap, regional availability, scalable, easy to deploy among your other droplets.

Robust hardware load balancer option, supporting multiple protocols (IP, TCP, FTP, UDP, HTTP).

Durable, scalable, real-tme service. Collects gigabytes of data per second from hundreds of thousands of sources, including database event streams, website clickstreams, financial transactions, etc.

Based on the concept of streams and transofrmations. Uses maven, handles batch tasks as data streams with finite boundaries. Low latency, high throughput.

Build stateful applications that process data in real time from multiple sources, including Kafka. Easy and inexpensive multi-subscriber model, can eliminate backpressure and has reliable persistency with low latency.

Real-time analytics service that is designed for mission-critical workloads.

Open source message broker from Amazon.

It's a multi-protocol, java based messaging server.

Created by yahoo, also highly scalable, low latency, geo-replication and multi-tenacy.

A fully managed enterprise integration message broker.

Very fast and highly scalable messaging broker. (not open source)

Written in Scala and speaks the memcached protocol. It works much like Kafka.

Dashboard that integrates most of hadoop related technologies for easy management and executions.

Widely popular message broker with low latency for data streaming.

*Retired project, it's a YARN-native platform that unifies stream and batch processing.

Distributed, highly available and efficient in collecting, aggregating and moving large amounts of log data.

[3.6k ⭐] - Modeled after Google's Bigtable and written in Java. Developed as a part of Apache Hadoop project.

Query hadoop stored data in SQL.

A rich framework for building web apps and APIs using the Model-View-Controller design pattern in C# or F#. Number 6 on

[18.4k ⭐] - Written in Python, Django Rest is a powerful and flexible REST API. The efficiency and time to market resembles Rails.

[49.6k ⭐] - Fast node.js rest api that can perform well under many scenarios.

[22.7k ⭐] - A lightweight Python Microframework inspired in Flask but more modern, using Python async.

[15.4k ⭐] - A Node.js web framework highly focused on providing the best developer experience with the least overhead and a powerful plugin architecture.

[51.6k ⭐] - A lightweight Python Microframework for fast prototyping and production.

Unified, distributed storage system.

Scale-out NAS file system.

Hadoop File System is a a widely popular choice among its big data competitors, providing high throughput access.

File system for computer clusters.

POSIX-compliant distributed file system.

Fault tolerant file system.