scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

A collection of learning resources for curious software engineers

Learn how to design systems at scale and prepare for system design interviews

Learn System Design concepts and prepare for interviews using free resources.

If you want to become good at AI engineering & system design, join this newsletter 👇

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Machine Learning Engineering Open Book

These are the best resources for System Design on the Internet

A curated list of Site Reliability and Production Engineering resources.

A distributed, fast open-source graph database featuring horizontal scalability and high availability

Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.

Preparation links and resources for system design questions

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Your platform team, as a service

Framework for Evolutionary Message-Driven Microservices on the JVM

rust stackful coroutine library

A Node.js library for building zero-configuration microservices.

🧭 Architecture-first system design: 26 bilingual tutorials, 25 architecture templates, and 6 end-to-end cases covering distributed systems, AI-native systems, RAG, coding Agents, and production trade-offs.

It's just fascinating. How is modern software designed? 🤔 Some design-level considerations for scalability, maintainability eventual consistency, availability & reliability. 👨‍💻 Interview Prep. 👨‍💻

The Art of Problem-Solving in Software Engineering: How to Make MySQL Better

Shadow is a discrete-event network simulator that directly executes real application code, enabling you to simulate distributed systems with thousands of network-connected processes in realistic and scalable private network experiments using your laptop, desktop, or server running Linux.

Real-time messaging library for Go. The simplest way to add feature-rich and scalable WebSocket support to your application. The core of Centrifugo server.

A system design tool that allows you to simulate data flow of distributed systems.

An extensible framework for linking databases and interactive views.

Dream 7B, a large diffusion language model

An AI-enhanced cloud-native layer-1 blockchain network. 

Resources related to distributed systems, system design, microservices, scalability and performance, etc

DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.

A scalable file analysis and data generation platform that allows users to easily orchestrate arbitrary docker/vm/shell tools at scale.