distributed-computing

Making large AI models cheaper, faster and more accessible

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Automate code & data workflows with interactive Elixir notebooks

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

Accelerated deep learning R&D

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

A list of papers about distributed consensus.

Open-source software for volunteer computing and grid computing.

Microsoft Graph Engine

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Master Federated Learning in 2 Hours—Run It on Your PC!

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

a Productive Parallel Programming Language

MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

Ultrafast serverless GPU inference, sandboxes, and background jobs

A distributed task scheduler for Dask

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

:books: 深入浅出分布式基础架构，Linux 与操作系统篇 | 分布式系统篇 | 分布式计算篇 | 数据库篇 | 网络篇 | 虚拟化与编排篇 | 大数据与云计算篇

A crowdsourced distributed cluster for AI art and text generation

Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data

The current, performant & industrial strength version of Holochain on Rust.

A Golang based high performance, scalable and distributed workflow framework

SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics