spark

LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

REST job server for Apache Spark

LLM speculative inference server for heterogeneous hardware & consumer GPUs

:herb: 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、k3s、k3d、k8s、mybatis加解密插件、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等:pushpin:

深圳地铁大数据客流分析系统🚇🚄🌟

✨Spark is a web-based, cross-platform and full-featured Remote Administration Tool (RAT) written in Go that allows you control all your devices anywhere. Spark是一个Go编写的，网页UI、跨平台以及多功能的远程控制和监控工具，你可以随时随地监控和控制所有设备。

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

YTsaurus is a scalable and fault-tolerant open-source big data platform.

Tools for handling firmwares of DJI products, with focus on quadcopters.

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Compile-time Language Integrated Queries for Scala

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Official code repository for GATK versions 4 and up

Apache Spark to Apache Cassandra connector

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

Apache Auron(Incubating) is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.

后端 （Java Golang）全栈知识架构体系总结

ApacheCN 开源组织：公告、介绍、成员、活动、交流方式

More than 2000+ Data engineer interview questions.

Elassandra = Elasticsearch + Apache Cassandra

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

A Scala kernel for Jupyter

The Internals of Apache Spark

MLeap: Deploy ML Pipelines to Production

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Nessie: Transactional Catalog for Data Lakes with Git-like semantics