datalake

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

Upserts, Deletes And Incremental Processing on Big Data.

lakeFS - Data version control for your data lake | Git for data

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

The LeoFS Storage System

Scalable master data management, identity resolution, entity resolution, and deduplication using ML

ClickBench: a Benchmark For Analytical Databases

A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.

Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"

A curated list of open source tools used in analytics platforms and data engineering ecosystem

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)

汇总Apache Hudi相关资料