parquet
Tracked open-source repos tagged parquet, sorted by stars.
Related topics
Topics that frequently appear alongside parquet on the same repo.
Recent risers
Repos created in the last 90 days, tagged parquet.
- #1★ 17,295+6Star change over the last 7 days
- #2
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
★ 17,078+6Star change over the last 7 days - #3
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
★ 5,736+4Star change over the last 7 days - #4★ 3,600+4Star change over the last 7 days
- #5
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
★ 3,429+1Star change over the last 7 days - #6
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
★ 3,341+4Star change over the last 7 days - #7
Apache Parquet Java
★ 3,078+0Star change over the last 7 days - #8★ 2,862+11Star change over the last 7 days
- #9
Apache Parquet Format
★ 2,563+7Star change over the last 7 days - #10
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.
★ 2,450+2Star change over the last 7 days - #11★ 2,022+0Star change over the last 7 days
- #12
Real-time analytics on Postgres tables
★ 2,003+0Star change over the last 7 days - #13
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
★ 1,892+0Star change over the last 7 days - #14
Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
★ 1,853+1Star change over the last 7 days - #15
One SQL interface for 60+ tools (e.g., GitHub, Notion, Airtable). Plug into any LLM through MCP.
★ 1,772+2Star change over the last 7 days - #16★ 1,618+3Star change over the last 7 days
- #17
cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes
★ 1,582+1Star change over the last 7 days - #18★ 1,531+0Star change over the last 7 days
- #19
OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.
★ 1,435+2Star change over the last 7 days - #20
Quilt is a Scientific Data Management Platform on AWS that helps teams and AI find, trust, and reuse data through deeply versioned, context-rich data packages.
★ 1,370+0Star change over the last 7 days - #21
Simple Windows desktop application for viewing & querying Apache Parquet files
★ 1,231+2Star change over the last 7 days - #22
ClickBench: a Benchmark For Analytical Databases
★ 1,100+8Star change over the last 7 days - #23
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
★ 1,059+2Star change over the last 7 days - #24★ 963+1Star change over the last 7 days
- #25★ 950+8Star change over the last 7 days
- #26
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
★ 860+0Star change over the last 7 days - #27
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
★ 824+0Star change over the last 7 days - #28
High-performance Go package to read and write Parquet files
★ 769+2Star change over the last 7 days - #29
Graph Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, NetworkX, RAPIDS, RDFlib, pySHACL, PyVis, morph-kgc, pslpython, pyarrow, etc.
★ 691+2Star change over the last 7 days - #30
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
★ 685+0Star change over the last 7 days