data-processing
Tracked open-source repos tagged data-processing, sorted by stars.
Related topics
Topics that frequently appear alongside data-processing on the same repo.
Recent risers
Repos created in the last 90 days, tagged data-processing.
- #1
MARVIS-Agent: all-purpose credit risk agent for model development, validation, data processing, feature engineering, and strategy workflows.
★ 518
- #1
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
★ 62,365-36Star change over the last 7 days - #2★ 11,430+48Star change over the last 7 days
- #3
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
★ 10,767+5Star change over the last 7 days - #4
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
★ 10,005+4Star change over the last 7 days - #5
Unified querying, transformation, and modification of JSON, TOML, YAML, XML, INI, HCL, KDL and CSV.
★ 8,028+7Star change over the last 7 days - #6★ 7,825+164Star change over the last 7 days
- #7
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
★ 7,371+416Star change over the last 7 days - #8
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
★ 6,949+28Star change over the last 7 days - #9
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
★ 5,738+4Star change over the last 7 days - #10★ 5,002+5Star change over the last 7 days
- #11★ 4,443+5Star change over the last 7 days
- #12★ 2,827+2Star change over the last 7 days
- #13
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
★ 2,811+3Star change over the last 7 days - #14★ 2,677+1Star change over the last 7 days
- #15
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
★ 2,389+0Star change over the last 7 days - #16★ 2,048+1Star change over the last 7 days
- #17★ 1,740+12Star change over the last 7 days
- #18★ 1,538+2Star change over the last 7 days
- #19★ 1,518+0Star change over the last 7 days
- #20
Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017
★ 1,428+1Star change over the last 7 days - #21
Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
★ 1,224+0Star change over the last 7 days - #22
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
★ 843+0Star change over the last 7 days - #23
All-in-one text de-duplication
★ 765+0Star change over the last 7 days - #24
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
★ 722+0Star change over the last 7 days - #25★ 705+1Star change over the last 7 days
- #26
A list about Apache Kafka
★ 591+0Star change over the last 7 days - #27★ 581+1Star change over the last 7 days
- #28
A tool that uses advanced Monte Carlo simulations and Turbit parallel processing to create possible Bitcoin prediction scenarios.
★ 526+0Star change over the last 7 days - #29
MARVIS-Agent: all-purpose credit risk agent for model development, validation, data processing, feature engineering, and strategy workflows.
★ 518+2Star change over the last 7 days - #30★ 505+1Star change over the last 7 days
