data-quality

Learn how to develop, deploy and iterate on production-grade ML applications.

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

Always know what to expect from your data.

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Refine high-quality datasets and visual AI models

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

The Open Source Feature Store for AI/ML

lakeFS - Data version control for your data lake | Git for data

Learn how to design, develop, deploy and iterate on production-grade ML applications.

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

Data Contracts engine for the modern data stack. https://www.soda.io

The Virtual Feature Store. Turn your existing data infrastructure into a feature store.

Feathr – A scalable, unified data and AI engineering platform for enterprise

Scalable data pre processing and curation toolkit for LLMs

re_data - fix data issues before your users & CEO would discover them 😊

First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

Automatically find issues in image datasets and practice data-centric computer vision.

A curated, but incomplete, list of data-centric AI resources.

Home of the Open Data Contract Standard (ODCS).

📙 Awesome Data Catalogs and Observability Platforms.

Enforce Data Contracts

Data quality assessment and metadata reporting for data frames and database tables

Production-Grade ML System for Automated Unit of Measure Error Detection | 88-92% Accuracy | 94% Autonomy | KNIME Workflow

Qualitis is a one-stop data quality management platform that supports quality verification, notification, and management for various datasource. It is used to solve various data quality problems caused by data processing. https://github.com/WeBankFinTech/Qualitis

Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

Compilation of high-profile real-world examples of failed machine learning projects