pipelines

A high-performance observability data pipeline.

Turns Data and AI algorithms into production-ready web applications in no time.

Workflow Engine for Kubernetes

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Concourse is a container-based automation system written in Go. It's mostly used for CI/CD.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

AI Infra / AI Orchestration / AI Control Plane

Event-driven Automation Framework for Kubernetes

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Elyra extends JupyterLab with an AI centric approach.

A Julia machine learning framework

Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

Azure AKS Kubernetes Masterclass

Tenzir is the data pipeline engine for security teams.

PypelineC: A hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.

Azure DevOps Extension for Azure CLI

Event triggering with Tekton!

Platform for Situated Intelligence

Zero-copy I/O primitives and pipelines for Go. Linux-specific.

Write your pipelines in C# !