Data Pipelines

Open-source data integration platform with 300+ connectors for syncing data from any source to any destination. Used in ...

Open-source platform to programmatically author, schedule, and monitor workflows using Python DAGs. Differentiates with ...

Open-source distributed event streaming platform for high-performance data pipelines, streaming analytics, and data inte...

Web scraping and browser automation library. Handles anti-bot protections. TypeScript and Python.

Data orchestration platform built around the concept of software-defined assets. Designed for ML and analytics teams, it...

SQL-first transformation tool that enables data analysts and engineers to transform, test, and document data using modul...

RAG framework by Mem0. Create AI apps over any data in minutes. Supports 20+ data source types.

Open-source workflow orchestration platform for building and scaling AI/ML pipelines and data workflows. Differentiates ...

Convert any URL to LLM-friendly text. Simple API: prefix URL with r.jina.ai. Free tier available.

Open-source Python framework for creating reproducible, maintainable, and modular data science and ML pipelines. Develop...

Open-source ML platform on Kubernetes. Provides Pipelines (DAG orchestration), Notebooks, Model Training Operator, KServ...

LlamaIndex's document parser. Handles complex PDFs with tables, charts, and mixed layouts for RAG.

Open-source data pipeline tool built for ML engineers with a block-based notebook interface. Designed to make building, ...

Universal document parser. Supports PDF, DOCX, PPTX, and more. Integrates with LangChain and LlamaIndex.

Python framework for building and managing ML, AI, and data science workflows with built-in versioning and orchestration...

Python-native workflow orchestration platform that turns functions into observable workflows using decorators. Different...

Production-ready RAG engine. Ingestion, search, and generation in one system with knowledge graph support.

Open-source MLOps framework for building portable, production-ready ML pipelines. Abstracts infrastructure complexity so...