数据工程 · 其他

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

来源

GitHub

语言

TypeScript

领域

智能体、技能与 MCP, 云计算, 数据工程, 人工智能 / 大语言模型, Web / JavaScript

用途

检索增强生成（RAG）, 工作流

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

来源

GitHub

语言

Java

领域

数据工程, DevOps / 平台工程

用途

工作流

YTsaurus is a scalable and fault-tolerant open-source big data platform.

来源

GitHub

语言

C++

领域

数据工程

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

来源

GitHub

语言

Python

领域

数据工程, 人工智能 / 大语言模型

用途

工作流

Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.

来源

GitHub

语言

TypeScript

领域

数据工程

用途

可观测性

:sparkles: An advanced 3D Gaussian Splatting renderer for THREE.js

来源

GitHub

语言

TypeScript

领域

数据工程

Hybrid recommender system + RAG chatbot for IT courses (FastAPI + Express/TS + PostgreSQL), with an independent Data Lakehouse module (Spark/Kafka/dbt/Trino) and full CI/CD

来源

GitHub

语言

Jupyter Notebook

领域

数据工程

Docker configuration for running VLLM on dual DGX Sparks

来源

GitHub

语言

Python

领域

数据工程

Apache Spark - A unified analytics engine for large-scale data processing

来源

GitHub

语言

Scala

领域

数据工程

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

来源

GitHub

语言

Python

领域

数据工程

用途

检索增强生成（RAG）, 工作流