工具说明为英文。

技术工具雷达: Data

雷达筛选条件

近期变化

Of 20 comparable tools in Data Engineering, 20 are increasing, 0 are stable, and 0 are declining. arrow has the largest measured increase: +268639 crates.io downloads over 90 days. These movements describe only changes in metrics collected over the period.

测量周期：2026-08-27 至 2026-09-02

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    库
    活跃

    SDK for robotics teams to verify the quality of their data used for AI model training.

    Python许可证: Apache-2.0
    • airflow
    • data-engineering
    • data-pipeline
    • data-quality
    • dataset-curation

    github实测增长打开来源 ↗

    225GitHub 星标+68 (+43.3 %)
  2. 2

    技能
    活跃

    World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

    Python许可证: AGPL-3.0
    • agent
    • agentic-ai
    • ai
    • claude
    • copilot

    github实测增长打开来源 ↗

    安装 git clone https://github.com/calesthio/OpenMontage ~/.claude/skills/OpenMontage

    52 517GitHub 星标+1 089 (+2.1 %)
  3. 3

    其他
    活跃

    Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).

    Python许可证: Apache-2.0

      github实测增长打开来源 ↗

      68GitHub 星标+14 (+25.9 %)
    • 4

      其他
      活跃

      Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.

      Python许可证: MIT
      • 2027
      • career
      • computer-science
      • faang
      • h1b

      github实测增长打开来源 ↗

      704GitHub 星标+24 (+3.5 %)
    • 5

      其他
      活跃

      A Windows app to debloat and optimize your PC

      TypeScript许可证: GPL-3.0
      • debloater
      • opimization
      • registry-tweaks
      • windows
      • windows-10-debloat

      github实测增长打开来源 ↗

      2 074GitHub 星标+27 (+1.3 %)
    • 6

      其他
      活跃

      Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

      Rust许可证: Apache-2.0
      • cdc
      • connectors
      • data-engineering
      • data-integration
      • data-orchestration

      github实测增长打开来源 ↗

      1 258GitHub 星标+21 (+1.7 %)
    • 7

      其他
      活跃

      2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.

      许可证: MIT
      • careers
      • computer-science
      • hiring
      • internship
      • internships

      github实测增长打开来源 ↗

      95GitHub 星标+5 (+5.6 %)
    • 8

      其他
      活跃

      从数据到智能：企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记：从 0 到 1 构建企业级医药数据平台，再到 Data + AI 转型下的 Agentic BI。

      HTML
      • agentic-bi
      • data-agent
      • data-ai
      • data-architecture
      • data-engineering

      github实测增长打开来源 ↗

      128GitHub 星标+3 (+2.4 %)
    • 9

      其他
      活跃

      Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

      Python许可证: BSD-2-Clause
      • analytics
      • athena
      • bi
      • bigquery
      • business-intelligence

      github实测增长打开来源 ↗

      28 777GitHub 星标+9 (+0.03 %)
    • 10

      其他
      活跃

      Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

      Go许可证: AGPL-3.0
      • aws
      • azure
      • cis
      • cloud
      • cnapp

      github实测增长打开来源 ↗

      7 941GitHub 星标+6 (+0.08 %)
    • 11

      其他
      活跃

      Spug is a lightweight agent-free automatic operation and maintenance platform designed for small and medium-sized enterprises. It integrates host management, host batch execution, host online terminal, file management, application release…

      JavaScript许可证: AGPL-3.0
      • alert
      • ci
      • cicd
      • cmdb
      • deploy

      github实测增长打开来源 ↗

      11 060GitHub 星标+5 (+0.05 %)
    • 12

      MCP
      活跃

      A MCP (Model Context Protocol) server for interacting with dbt.

      Python许可证: Apache-2.0
      • data-analytics
      • data-engineering
      • dbt
      • llm
      • mcp

      github实测增长打开来源 ↗

      602GitHub 星标+3 (+0.50 %)
    • 13

      其他
      活跃

      Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.

      Rust许可证: MIT
      • benchmark
      • bigquery
      • clickhouse
      • data-engineering
      • data-ingestions

      github实测增长打开来源 ↗

      52GitHub 星标+1 (+2.0 %)
    • 14

      其他
      活跃

      The first book dedicated to enterprise Agent platform engineering, from data intelligence foundations to production-ready AI-native business systems.

      Python许可证: Apache-2.0

        github实测增长打开来源 ↗

        256GitHub 星标+2 (+0.79 %)
      • 15

        其他
        活跃

        YTsaurus is a scalable and fault-tolerant open-source big data platform.

        C++许可证: Apache-2.0
        • big-data
        • clickhouse
        • distributed-database
        • lakehouse
        • olap-database

        github实测增长打开来源 ↗

        2 203GitHub 星标+3 (+0.14 %)
      • 16

        其他
        活跃

        The Clickhouse plugin for dbt (data build tool)

        Python许可证: Apache-2.0
        • clickhouse
        • database
        • dbt

        github实测增长打开来源 ↗

        361GitHub 星标+2 (+0.56 %)
      • 17

        其他
        活跃

        Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

        Go许可证: Apache-2.0
        • dashboard-friendly
        • data
        • data-analysis
        • data-engineering
        • data-integration

        github实测增长打开来源 ↗

        3 119GitHub 星标+3 (+0.10 %)
      • 18

        其他
        活跃

        The data-validation toolkit for enhanced dbt (data build tool) PR review

        TypeScript许可证: Apache-2.0
        • analytics-engineering
        • data
        • data-engineering
        • data-validation
        • dataops

        github实测增长打开来源 ↗

        477GitHub 星标+2 (+0.42 %)
      • 19

        其他
        活跃

        Production-style end-to-end e-commerce recommendation platform with data engineering, MLOps, serving, governance, and observability on Kubernetes.

        Python

          github实测增长打开来源 ↗

          97GitHub 星标+1 (+1.0 %)
        • 20

          其他
          活跃

          Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.

          TypeScript许可证: MIT
          • agent
          • agentic-data-engineering
          • ai
          • analytics-engineering
          • bigquery

          github实测增长打开来源 ↗

          802GitHub 星标+2 (+0.25 %)
        • 21

          其他
          活跃

          Enforce Data Contracts

          JavaScript许可证: MIT
          • bigquery
          • data-contract
          • data-contracts
          • data-engineering
          • data-governance

          github实测增长打开来源 ↗

          1 052GitHub 星标+2 (+0.19 %)
        • 22

          其他
          活跃

          Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code

          Python许可证: Apache-2.0
          • airflow
          • airflow-operators
          • apache-airflow
          • dbt
          • python

          github实测增长打开来源 ↗

          1 253GitHub 星标+2 (+0.16 %)

        学习与参考资源

        按实测增长排序，并在不同来源间归一化。 这些资源可单独访问，不参与主要排名。

        1. 1

          dbt-agent-skills

          技能
          活跃打开来源 ↗

          A curated collection of Agent Skills for working with dbt, to help AI agents understand and execute dbt workflows more effectively.

          Python许可证: Apache-2.0
            github

            安装 git clone https://github.com/dbt-labs/dbt-agent-skills ~/.claude/skills/dbt-agent-skills

            资源实测增长
            698GitHub 星标+9 (+1.3 %)
          • 2

            docker_practice

            其他
            活跃打开来源 ↗

            最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!

            Go
            • book
            • cloud-computing
            • container
            • devops
            • docker
            github资源实测增长
            26 229GitHub 星标+8 (+0.03 %)
          • 3

            awesome-data-engineering-br

            其他
            活跃打开来源 ↗github资源实测增长
            72GitHub 星标+1 (+1.4 %)