工具说明为英文。

技术工具雷达: Data

雷达筛选条件

近期变化

Of 20 comparable tools in Data Engineering, 20 are increasing, 0 are stable, and 0 are declining. arrow has the largest measured increase: +268639 crates.io downloads over 90 days. These movements describe only changes in metrics collected over the period.

测量周期：2026-08-27 至 2026-09-02

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    库
    活跃

    SDK for robotics teams to verify the quality of their data used for AI model training.

    Python许可证: Apache-2.0
    • airflow
    • data-engineering
    • data-pipeline
    • data-quality
    • dataset-curation

    github实测增长打开来源 ↗

    225GitHub 星标+68 (+43.3 %)
  2. 2

    技能
    活跃

    World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

    Python许可证: AGPL-3.0
    • agent
    • agentic-ai
    • ai
    • claude
    • copilot

    github实测增长打开来源 ↗

    安装 git clone https://github.com/calesthio/OpenMontage ~/.claude/skills/OpenMontage

    52 517GitHub 星标+1 089 (+2.1 %)
  3. 3

    其他
    活跃

    Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).

    Python许可证: Apache-2.0

      github实测增长打开来源 ↗

      68GitHub 星标+14 (+25.9 %)
    • 4

      应用
      活跃

      SparkyFitness: Built for Families. Powered by AI. Track food, fitness, water, and health — together.

      TypeScript
      • ai
      • artificial-intelligence
      • fitness
      • fitness-app
      • fitness-tracker

      github实测增长打开来源 ↗

      5 725GitHub 星标+75 (+1.3 %)
    • 5

      其他
      活跃

      Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.

      Python许可证: MIT
      • 2027
      • career
      • computer-science
      • faang
      • h1b

      github实测增长打开来源 ↗

      704GitHub 星标+24 (+3.5 %)
    • 6

      其他
      活跃

      LLM speculative inference server for heterogeneous hardware & consumer GPUs

      C++许可证: Apache-2.0
      • cuda
      • cuda-kernels
      • dflash
      • heterogeneous-computing
      • kernel

      github实测增长打开来源 ↗

      2 825GitHub 星标+34 (+1.2 %)
    • 7

      其他
      活跃

      A Windows app to debloat and optimize your PC

      TypeScript许可证: GPL-3.0
      • debloater
      • opimization
      • registry-tweaks
      • windows
      • windows-10-debloat

      github实测增长打开来源 ↗

      2 074GitHub 星标+27 (+1.3 %)
    • 8

      其他
      活跃

      Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

      Rust许可证: Apache-2.0
      • cdc
      • connectors
      • data-engineering
      • data-integration
      • data-orchestration

      github实测增长打开来源 ↗

      1 258GitHub 星标+21 (+1.7 %)
    • 9

      其他
      活跃

      data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

      Python许可证: Apache-2.0
      • data
      • data-engineering
      • data-lake
      • data-loading
      • data-warehouse

      github实测增长打开来源 ↗

      5 809GitHub 星标+31 (+0.54 %)
    • 10

      其他
      活跃

      Agentic BI. Analytics at the speed of code ⚡️

      TypeScript
      • business-intelligence
      • data-analytics
      • data-visualization
      • dbt

      github实测增长打开来源 ↗

      6 112GitHub 星标+28 (+0.46 %)
    • 11

      其他
      活跃

      Docker configuration for running VLLM on dual DGX Sparks

      Shell许可证: MIT

        github实测增长打开来源 ↗

        2 211GitHub 星标+21 (+0.96 %)
      • 12

        智能体
        活跃

        DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！

        Python许可证: MIT
        • agent
        • agentic
        • agentic-ai
        • ai
        • ai-scientist

        github实测增长打开来源 ↗

        4 587GitHub 星标+22 (+0.48 %)
      • 13

        其他
        活跃

        2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.

        许可证: MIT
        • careers
        • computer-science
        • hiring
        • internship
        • internships

        github实测增长打开来源 ↗

        95GitHub 星标+5 (+5.6 %)
      • 14

        其他
        活跃

        :sparkles: An advanced 3D Gaussian Splatting renderer for THREE.js

        TypeScript许可证: MIT

          github实测增长打开来源 ↗

          3 548GitHub 星标+18 (+0.51 %)
        • 15

          其他
          活跃

          Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

          Python许可证: MIT
          • data-matching
          • data-science
          • deduplicate-data
          • deduplication
          • duckdb

          github实测增长打开来源 ↗

          2 373GitHub 星标+9 (+0.38 %)
        • 16

          其他
          活跃

          从数据到智能：企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记：从 0 到 1 构建企业级医药数据平台，再到 Data + AI 转型下的 Agentic BI。

          HTML
          • agentic-bi
          • data-agent
          • data-ai
          • data-architecture
          • data-engineering

          github实测增长打开来源 ↗

          128GitHub 星标+3 (+2.4 %)
        • 17

          其他
          活跃

          Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

          Go许可证: MPL-2.0
          • airbyte
          • attack-surface-management
          • aws
          • azure
          • bigquery

          github实测增长打开来源 ↗

          6 506GitHub 星标+9 (+0.14 %)
        • 18

          其他
          活跃

          Scalable and efficient data transformation framework - backwards compatible with dbt.

          Python许可证: Apache-2.0
          • dataengineering
          • dataops
          • dbt
          • elt
          • etl

          github实测增长打开来源 ↗

          3 265GitHub 星标+8 (+0.25 %)
        • 19

          其他
          活跃

          Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

          Python许可证: BSD-2-Clause
          • analytics
          • athena
          • bi
          • bigquery
          • business-intelligence

          github实测增长打开来源 ↗

          28 777GitHub 星标+9 (+0.03 %)
        • 20

          其他
          活跃

          The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

          HTML许可证: Apache-2.0
          • analytics-engineer
          • bigquery
          • data-analysis
          • data-governance
          • data-lineage

          github实测增长打开来源 ↗

          2 405GitHub 星标+7 (+0.29 %)
        • 21

          其他
          活跃

          Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

          Rust许可证: Apache-2.0
          • apache-iceberg
          • apache-spark
          • arrow
          • artificial-intelligence
          • big-data

          github实测增长打开来源 ↗

          3 339GitHub 星标+7 (+0.21 %)
        • 22

          其他
          活跃

          Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

          Go许可证: AGPL-3.0
          • bigquery
          • cdc
          • clickhouse
          • cloud-native
          • distributed-systems

          github实测增长打开来源 ↗

          3 258GitHub 星标+6 (+0.18 %)
        • 23

          其他
          活跃

          Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

          Go许可证: AGPL-3.0
          • aws
          • azure
          • cis
          • cloud
          • cnapp

          github实测增长打开来源 ↗

          7 941GitHub 星标+6 (+0.08 %)

        学习与参考资源

        按实测增长排序，并在不同来源间归一化。 这些资源可单独访问，不参与主要排名。

        1. 1

          dbt-agent-skills

          技能
          活跃打开来源 ↗

          A curated collection of Agent Skills for working with dbt, to help AI agents understand and execute dbt workflows more effectively.

          Python许可证: Apache-2.0
            github

            安装 git clone https://github.com/dbt-labs/dbt-agent-skills ~/.claude/skills/dbt-agent-skills

            资源实测增长
            698GitHub 星标+9 (+1.3 %)
          • 2

            docker_practice

            其他
            活跃打开来源 ↗

            最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!

            Go
            • book
            • cloud-computing
            • container
            • devops
            • docker
            github资源实测增长
            26 229GitHub 星标+8 (+0.03 %)