Data radar: tools and trends

Momentum based on available 7-day snapshots for Data: measured with two snapshots, estimated otherwise. Each value shows its own source window. This page reads stored snapshots only.

Radar filters

What’s changing

Of 20 comparable tools in Data Engineering, 20 are increasing, 0 are stable, and 0 are declining. arrow has the largest measured increase: +268639 crates.io downloads over 90 days. These movements describe only changes in metrics collected over the period.

Measured period: 2026-08-27 to 2026-09-02

Tool ranking

Ranked by measured growth, normalized across sources. Raw values keep their source-specific window, shown under each tool; a change requires at least two snapshots from the last 7 days.

  1. 1

    Library
    Active

    SDK for robotics teams to verify the quality of their data used for AI model training.

    PythonLicense: Apache-2.0
    • airflow
    • data-engineering
    • data-pipeline
    • data-quality
    • dataset-curation

    githubmeasured growthOpen source ↗

    225GitHub stars+68 (+43.3 %)
  2. 2

    Skill
    Active

    World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

    PythonLicense: AGPL-3.0
    • agent
    • agentic-ai
    • ai
    • claude
    • copilot

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/calesthio/OpenMontage ~/.claude/skills/OpenMontage

    52 517GitHub stars+1 089 (+2.1 %)
  3. 3

    Other
    Active

    Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).

    PythonLicense: Apache-2.0

      githubmeasured growthOpen source ↗

      68GitHub stars+14 (+25.9 %)
    • 4

      Other
      Active

      Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.

      PythonLicense: MIT
      • 2027
      • career
      • computer-science
      • faang
      • h1b

      githubmeasured growthOpen source ↗

      704GitHub stars+24 (+3.5 %)
    • 5

      Other
      Active

      A Windows app to debloat and optimize your PC

      TypeScriptLicense: GPL-3.0
      • debloater
      • opimization
      • registry-tweaks
      • windows
      • windows-10-debloat

      githubmeasured growthOpen source ↗

      2 074GitHub stars+27 (+1.3 %)
    • 6

      Other
      Active

      Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

      RustLicense: Apache-2.0
      • cdc
      • connectors
      • data-engineering
      • data-integration
      • data-orchestration

      githubmeasured growthOpen source ↗

      1 258GitHub stars+21 (+1.7 %)
    • 7

      Other
      Active

      2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.

      License: MIT
      • careers
      • computer-science
      • hiring
      • internship
      • internships

      githubmeasured growthOpen source ↗

      95GitHub stars+5 (+5.6 %)
    • 8

      Other
      Active

      从数据到智能：企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记：从 0 到 1 构建企业级医药数据平台，再到 Data + AI 转型下的 Agentic BI。

      HTML
      • agentic-bi
      • data-agent
      • data-ai
      • data-architecture
      • data-engineering

      githubmeasured growthOpen source ↗

      128GitHub stars+3 (+2.4 %)
    • 9

      Other
      Active

      Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

      PythonLicense: BSD-2-Clause
      • analytics
      • athena
      • bi
      • bigquery
      • business-intelligence

      githubmeasured growthOpen source ↗

      28 777GitHub stars+9 (+0.03 %)
    • 10

      Other
      Active

      Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

      GoLicense: AGPL-3.0
      • aws
      • azure
      • cis
      • cloud
      • cnapp

      githubmeasured growthOpen source ↗

      7 941GitHub stars+6 (+0.08 %)
    • 11

      Other
      Active

      Spug is a lightweight agent-free automatic operation and maintenance platform designed for small and medium-sized enterprises. It integrates host management, host batch execution, host online terminal, file management, application release…

      JavaScriptLicense: AGPL-3.0
      • alert
      • ci
      • cicd
      • cmdb
      • deploy

      githubmeasured growthOpen source ↗

      11 060GitHub stars+5 (+0.05 %)
    • 12

      MCP
      Active

      A MCP (Model Context Protocol) server for interacting with dbt.

      PythonLicense: Apache-2.0
      • data-analytics
      • data-engineering
      • dbt
      • llm
      • mcp

      githubmeasured growthOpen source ↗

      602GitHub stars+3 (+0.50 %)
    • 13

      Other
      Active

      Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.

      RustLicense: MIT
      • benchmark
      • bigquery
      • clickhouse
      • data-engineering
      • data-ingestions

      githubmeasured growthOpen source ↗

      52GitHub stars+1 (+2.0 %)
    • 14

      Other
      Active

      The first book dedicated to enterprise Agent platform engineering, from data intelligence foundations to production-ready AI-native business systems.

      PythonLicense: Apache-2.0

        githubmeasured growthOpen source ↗

        256GitHub stars+2 (+0.79 %)
      • 15

        Other
        Active

        YTsaurus is a scalable and fault-tolerant open-source big data platform.

        C++License: Apache-2.0
        • big-data
        • clickhouse
        • distributed-database
        • lakehouse
        • olap-database

        githubmeasured growthOpen source ↗

        2 203GitHub stars+3 (+0.14 %)
      • 16

        Other
        Active

        The Clickhouse plugin for dbt (data build tool)

        PythonLicense: Apache-2.0
        • clickhouse
        • database
        • dbt

        githubmeasured growthOpen source ↗

        361GitHub stars+2 (+0.56 %)
      • 17

        Other
        Active

        Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

        GoLicense: Apache-2.0
        • dashboard-friendly
        • data
        • data-analysis
        • data-engineering
        • data-integration

        githubmeasured growthOpen source ↗

        3 119GitHub stars+3 (+0.10 %)
      • 18

        Other
        Active

        The data-validation toolkit for enhanced dbt (data build tool) PR review

        TypeScriptLicense: Apache-2.0
        • analytics-engineering
        • data
        • data-engineering
        • data-validation
        • dataops

        githubmeasured growthOpen source ↗

        477GitHub stars+2 (+0.42 %)
      • 19

        Other
        Active

        Production-style end-to-end e-commerce recommendation platform with data engineering, MLOps, serving, governance, and observability on Kubernetes.

        Python

          githubmeasured growthOpen source ↗

          97GitHub stars+1 (+1.0 %)
        • 20

          Other
          Active

          Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.

          TypeScriptLicense: MIT
          • agent
          • agentic-data-engineering
          • ai
          • analytics-engineering
          • bigquery

          githubmeasured growthOpen source ↗

          802GitHub stars+2 (+0.25 %)
        • 21

          Other
          Active

          Enforce Data Contracts

          JavaScriptLicense: MIT
          • bigquery
          • data-contract
          • data-contracts
          • data-engineering
          • data-governance

          githubmeasured growthOpen source ↗

          1 052GitHub stars+2 (+0.19 %)
        • 22

          Other
          Active

          Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code

          PythonLicense: Apache-2.0
          • airflow
          • airflow-operators
          • apache-airflow
          • dbt
          • python

          githubmeasured growthOpen source ↗

          1 253GitHub stars+2 (+0.16 %)

        Learning resources

        Ranked by measured growth, normalized across sources. These resources remain available separately and do not take part in the main tool ranking.

        1. 1

          dbt-agent-skills

          Skill
          ActiveOpen source ↗

          A curated collection of Agent Skills for working with dbt, to help AI agents understand and execute dbt workflows more effectively.

          PythonLicense: Apache-2.0
            github

            Install git clone https://github.com/dbt-labs/dbt-agent-skills ~/.claude/skills/dbt-agent-skills

            Resourcemeasured growth
            698GitHub stars+9 (+1.3 %)
          • 2

            docker_practice

            Other
            ActiveOpen source ↗

            最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!

            Go
            • book
            • cloud-computing
            • container
            • devops
            • docker
            githubResourcemeasured growth
            26 229GitHub stars+8 (+0.03 %)
          • 3

            awesome-data-engineering-br

            Other
            ActiveOpen source ↗githubResourcemeasured growth
            72GitHub stars+1 (+1.4 %)