Data radar: tools and trends

Momentum based on available 7-day snapshots for Data: measured with two snapshots, estimated otherwise. Each value shows its own source window. This page reads stored snapshots only.

Radar filters

What’s changing

Of 20 comparable tools in Data Engineering, 20 are increasing, 0 are stable, and 0 are declining. arrow has the largest measured increase: +268639 crates.io downloads over 90 days. These movements describe only changes in metrics collected over the period.

Measured period: 2026-08-27 to 2026-09-02

Tool ranking

Ranked by measured growth, normalized across sources. Raw values keep their source-specific window, shown under each tool; a change requires at least two snapshots from the last 7 days.

  1. 1

    Library
    Active

    SDK for robotics teams to verify the quality of their data used for AI model training.

    PythonLicense: Apache-2.0
    • airflow
    • data-engineering
    • data-pipeline
    • data-quality
    • dataset-curation

    githubmeasured growthOpen source ↗

    225GitHub stars+68 (+43.3 %)
  2. 2

    Skill
    Active

    World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

    PythonLicense: AGPL-3.0
    • agent
    • agentic-ai
    • ai
    • claude
    • copilot

    githubmeasured growthOpen source ↗

    Install git clone https://github.com/calesthio/OpenMontage ~/.claude/skills/OpenMontage

    52 517GitHub stars+1 089 (+2.1 %)
  3. 3

    Other
    Active

    Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).

    PythonLicense: Apache-2.0

      githubmeasured growthOpen source ↗

      68GitHub stars+14 (+25.9 %)
    • 4

      App
      Active

      SparkyFitness: Built for Families. Powered by AI. Track food, fitness, water, and health — together.

      TypeScript
      • ai
      • artificial-intelligence
      • fitness
      • fitness-app
      • fitness-tracker

      githubmeasured growthOpen source ↗

      5 725GitHub stars+75 (+1.3 %)
    • 5

      Other
      Active

      Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.

      PythonLicense: MIT
      • 2027
      • career
      • computer-science
      • faang
      • h1b

      githubmeasured growthOpen source ↗

      704GitHub stars+24 (+3.5 %)
    • 6

      Other
      Active

      LLM speculative inference server for heterogeneous hardware & consumer GPUs

      C++License: Apache-2.0
      • cuda
      • cuda-kernels
      • dflash
      • heterogeneous-computing
      • kernel

      githubmeasured growthOpen source ↗

      2 825GitHub stars+34 (+1.2 %)
    • 7

      Other
      Active

      A Windows app to debloat and optimize your PC

      TypeScriptLicense: GPL-3.0
      • debloater
      • opimization
      • registry-tweaks
      • windows
      • windows-10-debloat

      githubmeasured growthOpen source ↗

      2 074GitHub stars+27 (+1.3 %)
    • 8

      Other
      Active

      Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

      RustLicense: Apache-2.0
      • cdc
      • connectors
      • data-engineering
      • data-integration
      • data-orchestration

      githubmeasured growthOpen source ↗

      1 258GitHub stars+21 (+1.7 %)
    • 9

      Other
      Active

      data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

      PythonLicense: Apache-2.0
      • data
      • data-engineering
      • data-lake
      • data-loading
      • data-warehouse

      githubmeasured growthOpen source ↗

      5 809GitHub stars+31 (+0.54 %)
    • 10

      Other
      Active

      Agentic BI. Analytics at the speed of code ⚡️

      TypeScript
      • business-intelligence
      • data-analytics
      • data-visualization
      • dbt

      githubmeasured growthOpen source ↗

      6 112GitHub stars+28 (+0.46 %)
    • 11

      Other
      Active

      Docker configuration for running VLLM on dual DGX Sparks

      ShellLicense: MIT

        githubmeasured growthOpen source ↗

        2 211GitHub stars+21 (+0.96 %)
      • 12

        Agent
        Active

        DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！

        PythonLicense: MIT
        • agent
        • agentic
        • agentic-ai
        • ai
        • ai-scientist

        githubmeasured growthOpen source ↗

        4 587GitHub stars+22 (+0.48 %)
      • 13

        Other
        Active

        2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.

        License: MIT
        • careers
        • computer-science
        • hiring
        • internship
        • internships

        githubmeasured growthOpen source ↗

        95GitHub stars+5 (+5.6 %)
      • 14

        Other
        Active

        :sparkles: An advanced 3D Gaussian Splatting renderer for THREE.js

        TypeScriptLicense: MIT

          githubmeasured growthOpen source ↗

          3 548GitHub stars+18 (+0.51 %)
        • 15

          Other
          Active

          Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

          PythonLicense: MIT
          • data-matching
          • data-science
          • deduplicate-data
          • deduplication
          • duckdb

          githubmeasured growthOpen source ↗

          2 373GitHub stars+9 (+0.38 %)
        • 16

          Other
          Active

          从数据到智能：企业级数据平台的构建、演进与 Agentic BI 实践。一个数据开发的八年数据工程手记：从 0 到 1 构建企业级医药数据平台，再到 Data + AI 转型下的 Agentic BI。

          HTML
          • agentic-bi
          • data-agent
          • data-ai
          • data-architecture
          • data-engineering

          githubmeasured growthOpen source ↗

          128GitHub stars+3 (+2.4 %)
        • 17

          Other
          Active

          Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

          GoLicense: MPL-2.0
          • airbyte
          • attack-surface-management
          • aws
          • azure
          • bigquery

          githubmeasured growthOpen source ↗

          6 506GitHub stars+9 (+0.14 %)
        • 18

          Other
          Active

          Scalable and efficient data transformation framework - backwards compatible with dbt.

          PythonLicense: Apache-2.0
          • dataengineering
          • dataops
          • dbt
          • elt
          • etl

          githubmeasured growthOpen source ↗

          3 265GitHub stars+8 (+0.25 %)
        • 19

          Other
          Active

          Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

          PythonLicense: BSD-2-Clause
          • analytics
          • athena
          • bi
          • bigquery
          • business-intelligence

          githubmeasured growthOpen source ↗

          28 777GitHub stars+9 (+0.03 %)
        • 20

          Other
          Active

          The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

          HTMLLicense: Apache-2.0
          • analytics-engineer
          • bigquery
          • data-analysis
          • data-governance
          • data-lineage

          githubmeasured growthOpen source ↗

          2 405GitHub stars+7 (+0.29 %)
        • 21

          Other
          Active

          Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

          RustLicense: Apache-2.0
          • apache-iceberg
          • apache-spark
          • arrow
          • artificial-intelligence
          • big-data

          githubmeasured growthOpen source ↗

          3 339GitHub stars+7 (+0.21 %)
        • 22

          Other
          Active

          Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

          GoLicense: AGPL-3.0
          • bigquery
          • cdc
          • clickhouse
          • cloud-native
          • distributed-systems

          githubmeasured growthOpen source ↗

          3 258GitHub stars+6 (+0.18 %)
        • 23

          Other
          Active

          Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

          GoLicense: AGPL-3.0
          • aws
          • azure
          • cis
          • cloud
          • cnapp

          githubmeasured growthOpen source ↗

          7 941GitHub stars+6 (+0.08 %)

        Learning resources

        Ranked by measured growth, normalized across sources. These resources remain available separately and do not take part in the main tool ranking.

        1. 1

          dbt-agent-skills

          Skill
          ActiveOpen source ↗

          A curated collection of Agent Skills for working with dbt, to help AI agents understand and execute dbt workflows more effectively.

          PythonLicense: Apache-2.0
            github

            Install git clone https://github.com/dbt-labs/dbt-agent-skills ~/.claude/skills/dbt-agent-skills

            Resourcemeasured growth
            698GitHub stars+9 (+1.3 %)
          • 2

            docker_practice

            Other
            ActiveOpen source ↗

            最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!

            Go
            • book
            • cloud-computing
            • container
            • devops
            • docker
            githubResourcemeasured growth
            26 229GitHub stars+8 (+0.03 %)