工具说明为英文。

技术工具雷达: Data

雷达筛选条件

工具排名

按实测增长排序，并在不同来源间归一化。 原始值保留各自的数据窗口；计算变化需要 7 天内至少两次测量。

  1. 1

    其他
    活跃

    End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.

    Python
    • apache-airflow
    • apache-iceberg
    • athena
    • aws
    • data-engineering

    github实测增长打开来源 ↗

    106GitHub 星标+51 (+92.7 %)
  2. 2

    其他
    活跃

    Graph-Native Infrastructure for Context and Accountable AI Systems

    Python许可证: MIT
    • agent-memory
    • ai
    • ai-governance
    • ai-infrastructure
    • artificial-intelligence

    github实测增长打开来源 ↗

    11 532GitHub 星标+698 (+6.4 %)
  3. 3

    其他
    活跃

    Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

    TypeScript
    • agent
    • agentic-ai
    • agentic-framework
    • agentic-workflow
    • ai

    github实测增长打开来源 ↗

    154 043GitHub 星标+524 (+0.34 %)
  4. 4

    其他
    活跃

    Summer 2027 software engineering, data science, AI, quant, product management, and hardware internship postings. Updated daily by Simplify and Pitt CSC.

    Python
    • data-science
    • fall-2026
    • github
    • internship
    • internships

    github实测增长打开来源 ↗

    47 002GitHub 星标+196 (+0.42 %)
  5. 5

    其他
    活跃

    Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).

    Python许可证: Apache-2.0

      github实测增长打开来源 ↗

      64GitHub 星标+11 (+20.8 %)
    • 6

      其他
      活跃

      Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

      TypeScript许可证: AGPL-3.0
      • analytics
      • apm
      • datadog
      • elasticsearch
      • grafana

      github实测增长打开来源 ↗

      21 594GitHub 星标+119 (+0.55 %)
    • 7

      其他
      活跃

      Apache Superset is a Data Visualization and Data Exploration Platform

      Python许可证: Apache-2.0
      • analytics
      • apache
      • apache-superset
      • asf
      • bi

      github实测增长打开来源 ↗

      74 566GitHub 星标+103 (+0.14 %)
    • 8

      其他
      活跃

      Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.

      Python许可证: MIT
      • 2027
      • career
      • computer-science
      • faang
      • h1b

      github实测增长打开来源 ↗

      698GitHub 星标+26 (+3.9 %)
    • 9

      其他
      活跃

      Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries.

      Go许可证: Apache-2.0
      • build-automation
      • build-pipelines
      • ci
      • ci-cd
      • code-repository

      github实测增长打开来源 ↗

      38 196GitHub 星标+72 (+0.19 %)
    • 10

      其他
      活跃

      dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

      Rust许可证: Apache-2.0
      • analytics
      • business-intelligence
      • data-modeling
      • dbt-viewpoint
      • elt

      github实测增长打开来源 ↗

      13 750GitHub 星标+60 (+0.44 %)
    • 11

      其他
      活跃

      LLM speculative inference server for heterogeneous hardware & consumer GPUs

      C++许可证: Apache-2.0
      • cuda
      • cuda-kernels
      • dflash
      • heterogeneous-computing
      • kernel

      github实测增长打开来源 ↗

      2 825GitHub 星标+37 (+1.3 %)
    • 12

      其他
      活跃

      Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for…

      Python许可证: Apache-2.0
      • agent-framework
      • agentic-ai
      • agentic-rag
      • agents
      • ai

      github实测增长打开来源 ↗

      26 377GitHub 星标+60 (+0.23 %)
    • 13

      其他
      活跃

      2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.

      许可证: MIT
      • careers
      • computer-science
      • hiring
      • internship
      • internships

      github实测增长打开来源 ↗

      93GitHub 星标+8 (+9.4 %)
    • 14

      其他
      活跃

      Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

      Python许可证: Apache-2.0
      • airflow
      • apache
      • apache-airflow
      • automation
      • dag

      github实测增长打开来源 ↗

      46 672GitHub 星标+64 (+0.14 %)
    • 15

      其他
      活跃

      A Windows app to debloat and optimize your PC

      TypeScript许可证: GPL-3.0
      • debloater
      • opimization
      • registry-tweaks
      • windows
      • windows-10-debloat

      github实测增长打开来源 ↗

      2 074GitHub 星标+29 (+1.4 %)
    • 16

      其他
      活跃

      Declarative Continuous Deployment for Kubernetes

      Go许可证: Apache-2.0
      • argo
      • argo-cd
      • cd
      • ci-cd
      • cicd

      github实测增长打开来源 ↗

      24 046GitHub 星标+54 (+0.23 %)
    • 17

      其他
      活跃

      Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

      Rust许可证: Apache-2.0
      • cdc
      • connectors
      • data-engineering
      • data-integration
      • data-orchestration

      github实测增长打开来源 ↗

      1 254GitHub 星标+24 (+2.0 %)
    • 18

      其他
      活跃

      Apache Spark - A unified analytics engine for large-scale data processing

      Scala许可证: Apache-2.0
      • big-data
      • java
      • jdbc
      • python
      • r

      github实测增长打开来源 ↗

      43 931GitHub 星标+55 (+0.13 %)
    • 19

      其他
      活跃

      Docker configuration for running VLLM on dual DGX Sparks

      Shell许可证: MIT

        github实测增长打开来源 ↗

        2 205GitHub 星标+27 (+1.2 %)
      • 20

        其他
        活跃

        Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

        Java许可证: Apache-2.0
        • ai-agents
        • automation
        • control-plane
        • data-engineering
        • data-orchestration

        github实测增长打开来源 ↗

        27 967GitHub 星标+45 (+0.16 %)
      • 21

        其他
        活跃

        A high-performance observability data pipeline.

        Rust许可证: MPL-2.0
        • agent
        • cloud-native
        • data-transformation
        • datadog
        • etl

        github实测增长打开来源 ↗

        22 497GitHub 星标+41 (+0.18 %)
      • 22

        其他
        活跃

        Agentic BI. Analytics at the speed of code ⚡️

        TypeScript
        • business-intelligence
        • data-analytics
        • data-visualization
        • dbt

        github实测增长打开来源 ↗

        6 110GitHub 星标+29 (+0.48 %)
      • 23

        其他
        活跃

        data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

        Python许可证: Apache-2.0
        • data
        • data-engineering
        • data-lake
        • data-loading
        • data-warehouse

        github实测增长打开来源 ↗

        5 804GitHub 星标+26 (+0.45 %)
      • 24

        其他
        活跃

        Always know what to expect from your data.

        Python许可证: Apache-2.0
        • cleandata
        • data-engineering
        • data-profilers
        • data-profiling
        • data-quality

        github实测增长打开来源 ↗

        11 760GitHub 星标+25 (+0.21 %)

      学习与参考资源

      按实测增长排序，并在不同来源间归一化。 这些资源可单独访问，不参与主要排名。

      1. 1

        data-engineering-zoomcamp

        其他
        活跃打开来源 ↗

        Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼

        Jupyter Notebook
        • course
        • data-engineering
        • dbt
        • docker
        • free
        github资源实测增长
        45 131GitHub 星标+171 (+0.38 %)