Die Werkzeugbeschreibungen sind auf Englisch.

Technologieradare: Data

Radarfilter

Aktuelle Veränderungen

Of 20 comparable tools in Data Engineering, 20 are increasing, 0 are stable, and 0 are declining. arrow has the largest measured increase: +256866 crates.io downloads over 90 days. These movements describe only changes in metrics collected over the period.

Messzeitraum: 2026-08-26 bis 2026-09-01

Werkzeug-Rangliste

Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Rohwerte behalten ihr eigenes Zeitfenster; eine Änderung erfordert mindestens zwei Messungen in 7 Tagen.

  1. 1

    Sonstige
    Aktiv

    End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.

    Python
    • apache-airflow
    • apache-iceberg
    • athena
    • aws
    • data-engineering

    githubgemessenes WachstumQuelle öffnen ↗

    106GitHub-Sterne+51 (+92.7 %)
  2. 2

    Sonstige
    Aktiv

    Graph-Native Infrastructure for Context and Accountable AI Systems

    PythonLizenz: MIT
    • agent-memory
    • ai
    • ai-governance
    • ai-infrastructure
    • artificial-intelligence

    githubgemessenes WachstumQuelle öffnen ↗

    11 532GitHub-Sterne+698 (+6.4 %)
  3. 3

    Bibliothek
    Aktiv

    SDK for robotics teams to verify the quality of their data used for AI model training.

    PythonLizenz: Apache-2.0
    • airflow
    • data-engineering
    • data-pipeline
    • data-quality
    • dataset-curation

    githubgemessenes WachstumQuelle öffnen ↗

    217GitHub-Sterne+71 (+48.6 %)
  4. 4

    Skill
    Aktiv

    World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

    PythonLizenz: AGPL-3.0
    • agent
    • agentic-ai
    • ai
    • claude
    • copilot

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/calesthio/OpenMontage ~/.claude/skills/OpenMontage

    52 517GitHub-Sterne+2 213 (+4.4 %)
  5. 5

    Bibliothek
    UnbekanntLetzter Commit: nicht verfügbar

    Rust implementation of Apache Arrow

    • arrow

    cratesgemessenes WachstumQuelle öffnen ↗

    Installieren cargo add arrow

    17 280 524crates.io-Downloads in 90 Tagen+256 866 (+1.5 %)
  6. 6

    Bibliothek
    UnbekanntLetzter Commit: nicht verfügbar

    DataFusion is an in-memory query engine that uses Apache Arrow as the memory model

    • sql
    • query
    • arrow

    cratesgemessenes WachstumQuelle öffnen ↗

    Installieren cargo add datafusion

    4 754 796crates.io-Downloads in 90 Tagen+64 216 (+1.4 %)
  7. 7

    Skill
    Aktiv

    Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI &…

    GoLizenz: Apache-2.0
    • agent
    • agent-skills
    • code-review
    • code-review-assistant
    • harness

    githubgemessenes WachstumQuelle öffnen ↗

    Installieren git clone https://github.com/alibaba/open-code-review ~/.claude/skills/open-code-review

    21 735GitHub-Sterne+316 (+1.5 %)
  8. 8

    Sonstige
    Aktiv

    Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

    TypeScript
    • agent
    • agentic-ai
    • agentic-framework
    • agentic-workflow
    • ai

    githubgemessenes WachstumQuelle öffnen ↗

    154 043GitHub-Sterne+524 (+0.34 %)
  9. 9

    Sonstige
    Aktiv

    Summer 2027 software engineering, data science, AI, quant, product management, and hardware internship postings. Updated daily by Simplify and Pitt CSC.

    Python
    • data-science
    • fall-2026
    • github
    • internship
    • internships

    githubgemessenes WachstumQuelle öffnen ↗

    47 002GitHub-Sterne+196 (+0.42 %)
  10. 10

    Sonstige
    Aktiv

    Data-engineering benchmark for coding agents (DuckDB + Snowflake dbt tasks).

    PythonLizenz: Apache-2.0

      githubgemessenes WachstumQuelle öffnen ↗

      64GitHub-Sterne+11 (+20.8 %)
    • 11

      Sonstige
      Aktiv

      Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…

      TypeScriptLizenz: AGPL-3.0
      • analytics
      • apm
      • datadog
      • elasticsearch
      • grafana

      githubgemessenes WachstumQuelle öffnen ↗

      21 594GitHub-Sterne+119 (+0.55 %)
    • 12

      App
      Aktiv

      SparkyFitness: Built for Families. Powered by AI. Track food, fitness, water, and health — together.

      TypeScript
      • ai
      • artificial-intelligence
      • fitness
      • fitness-app
      • fitness-tracker

      githubgemessenes WachstumQuelle öffnen ↗

      5 713GitHub-Sterne+79 (+1.4 %)
    • 13

      MCP
      Aktiv

      Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

      PythonLizenz: MIT
      • asr
      • audio
      • chinese
      • emotion-recognition
      • funasr

      githubgemessenes WachstumQuelle öffnen ↗

      20 106GitHub-Sterne+86 (+0.43 %)
    • 14

      Sonstige
      Aktiv

      Apache Superset is a Data Visualization and Data Exploration Platform

      PythonLizenz: Apache-2.0
      • analytics
      • apache
      • apache-superset
      • asf
      • bi

      githubgemessenes WachstumQuelle öffnen ↗

      74 566GitHub-Sterne+103 (+0.14 %)
    • 15

      Sonstige
      Aktiv

      Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.

      PythonLizenz: MIT
      • 2027
      • career
      • computer-science
      • faang
      • h1b

      githubgemessenes WachstumQuelle öffnen ↗

      698GitHub-Sterne+26 (+3.9 %)
    • 16

      App
      Aktiv

      A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

      PythonLizenz: Apache-2.0
      • artificial-intelligence
      • dag
      • data-science
      • data-visualization
      • dataflow

      githubgemessenes WachstumQuelle öffnen ↗

      22 576GitHub-Sterne+81 (+0.36 %)
    • 17

      Agent
      Aktiv

      The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…

      PythonLizenz: Apache-2.0
      • agentops
      • agents
      • ai
      • ai-governance
      • apache-spark

      githubgemessenes WachstumQuelle öffnen ↗

      27 759GitHub-Sterne+78 (+0.28 %)
    • 18

      Sonstige
      Aktiv

      Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries.

      GoLizenz: Apache-2.0
      • build-automation
      • build-pipelines
      • ci
      • ci-cd
      • code-repository

      githubgemessenes WachstumQuelle öffnen ↗

      38 196GitHub-Sterne+72 (+0.19 %)
    • 19

      Sonstige
      Aktiv

      dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

      RustLizenz: Apache-2.0
      • analytics
      • business-intelligence
      • data-modeling
      • dbt-viewpoint
      • elt

      githubgemessenes WachstumQuelle öffnen ↗

      13 750GitHub-Sterne+60 (+0.44 %)
    • 20

      Sonstige
      Aktiv

      LLM speculative inference server for heterogeneous hardware & consumer GPUs

      C++Lizenz: Apache-2.0
      • cuda
      • cuda-kernels
      • dflash
      • heterogeneous-computing
      • kernel

      githubgemessenes WachstumQuelle öffnen ↗

      2 825GitHub-Sterne+37 (+1.3 %)
    • 21

      Bibliothek
      Aktiv

      A software update framework for macOS

      Objective-C
      • framework
      • macos
      • software-update
      • update

      githubgemessenes WachstumQuelle öffnen ↗

      9 613GitHub-Sterne+52 (+0.54 %)
    • 22

      Sonstige
      Aktiv

      Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for…

      PythonLizenz: Apache-2.0
      • agent-framework
      • agentic-ai
      • agentic-rag
      • agents
      • ai

      githubgemessenes WachstumQuelle öffnen ↗

      26 377GitHub-Sterne+60 (+0.23 %)
    • 23

      Sonstige
      Aktiv

      2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.

      Lizenz: MIT
      • careers
      • computer-science
      • hiring
      • internship
      • internships

      githubgemessenes WachstumQuelle öffnen ↗

      93GitHub-Sterne+8 (+9.4 %)
    • 24

      Sonstige
      Aktiv

      Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

      PythonLizenz: Apache-2.0
      • airflow
      • apache
      • apache-airflow
      • automation
      • dag

      githubgemessenes WachstumQuelle öffnen ↗

      46 672GitHub-Sterne+64 (+0.14 %)

    Lern- und Referenzressourcen

    Nach gemessenem Wachstum und quellenübergreifend normalisiert sortiert. Diese Ressourcen bleiben getrennt zugänglich und fließen nicht in die Hauptwertung ein.

    1. 1

      data-engineering-zoomcamp

      Sonstige
      AktivQuelle öffnen ↗

      Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼

      Jupyter Notebook
      • course
      • data-engineering
      • dbt
      • docker
      • free
      githubRessourcegemessenes Wachstum
      45 131GitHub-Sterne+171 (+0.38 %)