ツールの説明は英語です。
技術ツールレーダー: Data
レーダーフィルター
最近の変化
Of 20 comparable tools in Data Engineering, 20 are increasing, 0 are stable, and 0 are declining. arrow has the largest measured increase: +256866 crates.io downloads over 90 days. These movements describe only changes in metrics collected over the period.
測定期間：2026-08-26〜2026-09-01
ツールランキング
情報源間で正規化した測定済み成長順です。 各値は情報源固有の期間を使用し、変化の算出には7日間で2回以上の測定が必要です。
- 1活動中
End-to-end streaming data platform on AWS: Kafka → Iceberg lake → Kimball model → Athena, orchestrated with Airflow 3. Terraform, Glue PySpark, dbt.
github測定済み成長情報源を開く ↗
106GitHubスター+51 (+92.7 %) - 2活動中
semantica
その他Graph-Native Infrastructure for Context and Accountable AI Systems
github測定済み成長情報源を開く ↗
11 532GitHubスター+698 (+6.4 %) - 3活動中
hflow
ライブラリSDK for robotics teams to verify the quality of their data used for AI model training.
github測定済み成長情報源を開く ↗
217GitHubスター+71 (+48.6 %) - 4活動中
OpenMontage
スキルWorld's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.
github測定済み成長情報源を開く ↗
インストール
git clone https://github.com/calesthio/OpenMontage ~/.claude/skills/OpenMontage52 517GitHubスター+2 213 (+4.4 %) - 517 280 524crates.ioの90日間ダウンロード数+256 866 (+1.5 %)
- 6不明最終コミット：不明
datafusion
ライブラリDataFusion is an in-memory query engine that uses Apache Arrow as the memory model
crates測定済み成長情報源を開く ↗
インストール
cargo add datafusion4 754 796crates.ioの90日間ダウンロード数+64 216 (+1.4 %) - 7活動中
Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI &…
github測定済み成長情報源を開く ↗
インストール
git clone https://github.com/alibaba/open-code-review ~/.claude/skills/open-code-review21 735GitHubスター+316 (+1.5 %) - 8活動中
dify
その他Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
github測定済み成長情報源を開く ↗
154 043GitHubスター+524 (+0.34 %) - 9活動中
Summer 2027 software engineering, data science, AI, quant, product management, and hardware internship postings. Updated daily by Simplify and Pitt CSC.
github測定済み成長情報源を開く ↗
47 002GitHubスター+196 (+0.42 %) - 1064GitHubスター+11 (+20.8 %)
- 11活動中
openobserve
その他Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage…
github測定済み成長情報源を開く ↗
21 594GitHubスター+119 (+0.55 %) - 12活動中
SparkyFitness: Built for Families. Powered by AI. Track food, fitness, water, and health — together.
github測定済み成長情報源を開く ↗
5 713GitHubスター+79 (+1.4 %) - 13活動中
FunASR
MCPOpen-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
github測定済み成長情報源を開く ↗
20 106GitHubスター+86 (+0.43 %) - 14活動中
superset
その他Apache Superset is a Data Visualization and Data Exploration Platform
github測定済み成長情報源を開く ↗
74 566GitHubスター+103 (+0.14 %) - 15活動中
Tech internships & CS jobs tracker - 180 open software engineering internships from 4,300 employer job boards, auto-updated every 30 min with visa-sponsorship and H-1B sponsor data.
github測定済み成長情報源を開く ↗
698GitHubスター+26 (+3.9 %) - 16活動中
marimo
アプリA reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
github測定済み成長情報源を開く ↗
22 576GitHubスター+81 (+0.36 %) - 17活動中
mlflow
エージェントThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models…
github測定済み成長情報源を開く ↗
27 759GitHubスター+78 (+0.28 %) - 18活動中
harness
その他Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries.
github測定済み成長情報源を開く ↗
38 196GitHubスター+72 (+0.19 %) - 19活動中
dbt-core
その他dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
github測定済み成長情報源を開く ↗
13 750GitHubスター+60 (+0.44 %) - 20活動中
lucebox
その他LLM speculative inference server for heterogeneous hardware & consumer GPUs
github測定済み成長情報源を開く ↗
2 825GitHubスター+37 (+1.3 %) - 219 613GitHubスター+52 (+0.54 %)
- 22活動中
haystack
その他Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for…
github測定済み成長情報源を開く ↗
26 377GitHubスター+60 (+0.23 %) - 23活動中
2026–2027 tech internships in the US, updated daily. Software engineering, data science, security, product, and design intern roles.
github測定済み成長情報源を開く ↗
93GitHubスター+8 (+9.4 %) - 24活動中
airflow
その他Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
github測定済み成長情報源を開く ↗
46 672GitHubスター+64 (+0.14 %)
学習・参考リソース
情報源間で正規化した測定済み成長順です。 これらは個別に参照でき、主要ランキングには含まれません。
- 1活動中情報源を開く ↗
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
githubリソース測定済み成長45 131GitHubスター+171 (+0.38 %)