Data radar: libraries and frameworks

Momentum based on available 7-day snapshots for Data: measured with two snapshots, estimated otherwise. Each value shows its own source window. This page reads stored snapshots only.

Radar filters

Tool ranking

Ranked by measured growth, normalized across sources. Raw values keep their source-specific window, shown under each tool; a change requires at least two snapshots from the last 7 days.

  1. 1

    Library
    Active

    SDK for robotics teams to verify the quality of their data used for AI model training.

    PythonLicense: Apache-2.0
    • airflow
    • data-engineering
    • data-pipeline
    • data-quality
    • dataset-curation

    githubmeasured growthOpen source ↗

    217GitHub stars+71 (+48.6 %)
  2. 2

    Library
    UnknownLast commit: unavailable

    Rust implementation of Apache Arrow

    • arrow

    cratesmeasured growthOpen source ↗

    Install cargo add arrow

    17 280 524crates.io downloads over 90 days+256 866 (+1.5 %)
  3. 3

    Library
    UnknownLast commit: unavailable

    DataFusion is an in-memory query engine that uses Apache Arrow as the memory model

    • sql
    • query
    • arrow

    cratesmeasured growthOpen source ↗

    Install cargo add datafusion

    4 754 796crates.io downloads over 90 days+64 216 (+1.4 %)
  4. 4

    Library
    Active

    A software update framework for macOS

    Objective-C
    • framework
    • macos
    • software-update
    • update

    githubmeasured growthOpen source ↗

    9 613GitHub stars+52 (+0.54 %)
  5. 5

    Library
    Active

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    PythonLicense: Apache-2.0
    • automation
    • data
    • data-engineering
    • data-ops
    • data-science

    githubmeasured growthOpen source ↗

    23 741GitHub stars+55 (+0.23 %)
  6. 6

    Library
    UnknownLast commit: unavailable

    Programmatically author, schedule and monitor data pipelines

    • airflow
    • automation
    • dag
    • data
    • orchestration

    pypimeasured growthOpen source ↗

    Install pip install apache-airflow

    1 843 267downloads over 7 days-2 040 184 (-52.5 %)
  7. 7

    Library
    Active

    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

    Python
    • batch-processing
    • data-analytics
    • data-pipelines
    • data-processing
    • dataflow

    githubmeasured growthOpen source ↗

    62 357GitHub stars-30 (-0.05 %)
  8. 8

    Library
    UnknownLast commit: unavailable

    With dbt, data analysts and engineers can build analytics the way engineers build applications.

    pypimeasured growthOpen source ↗

    Install pip install dbt-core

    5 107 126downloads over 7 days-12 397 593 (-70.8 %)
  9. 9

    Library
    UnknownLast commit: unavailable

    Dagster is an orchestration platform for the development, production, and observation of data assets.

    pypimeasured growthOpen source ↗

    Install pip install dagster

    1 743 888downloads over 7 days-691 335 (-28.4 %)
  10. 10

    Library
    UnknownLast commit: unavailable

    DuckDB in-process database

    License: MIT
    • DuckDB
    • Database
    • SQL
    • OLAP

    pypimeasured growthOpen source ↗

    Install pip install duckdb

    11 088 684downloads over 7 days-6 800 618 (-38.0 %)
  11. 11

    Library
    UnknownLast commit: unavailable

    Blazingly fast DataFrame library

    License: MIT
    • dataframe
    • arrow
    • out-of-core

    pypimeasured growthOpen source ↗

    Install pip install polars

    12 080 725downloads over 7 days-3 133 827 (-20.6 %)
  12. 12

    Library
    UnknownLast commit: unavailable

    DataFrame library based on Apache Arrow

    • arrow
    • dataframe
    • query-engine

    cratesmeasured growthOpen source ↗

    Install cargo add polars

    2 686 629crates.io downloads over 90 days-3 892 (-0.14 %)
  13. 13

    Library
    Active

    LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

    JavaLicense: Apache-2.0
    • arrow
    • daft
    • datafusion
    • flink
    • gluten

    githubmeasured growthOpen source ↗

    3 247GitHub starsstable

Learning resources

Ranked by measured growth, normalized across sources. These resources remain available separately and do not take part in the main tool ranking.

  1. 1

    deeplearning4j

    Library
    ActiveOpen source ↗

    Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top…

    JavaLicense: Apache-2.0
    • artificial-intelligence
    • clojure
    • deeplearning
    • deeplearning4j
    • dl4j
    githubResourcemeasured growth
    14 248GitHub stars+5 (+0.04 %)

Page 1 of 1 · 14 entries