Data engineering

Measured catalogue entries in Data engineering.

129 measured catalogue entriesSnapshot measured Oct 20, 2026Sort: Momentum

Refine this view

Language
Any language

Measured resources

Page 9 of 13

  1. flink-cdc

    OtherActive

    Flink CDC is a streaming data integration tool

    Source
    GitHub
    Language
    Java
    Last activity
    Oct 16, 2026

    Stars6,485Measured · Oct 20, 2026

    Momentum10.97 days · Measured · +0.03% relative change

  2. spug

    OtherActive

    Spug is a lightweight agent-free automatic operation and maintenance platform designed for small and medium-sized enterprises. It integrates host management, host batch execution, host online terminal, file management, application release and deployment, pipelines, online task planning, configuration center, monitoring, alarm and so on.

    Source
    GitHub
    Language
    JavaScript
    Last activity
    Oct 12, 2026

    Stars11,088Measured · Oct 18, 2026

    Momentum10.87 days · Measured · +0.02% relative change

  3. dbt-clickhouse

    OtherActive

    The Clickhouse plugin for dbt (data build tool)

    Source
    GitHub
    Language
    Python
    Last activity
    Oct 20, 2026

    Stars365Measured · Oct 20, 2026

    Momentum8.87 days · Measured · +0.27% relative change

  4. LakeSoul

    LibraryActive

    LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

    Source
    GitHub
    Language
    Rust
    Last activity
    Oct 20, 2026

    Stars3,257Measured · Oct 20, 2026

    Momentum77 days · Measured · +0.03% relative change

  5. spark-operator

    OtherActive

    Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

    Source
    GitHub
    Language
    Python
    Last activity
    Oct 19, 2026

    Stars3,155Measured · Oct 20, 2026

    Momentum77 days · Measured · +0.03% relative change

  6. cube-studio

    OtherActive

    cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，mlops算法链路全流程，算力租赁平台，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU虚拟化，边缘计算，标注平台自动化标注，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库，AI模型市场，支持国产cpu/gpu/npu 昇腾生态，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式

    Source
    GitHub
    Last activity
    Oct 9, 2026

    Stars5,082Measured · Oct 15, 2026

    Momentum6.97 days · Measured · +0.02% relative change

  7. spark-nlp

    OtherActive

    State of the Art Natural Language Processing

    Source
    GitHub
    Language
    Scala
    Last activity
    Oct 14, 2026

    Stars4,160Measured · Oct 20, 2026

    Momentum6.97 days · Measured · +0.02% relative change

  8. aws-sdk-pandas

    OtherActive

    pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

    Source
    GitHub
    Language
    Python
    Last activity
    Oct 18, 2026

    Stars4,123Measured · Oct 20, 2026

    Momentum6.97 days · Measured · +0.02% relative change

  9. docetl

    AgentActive

    A system for agentic LLM-powered data processing and ETL

    Source
    GitHub
    Language
    Python
    Last activity
    Oct 9, 2026

    Stars4,132Measured · Oct 15, 2026

    Momentum6.97 days · Measured · +0.02% relative change

  10. deequ

    OtherActive

    Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

    Source
    GitHub
    Language
    Scala
    Last activity
    Oct 13, 2026

    Stars3,650Measured · Oct 19, 2026

    Momentum6.97 days · Measured · +0.03% relative change