Data Engineering · Bibliothek

Dagster is an orchestration platform for the development, production, and observation of data assets.

Quelle

PyPI

Domänen

Data Engineering

Blazingly fast DataFrame library

Quelle

PyPI

Domänen

Data Engineering

DuckDB in-process database

Quelle

PyPI

Domänen

Data Engineering

Rust implementation of Apache Arrow

Quelle

crates.io

Domänen

Data Engineering

DataFusion is an in-memory query engine that uses Apache Arrow as the memory model

Quelle

crates.io

Domänen

Data Engineering

DataFrame library based on Apache Arrow

Quelle

crates.io

Domänen

Data Engineering, Rust

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

Quelle

GitHub

Sprache

Python

Domänen

Data Engineering

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Quelle

GitHub

Sprache

Python

Domänen

Data Engineering

Einsatzzwecke

Beobachtbarkeit, Workflows

A software update framework for macOS

Quelle

GitHub

Sprache

Objective-C

Domänen

Data Engineering

This project presents a comparative machine learning framework for heart attack risk prediction using Python. It includes data preprocessing, feature engineering, SMOTE for class balancing, cross validation, and performance evaluation of multiple ML models.

Quelle

GitHub

Sprache

Jupyter Notebook

Domänen

Data Engineering