Search *

treeverse/lakefs

lakeFS - Data version control for your data lake | Git for data

Scala versions: 2.12 2.11

apache-sparksql data-version-control data-engineering datalake aws-s3 data-quality go lakefs data-lake git-for-data azure-storage object-storage hadoop-filesystem golang apache-spark data-versioning datalakes google-cloud-storage azure-blob-storage

3807 79
whylabs/whylogs-java

Profile and monitor your ML data pipeline end-to-end

Scala versions: 2.12 2.11

whylogs apache-spark calculate-statistics statistics approximate-statistics data-quality java dataset statistical-properties aiops mlops spark ai-pipelines

174 7
piotr-kalanski/data-quality-monitoring

Data Quality Monitoring Tool

Scala versions: 2.11

data-quality monitoring scala spark

16 1
absaoss/spark-data-standardization

A library for Spark that helps to stadardize any input data (DataFrame) to adhere to the provided schema.

Scala versions: 2.13 2.12 2.11

data-structures data-quality schema spark scala

3 7
whylabs/whylogs

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

Scala versions: 2.12

logging calculate-statistics approximate-statistics dataops data-quality ml-pipelines ai-pipelines data-pipeline constraints dataset python mlops model-performance data-science analytics statistical-properties machine-learning data-constraints

2413 278 21

Sorting

Filters

treeverse/lakefs

whylabs/whylogs-java

piotr-kalanski/data-quality-monitoring

absaoss/spark-data-standardization

whylabs/whylogs