Search *

5 results

treeverse/lakefs

lakeFS - Data version control for your data lake | Git for data

Scala versions: 2.11 2.12

apache-sparksql data-version-control data-engineering datalake aws-s3 data-quality go lakefs data-lake git-for-data azure-storage object-storage hadoop-filesystem golang apache-spark data-versioning datalakes google-cloud-storage azure-blob-storage

3169 71
whylabs/whylogs-java

Profile and monitor your ML data pipeline end-to-end

Scala versions: 2.11 2.12

whylogs apache-spark calculate-statistics statistics approximate-statistics data-quality java dataset statistical-properties aiops mlops spark ai-pipelines

177 7
piotr-kalanski/data-quality-monitoring

Data Quality Monitoring Tool

Scala versions: 2.11

data-quality monitoring scala spark

16 1
absaoss/spark-data-standardization

A library for Spark that helps to stadardize any input data (DataFrame) to adhere to the provided schema.

Scala versions: 2.11 2.12

data-structures data-quality schema spark scala

2 6
whylabs/whylogs

The open standard for data logging

Scala versions: 2.12

logging calculate-statistics approximate-statistics dataops data-quality ml-pipelines ai-pipelines data-pipeline constraints dataset python mlops model-performance data-science analytics statistical-properties machine-learning data-constraints

2072 14