apache/spark   3.5.2

Apache Spark - A unified analytics engine for large-scale data processing

apache/predictionio   0.9.6

PredictionIO, a machine learning server for developers and ML engineers.

microsoft/synapseml   1.0.5

Simple and Distributed Machine Learning

delta-io/delta   3.2.0

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

apache/flink   1.20.0

Apache Flink

bigdatagenomics/adam   0.23.0

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

h2oai/sparkling-water   2.4.13

Sparkling Water provides H2O functionality inside Spark cluster

nvidia/spark-rapids   23.12.2

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

delta-io/delta-sharing   1.2.0

An open protocol for secure data sharing

touk/nussknacker   1.16.3

Low-code tool for automating actions on real time data | Stream processing for the users.

yotpoltd/metorikku   0.0.156

A simplified, lightweight ETL Framework based on Apache Spark

microsoft/hyperspace   0.4.0

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

hydrospheredata/mist   0.6.4

Serverless proxy for Spark cluster

setl-framework/setl   1.0.0-SNAPSHOT

A simple Spark-powered ETL framework that just works 🍺

sparkling-graph/sparkling-graph   0.0.7

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

51zero/eel-sdk   1.2.4

Big Data Toolkit for the JVM

clustering4ever/clustering4ever   0.11.0

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

apache/samza   1.2.0

Mirror of Apache Samza

hablapps/doric   0.0.7

Type safety for spark columns

swoop-inc/spark-records   3.0.1

Bulletproof Apache Spark jobs with fast root cause analysis of failures.