agile-lab-dev/wasp   3.0.1

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

fsanaulla/chronicler-spark   0.6.0

InfluxDB connector to Apache Spark on top of Chronicler

sansa-stack/archived-sansa-inference   0.7.1

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

fsanaulla/chronicler   0.7.2

Scala toolchain for InfluxDB

sansa-stack/archived-sansa-owl   0.7.1

SANSA Stack OWL (Web Ontology Language) API

alonsodomin/sbt-spark   0.6.0

Simple SBT plugin to configure Spark applications

timgent/data-flare   3.2.0_0.1.14

Data quality control tool built on spark and deequ

locationtech/rasterframes   0.11.1

Geospatial Raster support for Spark DataFrames

absaoss/pramen   1.0.1

Resilient data pipeline framework running on Apache Spark

pierrenodet/spark-ensemble   0.9.1

Ensemble Learning for Apache Spark 🌲

whylabs/whylogs-java   0.1.3

Profile and monitor your ML data pipeline end-to-end

isarn/isarn-sketches-spark   0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

arcizon/spark-filetransfer   0.3.0

API for reading and writing data via various file transfer protocols from Apache Spark.

kotlin/kotlin-spark-api   1.2.4

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

romans-weapon/spear-framework   3.1.1-3.0

Rapid ETL/ELT-connectors/pipeline development leveraged on top of Apache Spark

florentf9/sparkml-som   0.2

:sparkles: Spark ML implementation of SOM algorithm (Kohonen self-organizing map)

woltapp/spark-osm-datasource   0.3.0

Native Spark OSM PBF data source

s22s/pre-lt-raster-frames   0.6.1

Spark DataFrames for earth observation data

qubole/streaminglens   0.5.3

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines