sansa-stack/archived-sansa-inference   0.7.1

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

fsanaulla/chronicler   0.7.2

Scala toolchain for InfluxDB

absaoss/pramen   1.0.1

Resilient data pipeline framework running on Apache Spark

sansa-stack/archived-sansa-owl   0.7.1

SANSA Stack OWL (Web Ontology Language) API

alonsodomin/sbt-spark   0.6.0

Simple SBT plugin to configure Spark applications

pierrenodet/spark-ensemble   0.9.1

Ensemble Learning for Apache Spark 🌲

locationtech/rasterframes   0.11.1

Geospatial Raster support for Spark DataFrames

timgent/data-flare   3.2.0_0.1.14

Data quality control tool built on spark and deequ

whylabs/whylogs-java   0.1.3

Profile and monitor your ML data pipeline end-to-end

isarn/isarn-sketches-spark   0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

arcizon/spark-filetransfer   0.3.0

API for reading and writing data via various file transfer protocols from Apache Spark.

florentf9/sparkml-som   0.2

:sparkles: Spark ML implementation of SOM algorithm (Kohonen self-organizing map)

kotlin/kotlin-spark-api   1.2.4

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

derrickoswald/cimspark   2.12-3.0.1-5.1.1

Spark access to Common Information Model (CIM) files

romans-weapon/spear-framework   3.1.1-3.0

Rapid ETL/ELT-connectors/pipeline development leveraged on top of Apache Spark

woltapp/spark-osm-datasource   0.3.0

Native Spark OSM PBF data source

s22s/pre-lt-raster-frames   0.6.1

Spark DataFrames for earth observation data

qubole/streaminglens   0.5.3

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

qubole/s3-sqs-connector   0.5.1

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).