qubole/streaminglens   0.5.3

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

piotr-kalanski/data-quality-monitoring   0.3.8

Data Quality Monitoring Tool

getsentry/sentry-spark   0.0.1-alpha04

Apache Spark Sentry Integration

hammerlab/spark-util   3.1.0

low-level helpers for Apache Spark libraries and tests

derrickoswald/cimspark   2.12-3.0.1-5.1.1

Spark access to Common Information Model (CIM) files

qubole/s3-sqs-connector   0.5.1

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

jtnystrom/discount   3.0.1

Very large scale k-mer counting and analysis on Apache Spark.

fqaiser94/mse   0.2.4

Make Structs Easy (MSE)

absaoss/spark-hofs   0.5.0

Scala API for Apache Spark SQL high-order functions

qubole/spark-state-store   1.0.0

Rocksdb state storage implementation for Structured Streaming.

zuinnote/spark-hadoopcryptoledger-ds   1.3.2

A Spark datasource for the HadoopCryptoLedger library

data-tools/big-data-types   1.3.5

A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.

derrickburns/generalized-kmeans-clustering   1.2.2

Spark library for generalized K-Means clustering. Supports general Bregman divergences. Suitable for clustering probabilistic data, time series data, high dimensional data, and very large data.

phymbert/spark-search   0.2.0

Spark Search - high performance advanced search features based on Apache Lucene

tupol/spark-tools   0.4.1

Executable Apache Spark Tools: Format Converter & SQL Processor

housepower/clickhouse-native-jdbc   2.7.1

ClickHouse Native Protocol JDBC implementation

coxautomotivedatasolutions/vegalite4s   0.4

Vega-Lite4s is a small library over the comprehensive Vega-Lite Javascript visualisation library, allowing you to create beautiful Vega-Lite visualisations in Scala

absaoss/hermes   0.3.3

A E2E test tool for Enceladus. Also general dataframe comparison tool

lewuathe/dllib   0.0.11

dllib is a distributed deep learning library running on Apache Spark

pierrenodet/aruku   0.1.0

A Random Walk Engine for Apache Spark