azure/azure-event-hubs-spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

microsoft/mobius

C# and F# language binding and extensions to Apache Spark

chermenin/spark-states

Custom state store providers for Apache Spark

tupol/spark-utils

Basic framework utilities to quickly start writing production ready Apache Spark applications

agile-lab-dev/wasp

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

qubole/streaminglens

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

qubole/s3-sqs-connector

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

catalystcode/streaming-instagram

A library for reading social data from Instagram using Spark Streaming.

catalystcode/streaming-facebook

A library for reading social data from Facebook using Spark Streaming.

ponkin/bloom

Probabilistic data structures java implementation.

catalystcode/streaming-reddit

A library for reading public search results from Reddit using Spark Streaming.

cdapio/cdap

An open source framework for building data analytic applications.