Search *

9 results

azure/azure-event-hubs-spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Scala versions: 2.12 2.11 2.10

apache-spark streaming azure eventhubs kafka stream scala real-time microsoft spark-streaming bigdata continuous databricks structured-streaming spark apache ingestion connector event-hubs

228 37
streamnative/pulsar-spark

Spark Connector to read and write with Pulsar

Scala versions: 2.12 2.11

structured-streaming apache-spark apache-pulsar flink data-science batch-processing stream-processing spark-sql spark data-processing

103 19
chermenin/spark-states

Custom state store providers for Apache Spark

Scala versions: 2.12 2.11

structured-streaming apache-spark state spark-structured-streaming stateful state-store spark-streaming spark apache

92 3
heartsavior/spark-state-tools

Spark Structured Streaming State Tools

Scala versions: 2.12 2.11

apache-spark structured-streaming

34 2
heartsavior/spark-sql-kafka-offset-committer

Kafka offset committer for structured streaming query

Scala versions: 2.12 2.11

kafka spark structured-streaming

34 3
qubole/streaminglens

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

Scala versions: 2.11

micro-batches structured-streaming streaming sparklens cluster-management spark streaming-pipeline scala spark-streaming sla

18 2
qubole/s3-sqs-connector

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

Scala versions: 2.11

streaming scala spark-streaming s3 structured-streaming spark sqs

16 2
qubole/spark-state-store

Rocksdb state storage implementation for Structured Streaming.

Scala versions: 2.11

structured-streaming streaming real-time-processing scalability spark state-management rocksdb performance qubole

16 3
bdoepf/spark-cassandra-sink

spark-cassandra-sink is a Spark Structured Streaming Sink for cassandra

Scala versions: 2.11

cassandra spark streaming structured-streaming

4 1