Search *

172 results

apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

Scala versions: 2.13 2.12 2.11 2.10

sql jdbc big-data java spark scala python r

37304 4133 333
microsoft/synapseml

Simple and Distributed Machine Learning

Scala versions: 2.12 2.11

deep-learning databricks apache-spark onnx lightgbm azure cognitive-services opencv big-data data-science spark ai microsoft machine-learning ml pyspark synapse scala http model-deployment

4873 100
spark-jobserver/spark-jobserver

REST job server for Apache Spark

Scala versions: 2.11 2.10

rest-api scala spark spark-jobserver

2833 112
delta-io/delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Scala versions: 2.13 2.12 2.11

big-data delta-lake spark acid analytics

6534 273
johnsnowlabs/spark-nlp

State of the Art Natural Language Processing

Scala versions: 2.12 2.11

nlp question-answering llm text-classification sentiment-analysis spell-checker part-of-speech-tagger pyspark entity-extraction lemmatizer language-detection named-entity-recognition machine-translation tensorflow language-model transformers spark albert bert natural-language-processing

3514 85
salesforce/transmogrifai

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Scala versions: 2.11

einstein structured-data features sparkml transformers spark transmogrify automated-machine-learning pipelines ml transformations feature-engineering scala estimators transmogrification ai machine-learning dsl salesforce automl

2220 44
zio/zio-quill

Compile-time Language Integrated Queries for Scala

Scala versions: 3.x 2.13 2.12 2.11

Scala.js versions: 1.x 0.6

jdbc cassandra sparksql spark scala mysql database linq postgres scalajs

2134 115
datastax/spark-cassandra-connector

DataStax Connector for Apache Spark to Apache Cassandra

Scala versions: 2.13 2.12 2.11 2.10

cassandra scala spark

1921 93
almond-sh/almond

A Scala kernel for Jupyter

Scala versions: 3.x 2.13 2.12 2.11

jupyter-kernels repl jupyter-notebook spark-sql scala spark jupyter

1554 37
apache/kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

Scala versions: 2.13 2.12

sql kubernetes hacktoberfest jdbc spark hive thrift data-lake hadoop spark-sql

1795 157
combust/mleap

MLeap: Deploy ML Pipelines to Production

Scala versions: 2.12 2.11 2.10

scikit-learn tensorflow data-pipelines transformers spark scala python

1481 19 71
redislabs/spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster

Scala versions: 2.12 2.11

dataframe java redis spark

929 18
typelevel/frameless

Expressive types for Spark.

Scala versions: 2.13 2.12 2.11

functional-programming fp spark scala typelevel

865 49
bigdatagenomics/adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

Scala versions: 2.12 2.11 2.10

parquet genomics big-data java avro spark scala python r bioinformatics

960 67
tibcosoftware/snappydata

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

Scala versions: 2.11 2.10

scale spark stream snappydata transaction analytics memory-database

1040 42
mrpowers/spark-daria

Essential Spark extensions and helper methods ✨😲

Scala versions: 2.13 2.12 2.11

dataframe spark

738 14
h2oai/sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

Scala versions: 2.12 2.11 2.10

rsparkling integration big-data pysparkling pyspark spark scala h2o machine-learning

956 75 45
frees-io/freestyle

A cohesive & pragmatic framework of FP centric Scala libraries

Scala versions: 2.12 2.11

Scala.js versions: 0.6

functional-programming architectural-patterns free-monads monads cassandra tagless-final kafka spark scala redis freestyle rpc

612 35
lucacanali/sparkmeasure

This is the development repository for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task and stage metrics data.

Scala versions: 2.13 2.12 2.11

apache-spark performance-metrics performance-troubleshooting spark scala python

603 11
delta-io/delta-sharing

An open protocol for secure data sharing

Scala versions: 2.13 2.12

data-sharing big-data delta-lake spark pandas

648 110 29

1 (current)
2
3
4
5
6
7
8
9