Spark Exasol Connector

Build Status Maven Central – The Spark Exasol Connector

Quality Gate Status

Security Rating Reliability Rating Maintainability Rating Technical Debt

Code Smells Coverage Duplicated Lines (%) Lines of Code

spark-exasol-connector logo

Overview

Spark Exasol Connector (SEC) supports an integration between Exasol and Apache Spark. It allows creating Spark DataFrame from Exasol queries and saving Spark DataFrame as an Exasol table.

Features

  • Creates Spark DataFrame from Exasol query results
  • Saves Spark DataFrame to an Exasol table
  • Allows configuring the Spark tasks for parallel connection
  • Supports Spark DataFrame column pruning and filter push down

Spark Streaming

At the moment, Spark Exasol Connector does not support integration with Spark Streaming. Please check out the Spark regular JDBC integration.

Information for Users

Information for Contributors