Arc is an opinionated framework for defining data pipelines which are predictable, repeatable and manageable.
Arc-Jupyter is an interactive Jupyter Notebooks Extenstion for building Arc data pipelines via Jupyter Notebooks.
Provides ElasticsearchExtract and ElasticsearchLoad stages
Provides the DeltaLakeExtract and DeltaLakeLoad stages
Provides the SASExtract stage
Provides the CypherTransform and GraphTransform stages
Provides the DebeziumTransform stage
Provides the XMLExtract and XMLLoad stages
Provides the MongoDBExtract and MongoDBLoad stages
Provides the CassandraExtract, CassandraExecute, and CassandraLoad stages
Creates a list of formatted dates to easily calculate delta processing periods.
Provides KafkaExtract, KafkaLoad and KafkaCommitExecute stages
Provides GeoSpark UDFs functionality to Arc.
arc-dataquality-udf-plugin defines a set of data quality/validation user defined functions.
Plugin to support extract and load using the spark-bigquery-connector