derrickoswald / cimspark   2.12-3.0.1-5.1.1

MIT License GitHub

Spark access to Common Information Model (CIM) files

Scala versions: 2.12

CIMSpark

Spark access to Common Information Model (CIM) files. Maven Central

Overview

This project joins the two worlds of the Apache Spark computation model and the Common Information Model (CIM) data model.

A good overview presentation is Network Analysis and Simulation using Apache Spark on Compute Clusters, or without the audio tracks.

Overview

Model

The CIM model as implemented by this software is described in CIM Model and is described in detail in the ScalaDoc.

Functionality

This project has four components covering the following topics:

  • CIMTool to generate Scala and Javascript classes from the Enterprise Architect UML files
  • CIMReader the main component that reads CIM files into Apache Spark RDD data structures
  • CIMExport to generate RDF files from Apache Spark RDD data structures
  • CIMDifference compare CIM files
  • CIMJDBC example server and client JDBC access to CIM files loaded into Apache Spark RDD data structures

Each of these is described more fully in its module README.