xyxiaoyou / geode-spark-connector

This is a fork of the Apache Geode spark connector from tags/rel/v1.1.1 - the intent is to update it to a current version of scala and geode / gemfire. This project is open source and if you would like to contribute feel free to open a pull request.

Spark Geode Connector

Spark Geode Connector let's you connect Spark to Geode, expose Geode regions as Spark RDDs, save Spark RDDs to Geode and execute Geode OQL queries in your Spark applications and expose the results as DataFrames.

Features:

• Expose Geode region as Spark RDD with Geode server-side filtering
• RDD join and outer join Geode region
• Save Spark RDD to Geode
• Save DStream to Geode
• Execute Geode OQL and return DataFrame

Version and Compatibility

Spark Geode Connector supports Spark 2.3.

Documentation

• Building and testing
• Quick start
• Connect to Geode
• Loading data from Geode
• RDD Join and Outer Join Geode Region
• Saving RDD to Geode
• Saving DStream to Geode
• Geode OQL
• Using Connector in Java
• About the demos

License: Apache License 2.0