sergiimk / GeoSpark

A Cluster Computing System for Processing Large-Scale Spatial Data

Home Page:http://datasystemslab.github.io/GeoSpark

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

GeoSpark Logo

Stable Latest Source code
Maven Central with version prefix filter Sonatype Nexus (Snapshots) Build Status

GeoSpark@Twitter || GeoSpark Discussion Board || Join the chat at https://gitter.im/geospark-datasys/Lobby || HitCount(since Jan. 2018)

GeoSpark is a cluster computing system for processing large-scale spatial data. GeoSpark extends Apache Spark / SparkSQL with a set of out-of-the-box Spatial Resilient Distributed Datasets (SRDDs)/ SpatialSQL that efficiently load, process, and analyze large-scale spatial data across machines.

GeoSpark contains three modules:

Name API Spark compatibility Dependency
GeoSpark-core RDD Spark 2.X/1.X Spark-core
GeoSpark-SQL SQL/DataFrame SparkSQL 2.1 and later Spark-core, Spark-SQL, GeoSpark-core
GeoSpark-Viz RDD Spark 2.X/1.X Spark-core, GeoSpark-core
  • Core: GeoSpark SpatialRDDs and Query Operators.
  • SQL: SQL interfaces for GeoSpark core.
  • Viz: Visualization extension of GeoSpark core.

GeoSpark development team has published four papers about GeoSpark. Please read Publications.

GeoSpark received an evaluation from PVLDB 2018 paper "How Good Are Modern Spatial Analytics Systems?" Varun Pandey, Andreas Kipf, Thomas Neumann, Alfons Kemper (Technical University of Munich), quoted as follows:

GeoSpark comes close to a complete spatial analytics system. It also exhibits the best performance in most cases.

Please visit GeoSpark website for details and documentations.

News!

  • The full research paper of GeoSpark has been accepted by Geoinformatica Journal. This paper has over 40 pages to dissect GeoSpark in details and compare it with many other existing systems such as Magellan, Simba, and SpatialHadoop.
  • GeoSpark 1.1.3 is released. This release contains a critical bug fix for GeoSpark-core RDD API. Release notes || Maven Coordinate.
  • GeoSpark 1.1.2 is released. This release contains several bug fixes. Thanks for the patch from Lucas C.! Release notes || Maven Coordinate.

About

A Cluster Computing System for Processing Large-Scale Spatial Data

http://datasystemslab.github.io/GeoSpark

License:Apache License 2.0


Languages

Language:Java 83.9%Language:Scala 16.1%