rayokota / PregelPlus

open-source Pregel implementation with optimizations to reduce communication cost and eliminate skewness in communication.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

PregelPlus: A Distributed Graph Computing Framework with Effective Message Reduction

Pregel+ is not just another open-source Pregel implementation, but a substantially improved distributed graph computing system with effective message reduction. Compared with existing Pregel-like systems, Pregel+ provides simpler programming interface and yet achieves higher computational efficiency. We give ample examples and detailed tutorials to demonstrate how to program in Pregel+ and deploy Pregel+ in a distributed environment. Pregel+ is also a better choice for researchers who want to change the system to support new functionalities, as the design of Pregel+ is much simpler and more flexible than most other Pregel-like systems.

Pregel+ supports two effective message reduction techniques: (1)vertex mirroring and (2)a new request-respond paradigm. These techniques not only reduce the total number of messages exchanged through the network, but also bound the number of messages sent/received by any vertex, especially for processing power-law graphs and (relatively) dense graphs.

Project Website

http://www.cse.cuhk.edu.hk/pregelplus/

License

Copyright 2018 Husky Data Lab, CUHK

About

open-source Pregel implementation with optimizations to reduce communication cost and eliminate skewness in communication.


Languages

Language:C++ 99.4%Language:C 0.5%Language:Makefile 0.1%