aratz-lasa / dgraph_scaler

Distributed Graph Scaler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

dgraph_scaler

Graph dataset scaler that receives an input graph and it scales up or down by any arbitrary factor.

System architecture

The system presents a flat architecture, where all the nodes are homogeneous in configuration and resources. There is no hierarchy. This way, unnecessary complexities in the programming model are avoided. Any node can communicate with any other node. For communication the MPI library is used. This way, the nodes do not need to take care of naming, discovery or higher-level multiplexing abstractions and logic.

alt text

Usage

In order to use the program with MPI the following command is used:

foo@bar:~$ mpirun -np 2 python3.5 main.py datasets/graph.txt  samples/graph 6.5 -v

There are many scaling options. You can check them by running:

foo@bar:~$ python3.5 main.py --help

About

Distributed Graph Scaler

License:MIT License


Languages

Language:Python 100.0%