wanesta / Simrank

spark-simrank scala

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Simrank

spark-simrank   scala This project based on spark-2.0.2-with-hive. You can start run.sh to run Jar file with spark-submit.Attention that parameters to start spark. They are: --num-executors 200 --driver-memory 20G --executor-memory 10G --executor-cores 8 --master yarn

I use maven to build the project in IDEA with scala. Data file in data path.

About

spark-simrank scala


Languages

Language:Scala 92.3%Language:Shell 7.7%