qubole / sparklens

Qubole Sparklens tool for performance tuning Apache Spark

Home Page:http://sparklens.qubole.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Decouple reporting from spark-app

beriaanirudh opened this issue · comments

Right now, the simulations are run in the spark-app. This may add penalty to the app runtime.

By de-coupling simulation we can also get the additional advantage of running simulations independently on any previously-run-app. This is also a goal of de-coupling.

Merged to master 374bb8e