qubole / sparklens

Qubole Sparklens tool for performance tuning Apache Spark

Home Page:http://sparklens.qubole.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

SparkLens reporting from event-history files

beriaanirudh opened this issue · comments

After sparklens-9 (de-coupling reporting from spark-app), we should be able to run SparkLens simulations from event-history files as well. This will give 2 advantages:

  1. Older run jobs which didn't have sparkLens, will also profilable.
  2. Usability: User have additional option for profiling: event-history-log files; in addition to in-app and sparkLens files.

Merged to master 2ddf779