qubole / sparklens

Qubole Sparklens tool for performance tuning Apache Spark

Home Page:http://sparklens.qubole.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Mismatch in Driverclock time in notbook function and report via sparkjson file

m0n1sh opened this issue · comments

Hi Devs,
I'm facing the issue where the stats from notebook is correct and the data generated using the sparklens json file is incorrect.Driver Wallclock is the metric that is incorrect. kindly help in identifying the root cause.

Also when we configure the mail for report in spark properties, we get response saying invalid email in logs but that was not the case.

Thanks for this useful tool and your contributions.

Email Generated report.
http://sparklens.qubole.com/report_view/57d06225b494129c1d7e

https://qubole.zendesk.com/attachments/token/WryOmr9vyPJ4VDml6blVq1EOY/?name=aspark-application-1652854543439.sparklens.json

https://qubole.zendesk.com/attachments/token/83WCvC8hria7mT64Q7vc6l9ex/?name=notebook+report