Giters

qubole / sparklens

Qubole Sparklens tool for performance tuning Apache Spark

Home Page:http://sparklens.qubole.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

EventLoss analyzer for detecting event loss

mayurdb opened this issue · comments

commented

Loss of critical events like StageEnd, JobEnd, ExecutorAdded, etc leads to inaccurate reports. #56 highlights this problem. We should write an EventLossDetector Analyzer which will detect the event loss and communicate to the user that the report might not be accurate or not show the report altogether.