pyspark can use sparklens?
jiemar opened this issue · comments
i have a pyspark program.
spark 2.4.0 , hadoop 3.0.0
use spark-submit --jars sparklens-0.3.2-s_2.11.jar --conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener --conf spark.sparklens.reporting.disabled=true
to submit the pyspark program.
but error accure, anybody know why?
@jiemar Looks like it is some other issue with your code not with sparkLense .can u try to run it without using --jars sparklens-0.3.2-s_2.11.jar --conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener --conf spark.sparklens.reporting.disabled=true and see if it showing same issue or not.