Implementation Of StreamingLens Without Changing in Existing Code.

[Rahul Patidar]

Hi, I am Trying to Implement sparklens for streaming Application. I am able to do the same for spark Batch Application by adding below additional line in my batch application spark submit command.

--jars /home/sparklens-0.1.2-s_2.11.jar
--conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener
--conf spark.sparklens.reporting.disabled=true

Without Changing anything in code.

now I am trying to do the same with my streaming Applications also and using --jars /path/to/spark-streaminglens_2.11-0.5.3.jar
this jar in spark-submit command. Can someone kindly suggest if is there any way to run the same without changing anything in code.

//all Imports

object StreamApp {

def main(args: Array[String]): Unit = {

//SparkSession With sparklens Properties
val spark = SparkSession
.builder()
.appName("SparkLence_With_Spark_Submit")
.getOrCreate()

  // code for streaming Application

  }
  }

[Rahul Patidar]

Closing as Added #74 with More details here.