carlosescura / spark-history-server-helm

Spark history server Helm Chart

Spark history server Helm Chart

SHS Spark History Server is the web UI for completed and running Spark applications.

Chart Details

This chart uses AWS K8s IRSA technology to authenticate against AWS, so a proper ServiceAccount needs to be specified in order to have the right permissions accessing application logs S3 bucket.

Installing the Chart

To install the chart:

helm install --set app.S3logPath=yourBucketName/eventLogFoloder

Required variables

Minimum required variables are:

Parameter	Required	Description	Example
S3logPath	yes	S3 bucket and key used as base directory for Spark Application logs	mybucket/logs
serviceAccount.name	yes	Service account used to run the deployment. Needs to have the appropiate IRSA role associated in order to access S3	sparkSA