apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

Home Page:https://datafusion.apache.org/ballista

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Setting job name is not reflected in the Web UI

jamesmcm opened this issue · comments

Describe the bug

I'm setting the job name with:

    let start = SystemTime::now();
    let since_the_epoch = start
        .duration_since(UNIX_EPOCH)
        .expect("Time went backwards");

    let n: usize = 10;
    let job_name = format!("top_{}_{}", n, since_the_epoch.as_secs());

    let config = BallistaConfig::builder()
        .set("ballista.job.name", &job_name)
        .build()?;

But it isn't shown in the Web UI (None is shown as the job name).

This is the same both locally and in a GKE cluster.

To Reproduce

Run a job with the above config.

Expected behavior

The job name should appear in the Web UI

Additional context

It seems the relevant code is

pub const BALLISTA_JOB_NAME: &str = "ballista.job.name";
but I can't see anything wrong.