apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

Home Page:https://amoro.apache.org/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Improvement]: Flink optimizer container should be summitted in detached mode when using per-job mode

luoyell opened this issue · comments

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

Run flink optimizer tasks in per-job mode, if the submitted client exits unexpedtedly while the task is running, then the task fails to run due to task manger exceptions, the job manager will hang up and cannot exit

How should we improve?

Add -d to the method of FlinkOptimizerContainer#buildOptimizerStartupArgsString to make the task run in detached mode

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct

@luoyell by the way, flink per-job is deprecated in 1.17.if add -d maybe we need to know job what status in flink