couler-proj / couler

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Home Page:https://couler-proj.github.io/couler/index.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Separate template definition from `run_x` functions

moshewe opened this issue · comments

Summary

I was trying to implement a simple map-reduce workflow, e.g. this.
Digging through the code I've found that currently couler copies over step args into template inputs, basically fusing them together and making use of withParam as per the linked example impossible.

I suggest separating template creation and run_x functions such that these function will know how to handle a given template or create one on the fly as is done today.

Use Cases

Any workflow that requires a template to define its arguments independent of step.

Message from the maintainers:

Impacted by this bug? Give it a 👍. We prioritize the issues with the most 👍.