Make default kubernetes resources configurable
martinhausio opened this issue · comments
We recently upgraded our GKE Autopilot cluster to 1.29 and to our surprise, it is no longer calculating the resource allocation the same way, and the default metaflow resources are now "just a little" too large, resulting in our workflows being rejected.
I found the defaults are configured here, and we also have many ways to configure the resources, but it would be ideal for us to be able to configure the default resources via an environment variable, much the same way we can set the nodeSelector.
Great idea! We would be open to a PR if you would like to submit one!
@savingoyal , I just submitted a quick PR for it! Hope this helps.