Multi-tenant Elastic Resource Quota #48
kaiohenricunha opened this issue · comments
Area
- Scheduler
- Controller
- Helm Chart
- Documents
Other components
No response
What happened?
The current design of the capacity scheduler for elastic quotas doesn't fit a multi-tenant scenario, if I understand it correctly.
If I have the following namespaces:
acme-dev-us-west-2-webhook
acme-dev-us-west-2-kube-janitor
apple-dev-us-west-2-webhook
It would be great if we could configure the "acme" tenant resources to be shared only among namespaces starting with "acme".
What did you expect to happen?
Tenant's resources not shared with other tenants
How can we reproduce it (as minimally and precisely as possible)?
No response
Anything else we need to know?
No response
Kubernetes version
1.28
Scheduler Plugins version
Latest
My 2 cents is that there is no one-size-fit-all quota design. If an ElasticQuota needs to support cross-namespace sharing, there are more areas need to be considered:
- semantics of selector (label selector or regex or mix, etc.)
- how to deal with overlapping selectors
- how it impacts preemption
- ...
If you have a through design and can make it backwards-compatible, I'm happy to review to discuss the next steps.
My 2 cents is that there is no one-size-fit-all quota design. If an ElasticQuota needs to support cross-namespace sharing, there are more areas need to be considered:
semantics of selector (label selector or regex or mix, etc.)
how to deal with overlapping selectors
how it impacts preemption
...
If you have a through design and can make it backwards-compatible, I'm happy to review to discuss the next steps.
Thanks for the ideas. I'll see if I can work on that and submit a PR. Could be an interesting use case.