Increase stable-window
cyrildiagne opened this issue · comments
Cyril Diagne commented
The default 30s grace period of Knative is too short in comparison to the time most CUDA based services take to boot.
A few minutes would make more sense: https://knative.dev/docs/serving/configuring-autoscaling/