Describe the bug
In autoscaler 1.21.0, a running LLM function with no prior requests has no worker or per-function gateway series. The autoscaler selects ControlPlane and caches it for one hour, so later LLM traffic remains invisible and the function cannot scale correctly.
Steps or code to reproduce bug
- Deploy a new LLM function with
minInstances: 1.
- Wait 2–3 minutes without sending requests.
- Send sustained LLM traffic.
- Observe that the autoscaler continues using ControlPlane metrics and reports 0% utilization.
Expected behavior
Absence-based fallback is re-evaluated after gateway metrics appear, and missing utilization data cannot trigger scale-to-zero.
Additional context
By submitting this issue, you agree to follow our code of conduct and our contributing guidelines.
Describe the bug
In autoscaler 1.21.0, a running LLM function with no prior requests has no worker or per-function gateway series. The autoscaler selects ControlPlane and caches it for one hour, so later LLM traffic remains invisible and the function cannot scale correctly.
Steps or code to reproduce bug
minInstances: 1.Expected behavior
Absence-based fallback is re-evaluated after gateway metrics appear, and missing utilization data cannot trigger scale-to-zero.
Additional context
By submitting this issue, you agree to follow our code of conduct and our contributing guidelines.