Request queuing policy (Preview)

A workload group's request queuing policy controls queuing of requests for delayed execution, once a certain threshold of concurrent requests is exceeded.

Queuing of requests can reduce the number of throttling errors during times of peak activity. It does so by queuing incoming requests up to a predefined short time period, while polling for available capacity during that time period.

The policy may be defined only for workload groups with a request rate limit policy that limits the max concurrent requests at the scope of the workload group.

Use the .alter-merge workload group management command to enable request queuing.

The policy object

The policy includes a single property:

  • IsEnabled: A boolean indicating if the policy is enabled. The default value is false.