Class MRAutoscalingConfig

Configuration settings for autoscaling the ModelRunner service.

Constructors

new MRAutoscalingConfig(MR_AUTOSCALING_TASK_MAX_COUNT?, MR_AUTOSCALING_TASK_MIN_COUNT?, MR_AUTOSCALING_TASK_OUT_COOLDOWN?, MR_AUTOSCALING_TASK_IN_COOLDOWN?, MR_AUTOSCALING_TASK_IN_INCREMENT?, MR_AUTOSCALING_TASK_OUT_INCREMENT?): MRAutoscalingConfig
Creates an instance of MRAutoscalingConfig.
Parameters
- Optional MR_AUTOSCALING_TASK_MAX_COUNT: number = 40
  The maximum number of tasks allowed in the cluster.
- Optional MR_AUTOSCALING_TASK_MIN_COUNT: number = 3
  The minimum number of tasks required in the cluster.
- Optional MR_AUTOSCALING_TASK_OUT_COOLDOWN: number = 3
  The cooldown period (in minutes) after scaling out tasks.
- Optional MR_AUTOSCALING_TASK_IN_COOLDOWN: number = 1
  The cooldown period (in minutes) after scaling in tasks.
- Optional MR_AUTOSCALING_TASK_IN_INCREMENT: number = 8
  The number of tasks to increment when scaling in.
- Optional MR_AUTOSCALING_TASK_OUT_INCREMENT: number = 8
  The number of tasks to increment when scaling out.
Returns MRAutoscalingConfig
- Defined in lib/osml/model_runner/autoscaling/mr_autoscaling.ts:27

MR_AUTOSCALING_TASK_IN_COOLDOWN: number = 1

The cooldown period (in minutes) after scaling in tasks.

MR_AUTOSCALING_TASK_IN_INCREMENT: number = 8

The number of tasks to increment when scaling in.

MR_AUTOSCALING_TASK_MAX_COUNT: number = 40

The maximum number of tasks allowed in the cluster.

MR_AUTOSCALING_TASK_MIN_COUNT: number = 3

The minimum number of tasks required in the cluster.

MR_AUTOSCALING_TASK_OUT_COOLDOWN: number = 3

The cooldown period (in minutes) after scaling out tasks.

MR_AUTOSCALING_TASK_OUT_INCREMENT: number = 8

The number of tasks to increment when scaling out.