Skip to content

Document adaptive_parallelism_strategy #582

@hzxa21

Description

@hzxa21

Link to kernel PR: risingwavelabs/risingwave#20589

This PR adds behavior for jobs with adaptive parallelism.

When set to Full, the job will use all available parallelism;
When set to Bounded(n), the maximum parallelism is limited to n;
When set to Ratio(r), the actual available parallelism will be multiplied by r (rounded down);
The behavior of Auto is currently consistent with Full.
Keep in mind that all parallelism is still subject to the limits of max parallelism and resource groups.

Additionally, the command alter system set adaptive_parallelism_strategy can be used to modify this parameter, and it will update jobs in batches in the background.

Can check with the feature owner @shanicky on the details.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions