Skip to content
This repository has been archived by the owner on Apr 24, 2023. It is now read-only.

improvement: Introduce the idea of GangScaling #259

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

improvement: Introduce the idea of GangScaling #259

wants to merge 2 commits into from

Conversation

k-simons
Copy link
Contributor

@k-simons k-simons commented Apr 12, 2023 •
edited
Loading

  • Right now we require every executor and driver to be able to be scheduled before scheduling anything. This is the basis of the idea of gang scheduling.
  • I contend that gang scheduling doesn't actually provide value and can actually be distilled down into 2 core characteristics:
  1. Zonal scheduling is preserved
  2. Starvation isn't possible (which I am calling gang scaling)

Before this PR

After this PR

==COMMIT_MSG==
==COMMIT_MSG==

Possible downsides?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
autorelease merge when ready
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@k-simons