Skip to content

Improve Evenscheduler to schedule executors based supervisor used slots - #673

Open
fxjwind wants to merge 3 commits into
nathanmarz:masterfrom
fxjwind:even-schedule
Open

Improve Evenscheduler to schedule executors based supervisor used slots#673
fxjwind wants to merge 3 commits into
nathanmarz:masterfrom
fxjwind:even-schedule

Conversation

@fxjwind

@fxjwind fxjwind commented Sep 4, 2013

Copy link
Copy Markdown
  • fix wrong comment
  • improve the logic of sort-slots #359

@patricioe

Copy link
Copy Markdown

Is this solving the problem of no allocating evenly based on currently used slots?

In my case, rebalance command keeps on sending the worker to the same machine instead of the one of all free slots.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the test data here actually violates the worker number constraints, you specified the worker number to 4 for topology1, but here it is assigned 6 different workers.

@fxjwind

fxjwind commented Oct 8, 2013

Copy link
Copy Markdown
Author

@xumingming , thanks for your comments, have already updated

@fxjwind

fxjwind commented Oct 8, 2013

Copy link
Copy Markdown
Author

@patricioe , you are right, this fix will choose supervisor with less workers(used-slots) preferentially.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants