-
Notifications
You must be signed in to change notification settings - Fork 975
Run cudf-polars wheels unit tests with more than 1 process #20124
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Run cudf-polars wheels unit tests with more than 1 process #20124
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks fine. Please report the before/after times.
|
||
|
||
@pytest.fixture(autouse=True) | ||
@pytest.fixture(scope="session", autouse=True) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we add a note about why session scope here is important here?
Here's the raw pytest run times comparing the CUDA 12.9 cudf_polars wheels test CI job f4554de from this branch to the same job in #20141 as Before (#20141)
After (f4554de)
The overall job time has decreased from ~43 minutes to ~22 minutes. |
That's great! Glad to see parallelism getting us enough improvement here to keep this as is. |
/merge |
449173c
into
rapidsai:branch-25.12
Description
Follow up to #19980
Checklist