Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Align RDataSource cleanup routine with other sources #17961

Merged
merged 1 commit into from
Mar 17, 2025

Conversation

vepadulano
Copy link
Member

The call to cleanup routines was introduced in commit 0a719b4

The commit description informs it was done to avoid having setup and teardown routines called multiple times for the same column. In single-thread processing, the concept of one task is the processing of the entire computation graph for that run. As such, CleanupTask is called in RunTreeReader and RunEmptySource at the end of the function. In the case of RunDataSource, this routine is called in-between every event range processing. This commit aligns the RunDataSource logic with the logic of the other two single-thread processing methods, i.e. CleanupTask is now called at the end of the run.

Part 6 of N for #17895

Copy link

github-actions bot commented Mar 12, 2025

Test Results

    20 files      20 suites   5d 5h 43m 22s ⏱️
 2 726 tests  2 726 ✅ 0 💤 0 ❌
52 636 runs  52 636 ✅ 0 💤 0 ❌

Results for commit d438fbd.

♻️ This comment has been updated with latest results.

Copy link
Contributor

@martamaja10 martamaja10 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you Vincenzo, it makes sense to have this logic unified across all the single-thread processing methods.

The call to cleanup routines was introduced in commit
root-project@0a719b4

The commit description informs it was done to avoid having setup and teardown
routines called multiple times for the same column. In single-thread processing, the concept
of one task is the processing of the entire computation graph for that run. As such, CleanupTask
is called in RunTreeReader and RunEmptySource at the end of the function. In the case of
RunDataSource, this routine is called in-between every event range processing. This commit aligns
the RunDataSource logic with the logic of the other two single-thread processing methods, i.e.
CleanupTask is now called at the end of the run.
@vepadulano vepadulano force-pushed the rdf-move-cleanuptask branch from 704fafd to d438fbd Compare March 13, 2025 10:13
@vepadulano vepadulano merged commit 3385cf8 into root-project:master Mar 17, 2025
36 of 44 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants