Open
Description
Is your feature request related to a problem or challenge?
PR #16398 revised the cooperative scheduling support in DataFusion to make use of Tokio's task budget system. This was implemented using the API that's available in the version of Tokio that was available at the time of writing. PR tokio-rs/tokio#7405 in Tokio (if it gets merged) will make some additional API public that allows the DataFusion logic to be refined.
Describe the solution you'd like
When/if the Tokio PR lands and is released, the currently disabled code at https://github.com/apache/datafusion/blob/main/datafusion/physical-plan/src/coop.rs#L140 can be made the default implementation. The datafusion_coop
config attribute can probably be removed at that point in time as well.
Describe alternatives you've considered
No response
Additional context
No response