Skip to content

Conversation

chrisburr
Copy link
Member

The theory is that the connections are still backing up even while the service is sleeping. If we instead close connections agressively during the throttle period hopefully we'll be able to recover from overload periods more effectively

BEGINRELEASENOTES

*Core
CHANGE: Agressively close connections when serivces are overloaded

For examples look into release.notes

ENDRELEASENOTES

…f blocking

The theory is that the connections are still backing up even while the service is sleeping.
If we instead close connections agressively during the throttle period hopefully we'll be able
to recover from overload periods more effectively
@chrisburr chrisburr marked this pull request as ready for review October 7, 2025 18:32
@fstagni fstagni merged commit 385b299 into DIRACGrid:integration Oct 8, 2025
25 checks passed
@DIRACGridBot DIRACGridBot added the sweep:ignore Prevent sweeping from being ran for this PR label Oct 8, 2025
@chrisburr
Copy link
Member Author

Running with this has definitely been better than before, if still not ideal. Fundamentally the DIRAC model of assigning a thread per active RPC call isn't ideal but that isn't going to be fixed.

If anyone else struggles with this, increasing the number of threads used by the service seems to have helped.

@chrisburr chrisburr deleted the fix/better-throttle branch October 8, 2025 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sweep:ignore Prevent sweeping from being ran for this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants