[CI] AutodetectMemoryLimitIT testTooManyPartitions failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic-platform-support #9899 / rocky-8_platform-support-unix
• elasticsearch-periodic-platform-support #9815 / rocky-8_platform-support-unix

Reproduction Line:

./gradlew ":x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest" --tests "org.elasticsearch.xpack.ml.integration.AutodetectMemoryLimitIT.testTooManyPartitions" -Dtests.seed=F37F913239C5DEB6 -Dtests.locale=dsb-Latn-DE -Dtests.timezone=America/Anchorage -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Expected: a value less than <50300000L>
     but: <50470912L> was greater than <50300000L>

Issue Reasons:

• [main] 2 failures in test testTooManyPartitions (0.3% fail rate in 617 executions)
• [main] 2 failures in step rocky-8_platform-support-unix (15.4% fail rate in 13 executions)
• [main] 2 failures in pipeline elasticsearch-periodic-platform-support (15.4% fail rate in 13 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/ml-core (Team:ML)

[davidkyle]

Appears to be due to elastic/ml-cpp#2846