Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JVM Instability with DD_PROFILING_DDPROF_ENABLED=true #8607

Open
RyosukeFukushima opened this issue Mar 24, 2025 · 0 comments
Open

JVM Instability with DD_PROFILING_DDPROF_ENABLED=true #8607

RyosukeFukushima opened this issue Mar 24, 2025 · 0 comments

Comments

@RyosukeFukushima
Copy link

Tracer Version(s)

1.46.1

Java Version(s)

17.0.14

JVM Vendor

Amazon Corretto

Bug Report

When setting DD_PROFILING_DDPROF_ENABLED=true, the JVM becomes unstable. Here are the details:

  • When checking profiles for allocation, com/datadog/profiling/controller/openjdk/events/SmapEntryFactory.java and java/util/regex/Matcher.java used within it occupy a large portion (see attached image).
  • The buffer pool is heavily consumed, with jvm.buffer_pool.direct.capacity reaching three times the usual amount.
  • Minor GC stops occurring.
  • The Eden space does not decrease.
  • The Datadog Profiling uploader slows down.
  • Before the server stops functioning, the profile upload to Datadog ceases.
  • The issue is resolved when DD_PROFILING_DDPROF_ENABLED is set to false.
Image

I suspect that the following regular expression might be causing poor performance depending on the input string:

Expected Behavior

The JVM should remain stable when DD_PROFILING_DDPROF_ENABLED=true is set, without excessive buffer pool consumption or halted minor GC.

Reproduction Code

The exact steps to reproduce this issue are unclear. Even when running multiple instances concurrently, the issue appears in some instances but not others.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants