Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extension drops platform report metrics under certain conditions #334

Closed
2 tasks done
lahsivjar opened this issue Oct 20, 2022 · 1 comment
Closed
2 tasks done

Extension drops platform report metrics under certain conditions #334

lahsivjar opened this issue Oct 20, 2022 · 1 comment
Assignees
Labels
aws-λ-extension AWS Lambda Extension bug Something isn't working
Milestone

Comments

@lahsivjar
Copy link
Contributor

lahsivjar commented Oct 20, 2022

APM AWS Lambda extensiom version (1.1.0 as well as current main):

Describe the bug

To Reproduce
Steps to reproduce the behavior:

  1. Run a lambda function along with the extension.
  2. Invoke the function a bunch of times.
  3. Observe cloudwatch logs for a warning message report event request id didn't match the previous event id.
  4. Observe the number of metrics with faas.billed_duration : * to be equal to number of invocations - number of coldstarts.

Expected behavior
Extension doesn't drop platform report metrics and sends it to APM-Server.

Provide logs (if relevant):

Screenshot 2022-10-20 at 12 40 10 PM

^ Logs from cloudwatch showing dropped platform reports (the logs is observed using a lambda extension from a dev branch)
@lahsivjar lahsivjar added the bug Something isn't working label Oct 20, 2022
@github-actions github-actions bot added the aws-λ-extension AWS Lambda Extension label Oct 20, 2022
@AlexanderWert
Copy link
Member

@lahsivjar Also in case that a function is only called once per lifetime (so every request is a cold start) lambda metrics get lost completely. With this issue we should also make sure that cached data is flushed when the Lambda runtime is going to be shut down.

@simitt simitt added this to the 8.7 milestone Nov 21, 2022
@lahsivjar lahsivjar changed the title Extension will drop platform report metrics if the metrics is reported in a future invocation Extension drops platform report metrics under certain conditions Nov 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
aws-λ-extension AWS Lambda Extension bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants