chore(dev): add multiservice opentelemetry trace e2e test by tessneau · Pull Request #26554 · vectordotdev/vector

tessneau · 2026-10-06T12:38:13Z

Summary

Adds a manual OpenTelemetry trace test using the opentelemetry-demo app to Vector's e2e harness.

The existing opentelemetry-traces e2e test uses telemetrygen, which we could extend to cover more trace cases. However this app produced traces by multiple language SDKs and instrumentation libraries, so we get more varied and realistic input.

The main goal is to use this test against PRs against during the trace data model migration (see Trace data model RFC) so that we get the added confidence. This and the heavier application setup (23 services, ~25 min CI run) is why I've kept it manually triggered for now, since I'm not sure you'd want to run this continuously in CI.

Here's the test's architecture:

See the README for details.

References

Related: Trace data model RFC.

Vector configuration

How did you test this PR?

Ran both HTTP and gRPC locally with:

cargo vdev e2e run opentelemetry-traces-multiservice --retries 0 --always-show-logs

The manually triggered CI run passed on the latest commit

HTTP: 785 spans, 89 traces
gRPC: 780 spans, 88 traces
Both covered all required services with zero input/output differences

The tests currently takes ~ 25min. Looking into one more change to make it run more quickly in 6cf6484 but this shouldn't change the core

Does this PR include user facing changes?

Yes. Please add a changelog fragment based on our guidelines.
No. A maintainer will apply the no-changelog label to this PR.

Contributor Guidelines

Please read our Vector contributor resources.
Do not hesitate to use @vectordotdev/vector to reach out to us regarding this PR.
Before pushing, follow our pre-push guidance.
After a review is requested, please avoid force pushes to help us review incrementally.
- Feel free to push as many commits as you want. They will be squashed into one before merging.
- For example, you can run git merge origin master and git push.

Reuse the existing vdev Compose harness and PR review trigger. Compare captured span semantics and multiplicities, require realistic trace coverage, and retain evidence for migration PRs. Generated with GPT-6 (Codex).

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

thomasqueirozb

/ci-run-e2e-opentelemetry-traces-multiservice

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

chatgpt-codex-connector · 2026-10-08T16:56:24Z

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review	Status	Commit	Review trigger
📝 Code Review	✅ Completed 2026-10-09T16:06:40.356682Z	`6cf6484`	New commits

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

datadoghq-integration

The quote readiness probe reports success for a refused connection, allowing premature workload startup and false E2E failures. The inline replacement was verified to fail on a closed port and succeed on an open port.

_{Open Bits AI session}

_{🤖 Bits Code Review · Commit 69aeb3a · @DataDog review to ask questions}

tessneau · 2026-10-08T17:06:08Z

/ci-run-e2e-opentelemetry-traces-multiservice

datadoghq-integration

More details

Compose configuration validation passed. The multiservice round trip remains unverified in this environment because no Docker socket was available.

Was this helpful? React 👍 or 👎

_{Open Bits AI session}

_{🤖 Bits Code Review · Commit d67df6e · @DataDog review to ask questions}

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

… states

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

tessneau

/ci-run-e2e-opentelemetry-traces-multiservice

Add manual OTel Demo trace E2E validation

f3ad538

Reuse the existing vdev Compose harness and PR review trigger. Compare captured span semantics and multiplicities, require realistic trace coverage, and retain evidence for migration PRs. Generated with GPT-6 (Codex).

github-actions Bot added the domain: ci Anything related to Vector's CI environment label Oct 6, 2026

tessneau added 2 commits October 7, 2026 15:09

Clarify OTel trace test documentation and add architecture diagram

f002f26

Rename OTel trace E2E suite to multiservice traces

6cb87b3

tessneau changed the title ~~Add manual OTel Demo trace E2E validation~~ Add manual multiservice OpenTelemetry trace E2E validation Oct 7, 2026

Use cart failure flag for multiservice trace errors

f0aa5ba

tessneau commented Oct 7, 2026

View reviewed changes

tessneau added the no-changelog Changes in this PR do not need user-facing explanations in the release changelog label Oct 7, 2026

tessneau changed the title ~~Add manual multiservice OpenTelemetry trace E2E validation~~ chore(dev): add multiservice opentelemetry e2e test Oct 7, 2026

thomasqueirozb reviewed Oct 7, 2026

View reviewed changes

Allow more time for multiservice trace workload in CI

d3d0e8b

tessneau mentioned this pull request Oct 8, 2026

chore(ci): allow OP team members to trigger integration & e2e tests #26589

Merged

1 of 2 tasks

tessneau changed the title ~~chore(dev): add multiservice opentelemetry e2e test~~ test(opentelemetry): add manual multiservice trace E2E validation Oct 8, 2026

chore: merge master into multiservice trace tests

69aeb3a

tessneau commented Oct 8, 2026

View reviewed changes

tessneau marked this pull request as ready for review October 8, 2026 16:56

tessneau requested a review from a team as a code owner October 8, 2026 16:56

tessneau requested a review from bruceg October 8, 2026 16:56

tessneau marked this pull request as draft October 8, 2026 17:01

datadoghq-integration Bot reviewed Oct 8, 2026

View reviewed changes

Comment thread tests/e2e/opentelemetry-traces-multiservice/config/compose.yaml Outdated

tessneau added 2 commits October 8, 2026 19:02

test(opentelemetry): shorten multiservice trace workload runtime

bbecc34

fix(tests): fail quote readiness check on refused connections

d67df6e

tessneau marked this pull request as ready for review October 8, 2026 17:07

tessneau changed the title ~~test(opentelemetry): add manual multiservice trace E2E validation~~ chore(dev): add multiservice opentelemetry trace e2e test Oct 8, 2026

datadoghq-integration Bot reviewed Oct 8, 2026

View reviewed changes

tessneau commented Oct 9, 2026

View reviewed changes

fix(tests): exit multiservice workload promptly and capture container…

300e901

… states

github-actions Bot added the domain: vdev Anything related to the vdev tooling label Oct 9, 2026

tessneau commented Oct 9, 2026

View reviewed changes

fix(tests): increase multiservice demo memory limits

f78f444

tessneau commented Oct 9, 2026

View reviewed changes

chore(vdev): add opt-in build cache preservation

6cf6484

tessneau commented Oct 9, 2026

View reviewed changes

Navigation Menu

Repository navigation

chore(dev): add multiservice opentelemetry trace e2e test - #26554

chore(dev): add multiservice opentelemetry trace e2e test#26554
tessneau wants to merge 11 commits into
masterfrom
tess.neau-real-trace-testing

tessneau commented Oct 6, 2026 •

edited

Loading

Uh oh!

tessneau left a comment

Uh oh!

thomasqueirozb left a comment

Uh oh!

tessneau left a comment

Uh oh!

chatgpt-codex-connector Bot commented Oct 8, 2026 •

edited

Loading

Uh oh!

datadoghq-integration Bot left a comment

Uh oh!

Uh oh!

tessneau commented Oct 8, 2026

Uh oh!

datadoghq-integration Bot left a comment

Uh oh!

tessneau left a comment

Uh oh!

tessneau left a comment

Uh oh!

tessneau left a comment

Uh oh!

tessneau left a comment

Uh oh!

tessneau left a comment

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

tessneau commented Oct 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

References

Vector configuration

How did you test this PR?

Does this PR include user facing changes?

Contributor Guidelines

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

thomasqueirozb left a comment

Choose a reason for hiding this comment

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot commented Oct 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codex Review Summary

Uh oh!

datadoghq-integration Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

tessneau commented Oct 8, 2026

Uh oh!

datadoghq-integration Bot left a comment

Choose a reason for hiding this comment

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

tessneau left a comment

Choose a reason for hiding this comment

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

tessneau commented Oct 6, 2026 •

edited

Loading

chatgpt-codex-connector Bot commented Oct 8, 2026 •

edited

Loading