Skip to content

[helm] Request add a default trace backend to display trace data #1705

@Frapschen

Description

@Frapschen

With the proposal #1520 and the initial PR #1638, We are pushing GAIE for integration with the trace system. It's better to have an opt-in default trace backend, like Jaeger, to help us store and display trace data.

With the opt-in default trace backend, users or anyone interested in GAIE will quickly understand how an inference request is processed(filter, score) and forwarded to a vLLM model.

What would you like to be added:
Add Jageer as a sub-chart of GAIE and deploy the all-in-one model of Jaeger: https://www.jaegertracing.io/docs/2.11/getting-started/#all-in-one.

Why is this needed:

  • Users can easily utilize the trace graph to gain insights into the details of the inference request route.

Metadata

Metadata

Assignees

Labels

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions