generated from kubernetes/kubernetes-template-project
-
Notifications
You must be signed in to change notification settings - Fork 184
Open
Labels
needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.
Description
With the proposal #1520 and the initial PR #1638, We are pushing GAIE for integration with the trace system. It's better to have an opt-in default trace backend, like Jaeger, to help us store and display trace data.
With the opt-in default trace backend, users or anyone interested in GAIE will quickly understand how an inference request is processed(filter, score) and forwarded to a vLLM model.
What would you like to be added:
Add Jageer as a sub-chart of GAIE and deploy the all-in-one model of Jaeger: https://www.jaegertracing.io/docs/2.11/getting-started/#all-in-one.
Why is this needed:
- Users can easily utilize the trace graph to gain insights into the details of the inference request route.
Metadata
Metadata
Assignees
Labels
needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.