Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: ensures the route recalculated #135

Merged
merged 9 commits into from
Jan 20, 2025
Merged

Conversation

mathetake
Copy link
Member

@mathetake mathetake commented Jan 20, 2025

Previously, internally x-envoy-ai-gateway-selected-backend
was used for routing. However, it has some conflicts with the
EG default setting named suprressEnvoyHeaders: true and
that caused the route recalculation ignored. This fixes it.
In general, we shouldn't use the Envoy internal headers
x-envoy-* for headers we generate in this project.

Thanks @yuzisun for finding this out.

@mathetake mathetake marked this pull request as ready for review January 20, 2025 04:37
@mathetake mathetake requested a review from a team as a code owner January 20, 2025 04:37
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Comment on lines -62 to -63
mutation_rules:
allow_all_routing: true
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this was unneeded and makes the configuration diff between EG and raw envoy here smaller

@@ -61,7 +61,7 @@ type AIGatewayRouteSpec struct {
// modifications to achieve the necessary jobs, notably inserting the AI Gateway filter responsible for
// the transformation of the request and response, etc.
//
// In the matching conditions in the AIGatewayRouteRule, `x-envoy-ai-gateway-model` header is available
// In the matching conditions in the AIGatewayRouteRule, `x-eaig-model` header is available
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tbh, eaig looks like a typo unfortunately, suggest x-ai-eg-model which reads better?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's stick to ai-eg-* from now!

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake mathetake merged commit 3dfcbac into main Jan 20, 2025
11 checks passed
@mathetake mathetake deleted the e2erouterecalculatednot branch January 20, 2025 17:40
aabchoo added a commit that referenced this pull request Jan 21, 2025
Previously, internally `x-envoy-ai-gateway-selected-backend`
was used for routing. However, it has some conflicts with the
EG default setting named `suprressEnvoyHeaders: true` and
that caused the route recalculation ignored. This fixes it.
In general, we shouldn't use the Envoy internal headers
x-envoy-* for headers we generate in this project.

Thanks @yuzisun for finding this out.

---------

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Aaron Choo <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants