Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow passthrough traffic to unknown request paths #115

Open
nacx opened this issue Jan 17, 2025 · 1 comment
Open

Allow passthrough traffic to unknown request paths #115

nacx opened this issue Jan 17, 2025 · 1 comment
Milestone

Comments

@nacx
Copy link
Contributor

nacx commented Jan 17, 2025

The current implementation of the ext_proc filter assumes traffic goes to the /v1/chat/completions endpoint, and the translators return an error if the request goes to a different path.

It will be a common case for existing applications to be already consuming other OpenAI API endpoints (for example, the /v1/models to get the list of available models), and having requests to those endpoints fail when going through the AI gateway makes adoption harder.

It would be great to have a mechanism to configure the ext_proc to not fail on unknown paths and allow the request instead, so that existing applications can be proxied by the ai-gateway more easily

@mathetake
Copy link
Member

I believe this is a valid use case

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants