Skip to content

api: changes LLM prefix -> AI* #76

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Jan 16, 2025
Merged

api: changes LLM prefix -> AI* #76

merged 9 commits into from
Jan 16, 2025

Conversation

mathetake
Copy link
Member

This comes up in a thread in #71 with @yuzisun, and we might
want to remove the LLM prefix.

The rationale is that the current functionality is nothing to do
with "LLM" but more about the general routing and authn/z
with "AI providers" where the input is OpenAI format.

On the other hand, there "will be" the LLM specific CRD such
as the configurations for prompt guard, semantics caching etc.

I would like to have inputs from the community members!

cc @envoyproxy/ai-gateway-assignable

Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake
Copy link
Member Author

Applied the change according to the discussion so far:

  • AIRoute -> AIGatewayRoute
  • AIBackend -> AIServiceBackend

anything else?

@mathetake mathetake changed the title discussion[api]: changes LLM prefix -> AI discussion[api]: changes LLM prefix -> AI* Jan 13, 2025
@mathetake
Copy link
Member Author

mathetake commented Jan 14, 2025

PING ALL - this is blocking others

@Krishanx92
Copy link
Contributor

LGTM

@mathetake
Copy link
Member Author

others thoughts? if not, I will polish this PR as a proper one not just for discussion

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake
Copy link
Member Author

ok i will work on it

@mathetake mathetake marked this pull request as draft January 16, 2025 01:37
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake mathetake changed the title discussion[api]: changes LLM prefix -> AI* api: changes LLM prefix -> AI* Jan 16, 2025
@mathetake mathetake requested a review from yuzisun January 16, 2025 01:41
@mathetake mathetake marked this pull request as ready for review January 16, 2025 01:41
@mathetake mathetake requested a review from a team as a code owner January 16, 2025 01:41
@mathetake
Copy link
Member Author

@yuzisun can you take a look?

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake mathetake merged commit 874937c into main Jan 16, 2025
9 checks passed
@mathetake mathetake deleted the removellmprefix branch January 16, 2025 01:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants