Skip to content

Fix the bedrock inference profile missing issue for sonnet 3.7 #113

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

wang2nd
Copy link

@wang2nd wang2nd commented Feb 26, 2025

identify inference_profile type from the foundation model list response itself

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

identify inference_profile type from the foundation model list response itself
@daixba
Copy link
Contributor

daixba commented Feb 27, 2025

Thanks for the contribution. But I don't see any bugs so far using sonnet 3.7.

Can you please describe what issue (bug) you faced and why we need this fix?

@wang2nd
Copy link
Author

wang2nd commented Mar 3, 2025

I could not see sonnet 3.7 interference profile listed in the models api without changes, even after I checked out the main and rebuilt the server again.

@daixba
Copy link
Contributor

daixba commented Mar 7, 2025

You can try to redeploy this solution and you should be able to use the Sonnet 3.7.

If you just deployed recently, try run curl -s $OPENAI_BASE_URL/models -H "Authorization: Bearer $OPENAI_API_KEY" | jq .data to refresh the model list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants