New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

allow specifying encoder token model #592

Open

pelikhan opened this issue Jul 29, 2024 · 1 comment

Member

pelikhan commented Jul 29, 2024

For azure connection, the model name does not match the canonical model name

Member Author

pelikhan commented Jan 19, 2025

if we do a dummy query, we can sniff the model family in the response.

Alternatively, allow it to be configured.

If logorobs is supported, we could learn the token map for choices at least.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment