You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, if the provider is anything but openai, azure, or bedrock, an httpx.Timeout passed in will be turned into a float. This can be less restrictive — when I monkeypatch supports_httpx_timeout to allow through custom_openai as well, it seems to work fine. supports_httpx_timeout should also allow custom_openai, and presumably other providers that use the OpenAI client.
Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.60.6
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered:
What happened?
Currently, if the provider is anything but openai, azure, or bedrock, an
httpx.Timeout
passed in will be turned into a float. This can be less restrictive — when I monkeypatchsupports_httpx_timeout
to allow throughcustom_openai
as well, it seems to work fine.supports_httpx_timeout
should also allowcustom_openai
, and presumably other providers that use the OpenAI client.Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.60.6
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: