LiteLLM Connection Issue

[davidfungf]

I am using the latest the mintplexlabs/anythingllm:pg docker. It returned the following error when the the LLM is connected to LiteLLM gateway. Docker image v1.12.1 works fine. I already specified PROVIDER_DISABLE_NATIVE_TOOL_CALLING="litellm" in my docker file.

The agent model failed to respond: this.supportsNativeToolCallingViaEnv is not a function

Docker log

[backend] error: TypeError: this.supportsNativeToolCallingViaEnv is not a function
at LiteLLMProvider.supportsNativeToolCalling (/app/server/utils/agents/aibitat/providers/litellm.js:47:38)
at Object.supportsNativeToolCalling (/app/server/models/workspace.js:702:78)
at grepAgents (/app/server/utils/chats/agents.js:52:44)
at streamChatWithWorkspace (/app/server/utils/chats/stream.js:43:29)
at async /app/server/endpoints/chat.js:149:9

[timothycarambat]

Fixed in #5961

Rebuilding and publishing pg now: https://github.com/Mintplex-Labs/anything-llm/actions/runs/28680764637