Skip to content

feat(generation): remote vLLM/NIM generation backend (GPU-free) - #575

Draft
binaryaaron wants to merge 16 commits into
mainfrom
agonzales/remote-generation-backend
Draft

feat(generation): remote vLLM/NIM generation backend (GPU-free)#575
binaryaaron wants to merge 16 commits into
mainfrom
agonzales/remote-generation-backend

refactor(llm): define typed local model host

c226c79
Select commit
Loading
Failed to load commit list.