You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
LmDeploy showcase great performance on inference on Cuda and it could be great to wrap a node called dora-lmdeploy that could specify the model we want to use and handle the logic around receiving text and images.
LmDeploy showcase great performance on inference on Cuda and it could be great to wrap a node called dora-lmdeploy that could specify the model we want to use and handle the logic around receiving text and images.
It would probably be very similar to https://github.com/dora-rs/dora/blob/main/node-hub/dora-qwen2-5-vl except that we replace transformers with lmdeploy pipelines.
The text was updated successfully, but these errors were encountered: