Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a dora-lmdeploy node #817

Open
haixuanTao opened this issue Mar 7, 2025 · 5 comments
Open

Add a dora-lmdeploy node #817

haixuanTao opened this issue Mar 7, 2025 · 5 comments
Assignees
Labels
good first issue Good for newcomers

Comments

@haixuanTao
Copy link
Collaborator

LmDeploy showcase great performance on inference on Cuda and it could be great to wrap a node called dora-lmdeploy that could specify the model we want to use and handle the logic around receiving text and images.

It would probably be very similar to https://github.com/dora-rs/dora/blob/main/node-hub/dora-qwen2-5-vl except that we replace transformers with lmdeploy pipelines.

@haixuanTao haixuanTao added the good first issue Good for newcomers label Mar 7, 2025
@7SOMAY
Copy link
Contributor

7SOMAY commented Mar 7, 2025

Please assign this issue to me!

@Shar-jeel-Sajid
Copy link
Contributor

@dora-bot assign me

Copy link

Hello @Shar-jeel-Sajid, this issue is now assigned to you!

@7SOMAY
Copy link
Contributor

7SOMAY commented Mar 13, 2025

@dora-bot assign me

Copy link

Hello @7SOMAY, this issue is now assigned to you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

3 participants