Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a dora-transformers node that can handle multiple model and modality! #830

Open
haixuanTao opened this issue Mar 9, 2025 · 9 comments
Labels
good first issue Good for newcomers

Comments

@haixuanTao
Copy link
Collaborator

In order to facilitate integration of multiple AI models, I think it could be good to have a generic dora-transformers node that can be used to try different AI models.

I think that we can reuse most of the work already made on dora-qwen2.5vl and build on top of it.

@haixuanTao haixuanTao added the good first issue Good for newcomers label Mar 9, 2025
@Mati-ur-rehman-017
Copy link
Contributor

@dora-bot assign me

Copy link

Hello @Mati-ur-rehman-017, this issue is now assigned to you!

@Krishnadubey1008
Copy link
Contributor

@Mati-ur-rehman-017 are you still working on this issue

@Mati-ur-rehman-017
Copy link
Contributor

Yes still working on the issue. How do i test a node completely through different inputs? I am currently changing models based on environment variables and to test these models i have to use different inputs. Currently i plan to run python scripts separately for testing. is there a more efficient method? @haixuanTao

@MunishMummadi
Copy link
Contributor

Hey, I am just curious. what do you mean different inputs? Are u planning to pass image inputs??(for ex: dora-qwen2.5l) to see the output??. I believe as long as your model is up and running and you are following the chat template example or various chat template/ways you should be good to go. Please correct me if i am wrong!!

@haixuanTao
Copy link
Collaborator Author

Ok going to work on this this weekend

@MunishMummadi
Copy link
Contributor

Can I lend a hand? If it's ok!! multi model modality sounds interesting.

@Mati-ur-rehman-017
Copy link
Contributor

@dora-bot unassign me

Copy link

Hello @Mati-ur-rehman-017, you have been unassigned from this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

4 participants