Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a way to get small clips for VFX samples or drumkit stuff for ableton #37

Open
TheMindExpansionNetwork opened this issue Jan 31, 2025 · 4 comments
Labels
enhancement New feature or request

Comments

@TheMindExpansionNetwork

I was just thinking is there a way that instead of the track being long we can do it short and small to create snares kicks stuff like that

possibly need fine-tuning. I'm not sure if that is going to be a thing in the future.

@a43992899
Copy link
Collaborator

a43992899 commented Jan 31, 2025

Do you mean a drum loop? Or just a single sound?

I think both can be done with fine-tune with small amount of compute. The only thing we need to get is audio pair with (detailed) text.

If there is an imagenet dataset for musical sound it would be cool.

@a43992899 a43992899 added the enhancement New feature or request label Jan 31, 2025
@TheMindExpansionNetwork
Copy link
Author

TheMindExpansionNetwork commented Jan 31, 2025

Yeah so I will give an example

I am an abstract DJ/Musician

I wanted to try to slice it down super small and then generate a bunch this way I can put it on my launch pad for kits to jam with my other instruments for this upcoming summer tour.

Then also like sounds for SFX like rocket blast alien sounds laser guns all that.

Doing something called interglatic music festival 2045 going to tour oregon west coast half is a tech workshop thing the other half is a party this way we can generate our own compute power.

Very exited for this tool you all got and sending love awesome to say its generated by yue because its true such a happy experience.

Be cool get this into hands of healing frequency stuff like that

@TheMindExpansionNetwork
Copy link
Author

Thinking how many samples do you need?

I got full ableton wonder if I hack together a little ai agent that will generate sounds then process with tags

@a43992899
Copy link
Collaborator

a43992899 commented Jan 31, 2025

You could throw the sound to Google drive. For labelling, try qwen2audio https://huggingface.co/Qwen/Qwen2-Audio-7B-Instruct

I have never tried this before, maybe 1K-5K samples I guess.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants