Will support lora fine-tuning?

[rookie0607]

No description provided.

[roudimit]

Thanks for your interest! Which task do you want Lora fine-tuning for? I will consider adding it

[rookie0607]

Thanks for your interest! Which task do you want Lora fine-tuning for? I will consider adding it

Well, that's great!

[roudimit]

Which GPU (how many GB) will you use for fine-tuning?

[rookie0607]

Which GPU (how many GB) will you use for fine-tuning?

I only have 4090, can I train whisper-large and AV-hubert?

[roudimit]

With 1 GPU / 24GB you could train Whisper Small and Whisper-Flamingo Small on English (LRS3 / LRS2) using our code. I'll consider adding adapters but it would probably be a while.

[rookie0607]

With 1 GPU / 24GB you could train Whisper Small and Whisper-Flamingo Small on English (LRS3 / LRS2) using our code. I'll consider adding adapters but it would probably be a while.

That's so cool!