Leverage style diffusion

[thewh1teagle]

I really like this model because it's easy to train and insanly fast. However it doesn't have enough styling in the speech.
How about adding something like style diffusion like with StyleTTS2?

https://github.com/yl4579/StyleTTS2

[mush42]

@thewh1teagle would you like to take a shot at it. Maybe I can then add it as an optional component.

[yukiarimo]

STOP POLLUTION GOOD AIs WITH DIFFUSION!