2x generation speed?

[danzeeeman]

I'm not seeing 2x generation speed I'm seeing more of a 1x generation speed.

I've tested on a:

• RTX A6000
• RTX 6000 ADA
• L40

[darkacorn]

running a6k's here non ada and its about 1.5x on tansformer at aprox 120 it/s

[rzgarespo]

on RTX3080 => | 1716/2588 [00:20<00:10, 82.31it/s]
so RTX A6000 should process 1716 frames in 14 seconds (1.5x faster than 3080)

[darkacorn]

mind you first generation after gradio start is always a bit slower - if you still have issues id recommend popping into discord and well be able to help you drill it down

[darkacorn]

output was 5 sec audio
as you can see the first run is slow after loading up ( i have not traced it but i would assume its the embeddings of the cloned voice)

[danzeeeman]

interesting... I'm only getting about ~100 it/s on my L40

[danzeeeman]

where is the discord link?

[darkacorn]

on the readme or :
https://discord.gg/tvT3q7wBZA

[MithrilMan]

I feel this problem too
on my 3090TI running docker on windows11 (WSL2) I got ~80 it/sec (basically 1x realtime)

[danzeeeman]

yeah on my docker image on windows is mad slow. on a docker image running on a VM on a big server its slightly better. the best performance I've gotten is off a bare metal Linux box.