whisper-bench SYCL faster than BLAS faster than VULKAN on Intel CPU+iGPU: i5-11400 for large-v3. Why? #2996
Unanswered
arkanoid87
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm new to
whisper.cpp
and trying to find the fastest setup to run it on Intel CPU + iGPUBy following the project readme I managed to compile (git master branch) and run
whisper-bench
on 3 backends (+1 failure)bench_vulkan.txt
bench_sycl.txt
bench_blas.txt
I was expecting OPENVINO to be the fastest, VULKAN the second place, but actually I got very different results: SYCL seems 3x faster than VULKAN. I'd like to ask you if you see any error in my benchmark, and if you consider my results reliable. Should I stick with SYCL? Should I fix the setup for a different -more performant- backend?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions