You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was running mineru on GCP P4 server with 8gb vram but response time were not adequate for our use case.
Then I tried running it on GCP server with 2xP4 GPU.
Model is being loaded on only 1 GPU and there was no significant improvement in response time
How to reproduce the bug | 如何复现
Try running mineru on multi gpu instance
Operating system | 操作系统
Linux
Python version | Python 版本
3.10
Software version | 软件版本 (magic-pdf --version)
0.10.x
Device mode | 设备模式
cuda
The text was updated successfully, but these errors were encountered:
We do not support running the same task on multiple GPUs to achieve a speedup. However, if you have multiple documents to process, you can distribute different tasks to different GPUs to achieve speedup through parallel processing of multiple tasks.
Description of the bug | 错误描述
I was running mineru on GCP P4 server with 8gb vram but response time were not adequate for our use case.
Then I tried running it on GCP server with 2xP4 GPU.
Model is being loaded on only 1 GPU and there was no significant improvement in response time
How to reproduce the bug | 如何复现
Try running mineru on multi gpu instance
Operating system | 操作系统
Linux
Python version | Python 版本
3.10
Software version | 软件版本 (magic-pdf --version)
0.10.x
Device mode | 设备模式
cuda
The text was updated successfully, but these errors were encountered: