Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MinerU model not able to utilise multiple gpu on same instance #1558

Closed
ajayp-cactus opened this issue Jan 16, 2025 · 1 comment
Closed

MinerU model not able to utilise multiple gpu on same instance #1558

ajayp-cactus opened this issue Jan 16, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@ajayp-cactus
Copy link

Description of the bug | 错误描述

I was running mineru on GCP P4 server with 8gb vram but response time were not adequate for our use case.
Then I tried running it on GCP server with 2xP4 GPU.
Model is being loaded on only 1 GPU and there was no significant improvement in response time

How to reproduce the bug | 如何复现

Try running mineru on multi gpu instance

Operating system | 操作系统

Linux

Python version | Python 版本

3.10

Software version | 软件版本 (magic-pdf --version)

0.10.x

Device mode | 设备模式

cuda

@ajayp-cactus ajayp-cactus added the bug Something isn't working label Jan 16, 2025
@myhloli
Copy link
Collaborator

myhloli commented Jan 22, 2025

We do not support running the same task on multiple GPUs to achieve a speedup. However, if you have multiple documents to process, you can distribute different tasks to different GPUs to achieve speedup through parallel processing of multiple tasks.

@myhloli myhloli closed this as completed Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants