Skip to content

[GPU] Allocate output mem using virtual memory in Windows even if physical memory is full #30106

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

kelvinchoi-intel
Copy link
Contributor

Details:

  • primitive_inst tries to allocate output memory and it can alloc by using virtual memory even if physical memory is full on Windows. So the check_allocatable() func needs to return true.
  • ...

Tickets:

  • 161457

@kelvinchoi-intel kelvinchoi-intel requested review from a team as code owners April 14, 2025 04:34
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Apr 14, 2025
Copy link
Contributor

@wilson-seok wilson-seok left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -165,7 +165,6 @@ bool ocl_engine::check_allocatable(const layout& layout, allocation_type type) {
GPU_DEBUG_COUT << "[Warning] [GPU] Exceeded max size of memory allocation: " << "Required " << layout.bytes_count() << " bytes, already occupied : "
<< used_mem << " bytes, but available memory size is " << get_max_memory_size() << " bytes" << std::endl;
GPU_DEBUG_COUT << "Please note that performance might drop due to memory swap." << std::endl;
return false;
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

random spot) could you check additional assertion whether the primitive has output buffer when executed? this would be helpful for future troubleshoot of such issue.

Copy link
Contributor Author

@kelvinchoi-intel kelvinchoi-intel Apr 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added assertions at set_arguments_impl() which allocated memory is necessary

@@ -165,7 +165,6 @@ bool ocl_engine::check_allocatable(const layout& layout, allocation_type type) {
GPU_DEBUG_COUT << "[Warning] [GPU] Exceeded max size of memory allocation: " << "Required " << layout.bytes_count() << " bytes, already occupied : "
<< used_mem << " bytes, but available memory size is " << get_max_memory_size() << " bytes" << std::endl;
GPU_DEBUG_COUT << "Please note that performance might drop due to memory swap." << std::endl;
return false;
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

random spot) PR title is difficult to understand. Could you rewrite it to express what it is doing or why it matters?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated PR title

@kelvinchoi-intel kelvinchoi-intel force-pushed the enable_faster_rcnn_nas_lowproposals_coco branch from bd7fc73 to 9e045ae Compare April 14, 2025 07:07
@kelvinchoi-intel kelvinchoi-intel changed the title [GPU] Return true for uing virtual memory in Windows [GPU] Allocate output mem using virtual memory in Windows Apr 14, 2025
@kelvinchoi-intel kelvinchoi-intel changed the title [GPU] Allocate output mem using virtual memory in Windows [GPU] Allocate output mem using virtual memory in Windows even if physical memory is full Apr 14, 2025
@kelvinchoi-intel kelvinchoi-intel force-pushed the enable_faster_rcnn_nas_lowproposals_coco branch 2 times, most recently from 7089381 to 3de6c74 Compare April 15, 2025 00:50
@isanghao isanghao added this pull request to the merge queue Apr 15, 2025
Merged via the queue into openvinotoolkit:master with commit 000c8b7 Apr 15, 2025
169 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: GPU OpenVINO GPU plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants