Skip to content

Commit 58e83ef

Browse files
authored
Fix performance degradation in Ubuntu (#815)
Fix issue with creating backend for every inference iteration. The issue was caused by using std::map operator[] that created a pair with key and empty value. In Ubuntu std::map insert method won't override the key value in backend_map if key exists in map (created by operator[])
1 parent f7a5656 commit 58e83ef

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

onnxruntime/core/providers/openvino/backend_manager.cc

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -672,7 +672,10 @@ void BackendManager::Compute(OrtKernelContext* context) {
672672

673673
{
674674
std::unique_lock<std::mutex> lock(mutex_);
675-
dynamic_backend = backend_map_[key];
675+
auto it = backend_map_.find(key);
676+
if (it != backend_map_.end()) {
677+
dynamic_backend = it->second;
678+
}
676679
}
677680

678681
if (!dynamic_backend) {

0 commit comments

Comments
 (0)