Conversation
There was a problem hiding this comment.
Pull request overview
Adds support in the OpenVINO EP to dump OpenVINO profiling (perf count) information to a directory specified by the ORT_OPENVINO_PERF_COUNT environment variable when profiling is enabled on the compiled model.
Changes:
- Make
IBackend::Infernon-const and updateBasicBackendaccordingly. - Add
ORT_OPENVINO_PERF_COUNTenv var plumbing and write perf counts to a CSV file under the specified directory. - Simplify
printPerformanceCountsAPIs and change output format to CSV.
Reviewed changes
Copilot reviewed 5 out of 5 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| onnxruntime/core/providers/openvino/ibackend.h | Adjust Infer interface constness to support new inference-time behavior. |
| onnxruntime/core/providers/openvino/backends/basic_backend.h | Update Infer override signature to match interface change. |
| onnxruntime/core/providers/openvino/backends/basic_backend.cc | Implement perf-count CSV dumping to an env-var directory after inference when profiling is enabled. |
| onnxruntime/core/providers/openvino/backend_utils.h | Add env-var helper and update perf-count printing function signatures. |
| onnxruntime/core/providers/openvino/backend_utils.cc | Implement env-var helper and update perf-count printing implementation/output format. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 5 out of 5 changed files in this pull request and generated 5 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…onnxruntime into sahar/perf_legacy_changes
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Description
https://jira.devtools.intel.com/browse/EISW-195635
This change allows profiling information to be dumped to a Directory defined by environment variable
ORT_OPENVINO_PERF_COUNT when Perf Count Property is enabled.
Motivation and Context
https://jira.devtools.intel.com/browse/EISW-195635
Compiler team has requested for profiling information