Pre-build tool to measure ONNX runtime performance for models? #21050
Unanswered
Voxelworld
asked this question in
Performance Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I would like to check whether the ONNX-Runtime is capable to execute my model (.onnx file) on CPU and with the DirectML execution provider and would like to capture performance measurements on the GPU and CPU, like memory consumption and execution time.
The official ONNX-Runtime documentation states "The onnxruntime_perf_test.exe tool (available from the build drop) can be used to test various knobs.". But I can't find the tool in the release assets.
Previously I used tools in Microsofts GitHub repo Windows-Machine-Learning which contains a WinMLRunner.exe and a MicrosoftMLRunner.exe. But the last version was released in 2022.
Where can I find a performance measuring tool which can be used out of the box?
Beta Was this translation helpful? Give feedback.
All reactions