5 ms·
Interesting, I did not encounter such discrepancies in my work with these tools. There could be multiple reasons for the degraded performance: - Are we compar
by akhundelar 5y ago
Interesting, I did not encounter such discrepancies in my work with these tools.
There could be multiple reasons for the degraded performance:
- Are we comparing apples to apples here (heh), e.g. ResNet-50 vs ResNet-50?
- Was the ONNX model ported from TF? There are known issues with that path (https://onnxruntime.ai/docs/how-to/tune-performance.html#my-converted-tensorflow-model-is-slow---why https://onnxruntime.ai/docs/how-to/tune-performance.html#my-...)
- Have you tried tuning an execution provider for your specific target platform?(https://onnxruntime.ai/docs/reference/execution-providers/#summary-of-supported-execution-providers https://onnxruntime.ai/docs/reference/execution-providers/#s...)