8 ms·
Yes, Cortex uses ONNX Runtime (https://github.com/microsoft/onnxruntime https://github.com/microsoft/onnxruntime) under the hood so any model that can be export
by ospillinger 7y ago
Yes, Cortex uses ONNX Runtime (https://github.com/microsoft/onnxruntime https://github.com/microsoft/onnxruntime) under the hood so any model that can be exported to ONNX can be deployed.
- solidasparagus 7y agoIs it only able to handle ONNX models? That's a pretty massive limitation compared to a hosted SageMaker endpoint.
- vishalbollu 7y agoContributor here - Cortex supports Tensorflow saved models in addition to ONNX. PyTorch support is on the roadmap. Do you have specific frameworks in mind that you would like Cortex to support?
- solidasparagus 7y agoPerfect. Nothing in particular other than TF.