8 ms·
I've been looking in to this for the java world. What's your use case? Deployment in to existing applications?
by agibsonccc 3y ago
I've been looking in to this for the java world. What's your use case? Deployment in to existing applications?
- jarym 3y agoYea exactly - Python for training, Java/.NET for inference at production. I looked at approaches like GRPC and things but my case is a bit more time-sensitive and the latency added by going over a network layer was too much. For now I'm happy with Pytorch->ONNX and then running the ONNX model directly. But as I said, that means I can't easily train using JAX :-(
- patrickkidger 3y agoYou can do JAX->TF->ONNX I believe: https://github.com/patrick-kidger/equinox/blob/main/equinox/internal/_onnx.py https://github.com/patrick-kidger/equinox/blob/main/equinox/...
- jarym 3y agoOhh, I'll check that out!