6 ms·
A 17 million parameter model (~Resnet50) takes more than 50s proof time. Is this on top of the inference time? I can see some niche applications for this syste
by BiasRegularizer 3y ago
A 17 million parameter model (~Resnet50) takes more than 50s proof time. Is this on top of the inference time?
I can see some niche applications for this system, but I am very skeptical it's ability to handle larger models (100M+) and the ability to and it's scalability when there are increased demand.
- iskander 3y agoZK is currently stuck with arithmetic circuit representations which are predictably very expensive to use as a representation for tensor data. The matrix based formulations are still limited and don't play nicely with the parts of ML models which go beyond simple matrix multiplication. I suspect someone will unify the two threads of research eventually, but it doesn't seem like it's there yet. (FHE ML is even further away)