ryanMVP

6 ms·

1. 1.▲
   by ryanMVP 11mo ago

   Thanks for the reply! By "inference provider" I meant someone operating a ComputeNode. I initially skimmed the paper, but I've now read more closely and see that we're trying to get guarantees that even a malicious opera
2. 2.▲
   by ryanMVP 11mo ago

   Reading the whitepaper, the inference provider still has the ability to access the prompt and response plaintext. This scheme does seem to guarantee that plaintext cannot be read for all other parties (e.g. the API router), and that the cli