6 ms·
if the servers are so private, why is on-device such a win? here are some irrelevant distractions: - the cpu arch of the servers - mentioning that you have to
by menacingly 2y ago
if the servers are so private, why is on-device such a win? here are some irrelevant distractions:
- the cpu arch of the servers
- mentioning that you have to trust vendors not to keep your data, then announcing a cloud architecture where you have to trust them not to keep your data
- pushing the verifiability of the phone image, when all we ever cared about was what they sent to servers
- only "relevant" data is sent, which over time is everything, and since they never give anyone fine-grained control over anything, the llm will quietly determine what's relevant
- the mention that the data is encrypted, which of course it isn't, since they couldn't inference. They mean in flight, which hopefully _everything_ is, so it's irrelevant
- menacingly 2y agoit will defer to the server a _lot_, if you just consider the capability they can fit on that phone