5 ms·
Is the Apple Photos feature mentioned actually implemented using Wally, or is that just speculation? From a cursory glance, the computation of centroids done o
by vrtx0 2y ago
Is the Apple Photos feature mentioned actually implemented using Wally, or is that just speculation?
From a cursory glance, the computation of centroids done on the client device seems to obviate the need for sending embedded vectors of potentially sensitive photo details — is that incorrect?
I’d be curious to read a report of how on-device-only search (using latest hardware and software) is impacted by disabling the feature and/or network access…
- chikere232 2y agoYou have to be quick if you want to disable the feature, as the scan starts on OS install, and disabling requires you to actively open the Photos app and turn it off.
- aeontech 2y agoAccording to this post on Apple's Machine Learning blog, yes, Wally is the method used for this feature. https://machinelearning.apple.com/research/homomorphic-encryption https://machinelearning.apple.com/research/homomorphic-encry...
- vrtx0 2y agoThank you! This is exactly the information the OP seems to have missed. It seems to confirm my suspicion that the author’s concerns about server-side privacy are unfounded — I think: > The client decrypts the reply to its PNNS query, which may contain multiple candidate landmarks. A specialized, lightweight on-device reranking model then predicts the best candidate… [please correct me if I missed anything — this used to be my field, but I’ve been disabled for 10 years now, so grain of salt]
- chikere232 2y agoThe devil is in the proprietary details though.
- vrtx0 2y agoSorry, what do you mean by “proprietary details”?
- sbuk 2y agoThey are alluding to the fact that the implementation is closed source, and therefore "untrustworthy". It's a trite point, of course, but not without some merit.
- vrtx0 2y agoI don’t see any merit, honestly. That would assume one is able to audit every bit of code they run, including updates, and control the build system. I mean, the Wally paper contains enough information to effectively implement homomorphic encryption for similar purposes. The field was almost entirely academic ~12 years ago… I miss talking shop on HN. Comments like that are why we can’t have nice things.
- sbuk 2y agoI do agree that everything is politicized. I'd have liked to have seen an explanation for laypeople and perhaps the option being opt-in. To me, there is some merit in that stance. It is a side-note. It is a shame that we can't talk about these things openly without people getting offended because of it.