4 ms·
That solution actually makes great sense. So Apple won in some strange way again? Guess there are limitations on size of the models, but if top-tier models wil
by chaoz_ 5mo ago
That solution actually makes great sense. So Apple won in some strange way again?
Guess there are limitations on size of the models, but if top-tier models will getting democratized I don’t see a reason not to use this API. The only thing that comes to me is data privacy concerns.
I think batch-evals for non-sensitive data has great PMF here.
- rvz 5mo agoYes. They never needed to participate in the AI race to zero. Because they were already at the finish line with Apple Silicon. > I don’t see a reason not to use this API. The only thing that comes to me is data privacy concerns. The whole inference is end-to-end encrypted so none of the nodes can see the prompts or the messages.
- chaoz_ 5mo agoFun question: can some (part of it) be a crypto token that I can buy? :)) That would finally be a crypto thing which is backed by value I believe in.
- 59nadir 5mo ago> So Apple won in some strange way again? Heh, what did they win exactly? This is just a way for another company to extract value out of the single region of the world where Apple is a relevant vendor, and it happens to be the one where it's the easiest to pull people into schemes.