7 ms·
Their rule of only releasing major software updates once a year in June is holding them back IMO. Their local LLM apis were dated before macOS/iOS 26 was even r
by rudedogg 6mo ago
Their rule of only releasing major software updates once a year in June is holding them back IMO. Their local LLM apis were dated before macOS/iOS 26 was even released. Just because something worked 20 years ago doesn’t mean it works today, but I’m sure it’s hard to argue against a historically successful strategy internally.
- aurareturn 6mo agoHuh? What local LLM apis? It uses Metal.
- rudedogg 6mo agoThe application development APIs, ie: https://developer.apple.com/documentation/technologyoverviews/foundation-models https://developer.apple.com/documentation/technologyoverview...
- aurareturn 6mo agoAny serious LLM work isn't going to use that. They'll use Metal GPU. No one is going to inference using the NPU on a Mac. OP said "work stations" which is implying Macbook Pros and Studios.
- rudedogg 6mo ago> Any serious LLM work isn't going to use that. That’s my point. One would expect the platform owner (especially one where they own both the hardware AND software) to provide a reasonable / easy path to using LLMs if they are going to provide a framework for doing so. But Apple can’t because of how slow they ship updates