10 ms·
Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they co
by shrimpx 3y ago
Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to win.
- fennecbutt 3y agoAre you so sure? Even this link is built on top of the work of others, I'm not sure they've contributed as much as you think they have.
- harryVic 3y agoCan you give an example? I switched to android because i use personal assistant a lot while driving and siri was absolutely horrible.
- shrimpx 3y ago- FaceID - Facial recognition in Photos - "Memories" in Photos - iOS keyboard autocomplete using LLMs. I am bilingual and noticed in the latest iOS it now does multi-language autocomplete and you no longer have to manually switch languages. - Event detection for Calendar - Depth Fusion in the iOS camera app, using ML to take crisper photos - Probably others... The crazy thing is most/all of these run on the device.
- pkage 3y agoI just wish you could turn the multilingual keyboard off—I find that I usually only type in one language at a time and having the autocomplete recommend the wrong languages is quite frustrating
- shrimpx 3y agoThat's true, I have found that mildly annoying sometimes. But most of the time it's a win. It was really annoying manually switching modes over and over when typing in mixed-language, which I do fairly often. It'd be great if there was a setting though.
- cezart 3y agoI had the opposite problem, the languages I usually typed in(Romanian + English) didn't have a multi language mode on iOS. So it was a constant pain to switch btw them when I needed to insert some English terms in Romanian sentences. IOS didn't support multi language for this language pair. On Android it always worked like a charm.
- shrimpx 3y agoHey I'm Romanian, too. The latest iOS does what you want -- it has multi-language support and typing mixed English + Romanian is seamless now. Yeah it was a total pain to keep switching languages before iOS 17.
- hansoolo 3y agoTo be honest I distrust Microsoft with swift key, but the it recognizes the change in language just smooth. I could switch languages in one sentence and it would understand what I am writing just fine, no Sill suggestions
- Aerbil313 3y agoApple recommending wrong words when you write in mixed-language was the case in iOS 15, so much I always needed to manually change my keyboard language. But it’s no more in iOS 17. As an example I just typed this entire comment in Turkish keyboard with English autocorrect and suggestions working. Maybe the (most likely) AI-based thing requires some training though. I got my new iPhone a month or so ago.
- fennecbutt 3y agoSwiftKey is great and if someone distrusts Microsoft for it...then fine, but various different companies "control" various different parts of my phone. With an iPhone, it's only one company, that controls every little thing, and we have no insight into Apple at all. They can basically do whatever the hell they want.
- pants2 3y agoThe iPhone's built in text OCR and image subject cutouts are also extremely good, just in the photos app.
- fennecbutt 3y agoYeah face id is pretty good, no android phones seem to use the ir dot camera which makes me think Apple has a "patent" on it ...lame considering the dot projector is ripped straight out of kinekt. Google does the memory photo thing too, but only if you use their app which I don't. Android has had multi language keyboard support for the longest time, in addition to being able to install whatever keyboard I like (I use SwiftKey, it's brilliant) I can also install an llm based one as I please. Android/my keyboard already does event detection/suggestion in text and has been doing for as long as I remember. None of these are reasons to buy an iPhone...just reasons to buy a phone, lmao.
- jmisavage 3y agoFYI Apple bought the company that made the kinect sensors. The Face ID module on iPhones is a mini kinect.
- Affric 3y agoDon’t TSMC make Nvidia’s chips too?
- shrimpx 3y agoYup! TSMC wins either way.
- madeofpalk 3y agoI doubt Apple’s going to make some big ChatGPT-style chatbot. They’re “just” going to use the same tech to drive iterative (good!) improvements to their products, like Siri and keyboard auto-complete.
- shrimpx 3y agoYeah. Siri supports text input already, anyway. Siri is their ChatGPT-style bot that's going to keep improving.
- ghusbands 3y agoBut does it even work sensibly, yet? Almost every time my partner asks Siri something, it works so badly that we end up asking Android/Google's Assistant, which responds well to most things.
- qgin 3y agoWhat sort of things don’t work well? Phone actions or knowledge / info type questions?
- fbdab103 3y agoI would challenge the keyboard autocomplete. I find the Apple suggestions to be frustratingly poor vs my experience on Android.
- Booourns 3y agoOut of curiosity have you experienced their autocorrect on iOS 17 because that’s when they updated to be LLM based?
- georgespencer 3y agoTransformer based autocomplete on iOS 17 feels just as bad -- but in different ways -- as its previous incarnation to me.
- theferalrobot 3y agoGiven Apple's track record on anything AI related and the terrible state they keep CoreML that not only seems extraordinarily unlikely, it would take a lot of time to win developer trust and that I just don't see happening.
- mark_l_watson 3y agoI have enjoyed working with CoreML over the last few years. Please share what you didn’t like about it.
- theferalrobot 3y agoThere are so many modern ML components that have terrible or no support in CoreML. Try to do any convolution other than conv2d, advanced or custom activation functions etc and you are out of luck. Exporting from PyTorch leads to all sorts of headaches with subtle behavior changes between implementations it is definitely a pain point for developers of widely used software
- mark_l_watson 3y ago+1 thanks
- hosh 3y agoApple doesn’t have to win developer trust or build an AI platform. They just have to build a compelling consumer product that can only function with AI, and they are better equipped to do that than Google or Microsoft. It remains to be seen if OpenAI will go that route instead of a business built on training and providing access to foundational models.
- theferalrobot 3y ago>They just have to build a compelling consumer product that can only function with AI Yeah and I'm not talking exclusively about developer trust. Given Apple's current consumer lineup (see Siri, Apple photos, predictive text etc)... we only have evidence that they suck at ML. What makes you think they are going to suddenly transform overnight?
- dwaite 3y ago> Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising They don't sell compute time to other companies to run AI, or massive custom hardware for AI training. They aren't after VC funding. Their core business isn't threatened by AI being "the evolution of search" Product-wise, so far all you hear is messaging around things like pointing out the applicability of the M3 Max for running ML models. Until they have real consumer products ready, they only need to keep tabs on analysts, with lip service at financial meetings.
- emmender2 3y agogeneric first-order shallow argument
- zamalek 3y agoYou're suggesting that Apple could fit what can't be done with a 4090 into a laptop? Color me doubtful.
- fennecbutt 3y agoBut Apple will just make a magical chip that's different to regular hardware cause they're the best company and invent all the things even if they've been seen before Apple still invented it first, just wait until their Super Unicorn Ultra™ chip comes out with Hyperdrive Retinated LLM™ support, they don't name normal hardware different just for marketing...it's really unique, new and inventive hardware that we're happy to pay a huge premium for because it's so advanced and inventive.
- slowmovintarget 3y agoPersonal ML systems running on hardware you own is the killer app. If these are "good enough" they'll be significantly preferable to using large subscription-based models, where those companies could pull a Lucy any day.
- gxyt6gfy5t 3y agoI wouldn’t go too far. They didn’t even train this model on Apple hardware. Trained on Nvidia A100s