28 ms·

Apple Intelligence for iPhone, iPad, and Mac

• maxioatic 2y ago
  I might have missed it but did they mention Spotlight at all? That'd be pretty sweet if Spotlight becomes more useful (even a little bit)
• agumonkey 2y ago
  It's not personal computing, it's personal intelligence now :)
• Barbara230 2y ago
  [flagged]
• jdeaton 2y ago
  Maybe we could just get a decent spam filter on imessage?
• BonoboIO 2y ago
  Only on iPhone 15 Pro upwards or M1 Mac’s So only a very small percentage of users will be able to use it.
• _nist 2y ago
  Microsoft delivers AI recall Everyone hates it Apple integrates AI into every facet of a device that is highly personal Everyone loves it Please make it make sense.
• rys 2y ago
  So was there ever a deal with OpenAI? Nothing in the keynote mentioned them or needs them. If there isn’t a deal, I’d love to know how everyone claiming it was signed on the dotted line was led so far down that garden path.
  • philip1209 2y ago
    Sam is there, and the presentation isn't yet finished: https://x.com/markgurman/status/1800198524031906258?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1800198524031906258%7Ctwgr%5Eebbb65aef08924cffe862309f8de1fcc88cec134%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.macrumors.com%2F https://x.com/markgurman/status/1800198524031906258?ref_src=...
    • deleted 2y ago
      [deleted]
  • glial 2y ago
    Siri will have ChatGPT integration (for free, apparently)
  • Tagbert 2y ago
    Yes, they mentioned ChatGPT. Siri reviews the request and decided if it can respond on its own or if it needs ChatGPT. It then pops up a dialog asking if it is OK ti send the request to ChatGPT. It will not be the default LLM.
  • bsaul 2y ago
    That's also my question. What exactly is apple custom LLM, and what is openAI tech ? I'm quite confident in the ability of openAI to provide a great usable LLM tech, but much less so of apple. All the demo they've shown in the WWDC could just fall flat if the tech really isn't working well enough in practice. I guess we'll just have to wait and see..
  • philistine 2y ago
    OpenAI is an option when making a query, but Apple made it sound like the first deal they're making, not the tight collaboration everybody was expecting. They gave more space and reverence to Ubisoft.
  • mh8h 2y ago
    There's an integration with ChatGPT, that requires user approval every time. Sam: https://x.com/sama/status/1800237314360127905 https://x.com/sama/status/1800237314360127905
• cube2222 2y ago
  This seems really cool. They said the models can scale to "private cloud compute" based on Apple Silicon which will be ensured by your device to run "publicly verifiable software" in order to guarantee no misuse of your data. I wonder if their server-side code will be open-source? That'd be positively surprising. Curious to see how this evolves. Anyway, overall looks really really cool. If it works as marketed, then it will be an easy "shut up and take my money". Siri seems to finally be becoming what it was meant to be (I wonder if they're piggy-backing on top of the Shortcuts Actions catalogue to have a wide array of possible actions right away), and the image and emoji generation features that integrate with Apple Photos and other parts of the system look _really_ cool. It seems like it will require M1+ on Macs/iPads, or an iPhone 15 Pro.
  • deleted 2y ago
    [deleted]
  • deleted 2y ago
    [deleted]
  • zitterbewegung 2y ago
    You don't even have to buy a new device since it's backwards compatible with A17 Pro and M1, M2, M3 and M4. It feels like the integration of the services are using existing models and integrating the API used traditionally originally from AppleScript but, extending it to LLM or stable diffusion systems. It seems that they want the M4 as soon as possible though for the gaming and cloud pushes.
  • cube2222 2y ago
    For those curious, there is in fact a ChatGPT integration. The way it works is that when the on-device model decides "this could better be answered by chatgpt" then it will ask you if it should use that. They described it in a way which seems to indicate that it will be pluggable for other models too over time. Notably, ChatGPT 4o will be available for free without creating an OpenAI account.
    • ladams 2y ago
• rvz 2y ago
  Lots of apps have been sherlocked once again and this marks the accelerated race to zero with Apple's entrance with on-device AI all system-wide. No API keys, no prompt engineering or switching between AI models. It. just. works.
  • zombiwoof 2y ago
    Ha ha. Let’s see if it just. Works.
  • Tagbert 2y ago
    I'm glad that they finally brought a better window tiling system. If that sherlocks a couple of dozen utility apps, I'm OK with that. it has been long enough. Some of those apps will be fine as they will probably provide more controls.
• jcfrei 2y ago
  So, is Apple running a proprietary LLM or are they licensing one from OpenAI, Google, etc?
  • theshrike79 2y ago
    Both. Siri is on device and it can talk to ChatGPT
    • oidar 2y ago
      And they can push computer to Apple cloud when compute on the device is not enough.
    • Geee 2y ago
      Siri runs on device and on Apple's cloud which should be more private than ChatGPT. ChatGPT integration is a separate feature, and will include other providers in the future too.
• KolmogorovComp 2y ago
  The WWDC is still ongoing and the stream can be followed here: https://www.apple.com/apple-events/event-stream/ https://www.apple.com/apple-events/event-stream/ (Sharing because I had trouble finding it).
  • deleted 2y ago
    [deleted]
• shepherdjerred 2y ago
  I'm so happy about this. Siri has great voice recognition and voice synthesis, but it really struggled with intent, context, and understanding what I wanted it to do. Combining the existing aspects of Siri with an LLM will, I expect, make it the best voice assistant available.
• jadbox 2y ago
  .. and none of it is open. It's a closed source OS with a proprietary dev cloud service using proprietary model that's only accessible with proprietary sdks.
  • oidar 2y ago
    The "kits" are "openish" to developers. I imagine that many app developers are going to be making models for specific use cases.
• ilaksh 2y ago
  When does this roll out exactly? And exactly which inference actually is on-device? I think people have been fooled by marketing for this one and the new Co-Pilot PCs into thinking that most of the AI really is running on-device. The models that run fast locally are still fairly limited compared to what runs in the cloud.
  • spike021 2y ago
    Usually the OS announced at WWDC is released around mid September.
    • Jtsummers 2y ago
      Specifically, the iOS update comes out with the new iPhones (usually dropping the same day the new devices are available) and the other OSes are usually timed to be released with it since features are shared across the OSes (so they want to release them at the same time) and the beta periods are the same.
  • Tagbert 2y ago
    The public betas will be available later this month. The official OS releases are usually in Sept and Oct. Some of the AI stuff should be available right away but rumors say that some of the more advanced Siri features (like app integration) might not launch until after the first of the year.
• astrodust 2y ago
  At some point I wonder if Apple might share compute across your devices so you can do things on low-power hardware like the Watch while leveraging the CPU on the phone, etc. If Apple's dedicated to on-device compute, this ends up being your own "private cloud" of sorts.
  • vundercind 2y ago
    Too many of their devices in the wild are battery powered, and one really nice thing about them is that their sleep-state battery use is incredibly low while maintaining quick wake-up. Plus it’d be weird UX for all your devices to get worse because the iPad in a drawer somewhere finally ran out of power.
• 1-6 2y ago
  Apple (I reckon): Most people don’t know how to use AI well. It’s our responsibility to pare it all down and release features one by one selling each new software feature as part of next year’s hardware.
  • vundercind 2y ago
    They depicted it working for the A17 through the M4, since those have significant AI-acceleration hardware. So, no.
• nerdjon 2y ago
  I am pretty unhappy with Apple doing the image generation, was really hoping that just would not happen. But a lot of the other features actually seem useful without feeling shoehorned in. At least so far. I am hoping that I can turn off the ability to use a server while keeping local processing, but curious what that would actually look like. Would it just say "sorry can't do that" or something? Is it that there is too much context and it can't happen locally or entire features that only work in the cloud? Edit: OK how they handle the ChatGPT integration I am happy with. Asks me each time if I want to do it. However... using recipe generation as an example... is a choice.
  • theshrike79 2y ago
    It was Google who wanted to put glue on pizza, not ChatGPT :)
    • nerdjon 2y ago
      I feel like I remember there being plenty of examples of bad ChatGPT recipe generation. Regardless, even if it wasn't ChatGPT, given the recent problems I would not have used that as one example given that regardless of who it came from.
  • c1sc0 2y ago
    What’s wrong with the image generation?
    • PodgieTar 2y ago
      I think there's still a myriad of concerns around the ethics of using others uncredited images to power models that aim to disenfranchise artists. but my biggest concern is that I think they look tacky, and putting it right in the messaging apps is gonna be ... irritating.
      • Toutouxc 2y ago
        Emoji, Memoji, stickers, now gen images. Can’t wait to start receiving them from my dad and my mother-in-law in the most absurd of contexts. Like honestly, I like how much the older relatives enjoy weird, tacky stuff like this.
• nsbk 2y ago
  This on-device, private cloud compute, and tight hardware-software integration take may be first useful for all genAI we’ve seen so far. Apple may have actually nailed this one. Edit: except for image generation. That one sucks
  • dmix 2y ago
    Native smartphone integration was always going to be the most important UI for genAI. Followed by maybe search engines once it gets to a certain level of quality (which we seem to be a bit far from). Then either desktop or home(alexa).
  • whimsicalism 2y ago
    > Edit: except for image generation. That one sucks Say more? it's just the media thing about intellectual property rights?
    • c1sc0 2y ago
      I asked up thread and people apparently have concerns about the IP and think that AI images often lack taste.
      • whimsicalism 2y ago
        it's fascinating to see this resurgence of people who now like copyright/IP law
        • rimunroe 2y ago
          I don't know why it's that fascinating. Lots of people think some amount of copyright is reasonable but that life of the author + 70 years is far too long.
          • jwells89 2y ago
            Exactly, nuance is important. Short term protections are good, but companies shouldn’t be able to keep works from entering public domain for decades on end.
• seydor 2y ago
  "we also intend to add support for other models" When they pay us sufficiently It's great that Apple is capitalizing so well on everyone else's inventions, but couldn't they at least pretend they will give something back to the ecosystem? I wish someone somewhere creates something like intents for the web browser
  • vineyardlabs 2y ago
    I would imagine the end goal here is to develop their own internal models (or partner with one of the companies doing open source models) that would be hosted on the Apple Silicon-based cloud they mentioned and then they would not be dependent on anyone else's compute.
• cjk2 2y ago
  This stuff will be well integrated, is useful, will be high quality and doesn't require you to buy new hardware. Microsoft are so boned. They don't even have a mobile proposition.
  • menacingly 2y ago
    microsoft was always going to take SMBs. Data is what makes them useful, so Microsoft keeps their SMBs, Apple gets consumers, Google gets their slice of productivity and android, where their preachy models will let you know if you did a harassment
  • bee_rider 2y ago
    On the contrary this is probably good for MS. Lots of people just don’t want to buy into the Apple ecosystem. MS is dumping R&D money into this ML stuff, apparently without thinking of an actual product or application first. So, now they can just copy Apple.
• PodgieTar 2y ago
  Few thoughts: It seems like this is what Rabbit's LAM was supposed to be. It is interesting to see it work, and I wonder how it will work in practice. I'm not sold on using voice for interacting with things still. Image Generation is gross, I really didn't want this. I am not excited to start seeing how many horrible AI images I'm going to get sent. I like Semantic Search in my photos. This does seem like the typical Apple polish.I think this might be the first main stream application of Gen AI that I can see catching on.
  • Tagbert 2y ago
    I like that they finally brought typing interaction to Siri. You won't always need to use voice. This does look like a real-world implementation of the concept promoted by Rabbit. Apple already had the App Intents API mechanism in place to give them the hooks into the apps. They have also publish articles about their Ferret UI LLM that can look at an app's UI and figure out how to interact with it, if there are no available intents. This is pretty exciting.
    • throwanem 2y ago
      Text as a Siri interface has been available for a while now. Long-press the sleep/wake button to raise the prompt.
      • rcdemski 2y ago
        It has, but it’s presently an accessibility affordance you have to enable first. It’s found under device Settings > Accessibility > Siri > “Type to Siri” On/Off
        • throwanem 2y ago
          Oh, go figure. Let that be a lesson: if you don't check out the accessibility options, you're missing at least half the cool stuff your phone can do to actually make your life easier.
  • 2y ago
• bigyikes 2y ago
  My home is filled with Apple HomePods even though Siri is dumb as rocks. Looking forward to my house gaining a few IQ points. I don’t see anything that mentions HomePod specifically but hopefully the updates will come.
  • eastbound 2y ago
    “Siri, please start the chronometer” “Added ‘start the chronometer’ to your reminders”
  • oidar 2y ago
    I was looking for homepod updates as well - I want to get rid of my Amazon Echo devices with homepods, but siri is #1 Slow #2 Dumb #3 messes up my grocery list. Grocery list and timers are the main use case for Amazon Echos - I really hope apple fixes it soon.
    • cromka 2y ago
      But HomePod isn’t powerful enough, all the processing would likely have to be online. They’ll fix it but with future models only
• mav3ri3k 2y ago
  Really excited about semantic index. This should allow for google knowledge graph like features grounded in reality for their llm. However it really depends how well it works.
• cuuupid 2y ago
  I really hope we can fully turn off the GPT4o integration even more than just saying no to every escalation
• boringg 2y ago
  So is this finally privacy based AI with personal memory included? Ie bespoke AI for your own stack that isn't out in the world.
  • teilo 2y ago
    It’s an on-device RAG.
    • Slyfox33 2y ago
      No it's not. "To run more complex requests that require more processing power, Private Cloud Compute extends the privacy and security of Apple devices into the cloud to unlock even more intelligence. With Private Cloud Compute, Apple Intelligence can flex and scale its computational capacity and draw on larger, server-based models for more complex requests."
• menacingly 2y ago
  The privacy conversation was pretty shady, and honestly full of technical holes with pointless misleading distractions
  • toddmorey 2y ago
    I thought privacy was really well handled for a high-level overview. Basically it seems like anything thing it can't do on device uses ephemeral private compute with no stored data. Any data sent to 3rd party AI models requests your consent first. The details will need to emerge on how they live up to this vision, but I think it's the best AI privacy model so far. I only wish they'd go further and release the Apple Intelligence models as open source.
    • uoaei 2y ago
      Considering they spent the first half of that segment throwing shade at people who claim privacy guarantees without any way to verify them, Apple hopefully will provide a very robust verification process.
      • solarkraft 2y ago
        Like they've done in the past, huh? They talk about "independent experts" a bit, which I remember being hindered (and sued?) by them rather than supported.
        • uoaei 2y ago
          Yep initiatives like these have a nasty habit of being underfunded and deprioritized.
    • menacingly 2y ago
      if the servers are so private, why is on-device such a win? here are some irrelevant distractions: - the cpu arch of the servers - mentioning that you have to trust vendors not to keep your data, then announcing a cloud architecture where you have to trust them not to keep your data - pushing the verifiability of the phone image, when all we ever cared about was what they sent to servers - only "relevant" data is sent, which over time is everything, and since they never give anyone fine-grained control over anything, the llm will quietly determine what's relevant - the mention that the data is encrypted, which of course it isn't, since they couldn't inference. They mean in flight, which hopefully _everything_ is, so it's irrelevant
• breadwinner 2y ago
  I thought it was underwhelming. The fact that integration with ChatGPT is not seamless pours cold water over it. Siri will seek your permission each time before passing the question to ChatGPT. I can avoid that step by using ChatGPT directly.
  • notdarkyet 2y ago
    There are a lot of people who do not want their phone seamlessly hooked into anything OpenAI touches. Choice is important
  • tr3ntg 2y ago
    I think this is good. For folks like you, that will always be an option. For people that have yet to touch ChatGPT and "still don't know how to access AI" (I've heard this sentiment from many people that couldn't care less about it all) it's a perfect balance. Siri will operate as you expect, until one day it prompts you to pass your question over to ChatGPT. You can opt out or give it a try. I do agree that the extra tap is a bummer for anyone that wanted ChatGPT baked into the OS, even easier to access than it is in the ChatGPT app.
  • kaba0 2y ago
    But it has an on-device LLM plus an in-cloud LLM, that can handle many types of queries, so why would it be bad?
  • TaylorAlexander 2y ago
    Personally I feel less and less comfortable giving OpenAI access to my private data tho, so I’m really happy there’s a divide. As you said, if you really just need ChatGPT for something you can open that app. But I’m happy the default isn’t to send all Apple users requests to OpenAI all the time.
  • nerdjon 2y ago
    On the opposite side, it not being seamless is entirely why I would actually trust using the new Siri with any sensitive data. I am not entirely sure I will ever actually allow it to connect to ChatGPT for privacy reasons, but having the option when it can't be handled another way is nice. I imagine this is more a stopgap until more and more of this can happen locally anyways. Especially since it sounds like Siri determins when it should reach out.
• PodgieTar 2y ago
  It is funny to think about how many Apps have probably built text-generation into their product, just to get it enabled on Apple Devices for free.
• TIPSIO 2y ago
  It was a very quick mention, but Siri will now have a text button directly on the lock screen. If we assume AI will get even 3-4x better, at a certain point, I can't help but think this is the future of computing. Most users on mobile won't even need to open other apps. We really are headed for agents doing mostly everything for us.
  • tr3ntg 2y ago
    And with ChatGPT's direct integration into Siri, ChatGPT will be available to anyone using iOS for free, without an account. Interesting.
  • singularity2001 2y ago
    Except the Intent API is completely crippled. Maybe the next big OS will just let the AI parse existing menus and figure out all the potential actions an app can take. Some actions need complex objects, so we need a new general mechanism for AIs to connect to 'exported functions'. Some general OS rethinking is overdue. Or maybe Android is ready for this? Haven't looked into it since they made development impossible via gradle. Despite this negativity the announcements were better than expected, rebranding AI is bold and funny. But the future will belong to general Agents, not a hardcoded one as presented.
    • solarkraft 2y ago
      Android theoretically has a pretty rich intent API, but like anything on Android adoption is a big meh.
  • denimnerd42 2y ago
    Siri already has an optional text button on the lockscreen. They changed the shortcut though. For me in ios17 it's a long press on the side button.
• doctoboggan 2y ago
  Apple trying to rebrand AI = "Apple Intelligence" is a totally Apple thing to do. I'll be curious to see if Apple gets caught with some surprise or scandal from unexpected behavior in their generative models. I expect that the rollout will be smoother than Bing or Google's first attempts, but I don't think even Apple will prove capable of identifying and mitigating all possible edge cases. I noticed during the livestream that the re-write feature generated some pretty bad text, with all the hallmarks of gen AI content. That's not a good sign for this feature, especially considering they thought it was good enough to include in the presentation.
  • tr3ntg 2y ago
    I noticed this too. I quickly skimmed a rewritten email and it was totally wooden. It's the one where they ask the AI to reword their rant that includes tons of all-caps words. The output is almost worse, dripping in a passive aggressive tone.
  • lacy_tinpot 2y ago
    It's bad branding because they can't use the "AI" abbreviation. It's too commonly used to be appropriated by Apple. Honestly calling it "Apple Intelligence" just feels a little lazy.
  • tonynator 2y ago
    It's good enough for the typical Apple consumer.
    • xanderlewis 2y ago
      Please don't sneer, including at the rest of the community. - HN Guidelines.
  • ukuina 2y ago
    > the re-write feature generated some pretty bad text, with all the hallmarks of gen AI content This is the curse of small-language models. They are better suited for constrained output like categorization. Using them for email generation takes... well, that takes courage. Thankfully, there is an option to use GPT-4o for many of the text generation tasks.
• riversflow 2y ago
  > coming to iPhone 15 pro, iPad and Mac with M1 or later. I assume it will come to all the iPhone 16’s this fall? Or is Apple Intelligence a Pro Feature? Either way, my first reaction is that this is going to sell a lot of iPhones.
  • Jtsummers 2y ago
    Apple's phones have, for several years now, been on a tick/tock sort of pattern. iPhone N Pro has the new CPU (15 Pro got the A17) and iPhone N uses the prior gen pro CPU (15 got the A16, which was in the iPhone 14 Pro). So this is probably an A17+ feature. If they stick to form, the iPhone 16 will have the A17 processor and the iPhone 16 Pro will have the A18. That's part of the differentiation between (on the phones) the Pro and non-Pro these days with the Pro getting all the new stuff, and non-Pro getting a partially improved (and partially degraded, usually wrt the camera) Pro from the prior year.
    • Toutouxc 2y ago
      Actually 15 Pro has the A17 “Pro” SoC, while the regular 15 uses the last gen A16 Bionic (Bionic being the regular version). We don’t know whether the next regular iPhone will get the last-gen A17 Pro (which would be a little confusing), or a “last-gen-but-new” A17 Bionic or if they’ll go with 18 Bionic + Pro.
      • deleted 2y ago
        [deleted]
• rasengan 2y ago
  Much thanks goes out to Microsoft and Apple for handing the Desktop to Linux!
• breadwinner 2y ago
  The worst part of Apple Intelligence is that it will now be a layer in between you and your friends & family. Every message will now be "cleaned up" by Apple Intelligence so you are not directly talking with your mom, best friend etc.
  • ducadveritatem 2y ago
    I actually liked that they didn’t show any of the AI writing capabilities being used in iMessage but rather in email client for more professional contexts. I’m really curious to see if they make it available in iMessage…
• lambdasmith 2y ago
  How is this going to affect battery life realistically with all the semantic indexing going on in the background?
• visarga 2y ago
  It's either "Apple Intelligence" or "Generative Intelligence", not "Artificial Intelligence" and "Generative Models"... so silly to brand common ideas with a small twist. Basically all your information is sucked into a semantic system, and your apps are accessible to a LLM. All with closed models and trusted auditors. Also funny how they pretend it's a great breakthrough when Siri was stupid-Siri for so many years and only now is lately coming to the AI party. I really hope those gen-images won't be used to ridicule and bully other people. I think it's kind of daring to use images of known people without their consent, relying on the idea that you know them. And it's dawning on me that we are already neck-deep in AI. It's flowing through every app and private information. They obliterate any privacy in this system, for the model.
  • stnmtn 2y ago
    Would you rather they have jumped onto AI early and LLM-ified Siri years ago?
    • visarga 2y ago
      It's late but better late than...
• whimsicalism 2y ago
  It's interesting how positive the commentary is here. I am generally much more pro-AI than the average HN commentator, but frankly I find this release completely underwhelming. Just replace Siri with chatgpt and give it actions, that is what everyone wants - why can't we have that?
  • kaba0 2y ago
    They have literally revamped Siri, and based it on an LLM that runs on-device, and can use your personal context, plus can escalate to a private cloud model when it deems “weak” for the task at hand. How the hell is it underwhelming?
  • Geee 2y ago
    Absolutely no one wants to hand their private information to any company, especially OpenAI. Everyone was waiting for an on-device LLM from Apple and they delivered.
    • Slyfox33 2y ago
      Why does everyone here seem to think its entirely on device? They literally mention in the article "To run more complex requests that require more processing power, Private Cloud Compute extends the privacy and security of Apple devices into the cloud to unlock even more intelligence. With Private Cloud Compute, Apple Intelligence can flex and scale its computational capacity and draw on larger, server-based models for more complex requests."
• minimaxir 2y ago
  The name and attempted reappropriation of the term "AI" is going to make SEO a pain in the ass.
  • dylan604 2y ago
    good. SEO should die in a dumpster fire. in fact, i would love to create a genmoji of that very thing
  • deleted 2y ago
    [deleted]
• dragon_greens 2y ago
  I wonder if this will become a paid feature or part of iCloud+ later on. Or do they expect it to be mostly on device models driven?
  • c1sc0 2y ago
    It’s all free
• nkotov 2y ago
  While I think it's cool and I appreciate Apple crafting better stories on why this is helpful, I still think for the everyday person, they won't really care if it's AI or not.
  • smith7018 2y ago
    Most of Apple's announcements today featured AI but the term wasn't explicitly mentioned. I think the last portion of the keynote that focused on AI was merely for investors tbh
  • gkoberger 2y ago
    Agreed! And the UI seemed pretty focused on not really clarifying too much; I think they just mentioned AI a lot since it was WWDC.
  • dylan604 2y ago
    But Apple's integration means you can use it and not care if it is AI or not. It'll just become part of using iOS (let's face it, that's were the majority of Apple's users will be). From creating a new "genmoji" to any of the other examples of allowing people to do this without know WTF huggingface or the other equally ridiculously named products are. They don't need accounts. They just type a message and decide to put in a new image. Of course we've only seen examples from an overly produced hype/propaganda video, but it looks to me of yet another example of Apple taking products and making them usable to the masses
    • FireBeyond 2y ago
      > but it looks to me of yet another example of Apple taking products and making them usable to the masses This is a bit obsequious to Apple. I find it hard to give a cogent argument of how ChatGPT is not "usable to the masses" at this point (and being -used- by the masses).
      • theshrike79 2y ago
        It doesn't integrate to anything, you need to explicitly give it context every time you ask it something. You can't just log in to ChatGPT and ask it what was on your calendar 2 weeks ago.
• mfiguiere 2y ago
  > Privacy protections are built in for users who access ChatGPT — their IP addresses are obscured, and OpenAI won’t store requests. ChatGPT’s data-use policies apply for users who choose to connect their account. > ChatGPT will come to iOS 18, iPadOS 18, and macOS Sequoia later this year, powered by GPT-4o.
  • talldayo 2y ago
    > and OpenAI won’t store requests. What's a promise from Sam Altman worth, again?
    • spacebanana7 2y ago
      Even if the promise were made in good faith, I fear it may be hard to resist pressure from law enforcement etc.
      • Turing_Machine 2y ago
        If Apple is sitting in the middle proxying the IP addresses, and not keeping any logs for longer than they absolutely need to, law enforcement could go pee up a rope, right?
        • talldayo 2y ago
          You'd hope so, but corporate resistance against domestic intelligence has a bumpy track record: https://arstechnica.com/tech-policy/2023/12/apple-admits-to-secretly-giving-governments-push-notification-data/ https://arstechnica.com/tech-policy/2023/12/apple-admits-to-...
    • educasean 2y ago
      Tim Cook doesn't seem to mind hanging his reputation on sama's promise, so at least that's something
    • minimaxir 2y ago
      The promise is from Apple, not OpenAI, and likely contractual. If OpenAI actually went against that, Apple would unleash the mother of all lawsuits.
• ChrisLTD 2y ago
  What Apple showed in the demo looks tastefully done. The jury is out on how useful it will be in day to day use, but it'll be nice to have the ability to ask AI for help with text, search, and images without resorting to copying and pasting between ChatGPT or some other AI app.
• Tomte 2y ago
  No transcripts in Voice Memos? The one feature I was surprised hasn‘t already been there for years, heavily rumored before this WWDC, and now nothing?
  • deleted 2y ago
    [deleted]
  • andrewmunsell 2y ago
    From MacRumors: > Notes can record and transcribe audio. When your recording is finished, Apple Intelligence automatically generates a summary. Recording and summaries coming to phone calls too. So the functionality exists, maybe just not in the Voice Memos app?
    • Tomte 2y ago
      That would be great, the three or so articles I read said nothing about it. Thanks!
• teolandon 2y ago
  I wish there was a way to leverage my M1 Mac to use this on my iPhone Pro 14. Like a private connection between my phone and computer to use the more powerful chip, even if it's limited to when I'm at home on the same Wi-Fi. Latency shouldn't be too bad. But I think Apple is going to limit iPhones from doing something like that to boost sales of the 15 Pro and the future gens.
  • ahmeneeroe-v2 2y ago
    Yes, I would love the escalation path to be: on-device -> owned Mac -> "private cloud"
• jbverschoor 2y ago
  Looks like a very similar strategy as Google Maps on the initial iPhone
• newhaus1994 2y ago
  the natural language tasking for actions between apps is the first thing that's made me excited about anything related to the latest AI craze. if apple can keep it actually private/secure, I'm looking forward to this.
• thomasqbrady 2y ago
  I’m super confused. 1. What is under the “Apple Intelligence” umbrella and what isn’t? There were a lot of AI features shown before that branding was brought up, I think. 2. The only supported iPhone is the iPhone 15 Pro? But any M1 iPad? Does this mean “Apple Intelligence” or all AI features announced? For instance… 3. For instance, is private cloud compute only available on iPhone 15 Pro?
• m3kw9 2y ago
  So they have models running on Apple silicone in the cloud, does that mean it’s running its own models?
  • machinekob 2y ago
    Or just opensource models
  • Tagbert 2y ago
    Ajax is the name of their home-grown LLM. Ferret UI is another model that they have published papers on that lets them look at the UI of an app to understand how to interact and automate it.
• ahmeneeroe-v2 2y ago
  For a brief moment at the intro of "private cloud compute" I was so hopeful that I could have a home-based Mac server for my own private iCloud and "Apple intelligence".
• hu3 2y ago
  Am I understanding correctly that some AI will run on Apple servers? So not completely offline AI. If so that's somewhat disappointing given how much AI power Apple hardware packs. > Apple sets a new standard for privacy in AI, with the ability to flex and scale computational capacity between on-device processing and larger, server-based models that run on dedicated Apple silicon servers
  • dylan604 2y ago
    The interesting thing I took from that is they are making servers with M-series chips. Maybe they're just rack mounted Mac Minis? But if Apple decides that crap, maybe it'll get them to a point where they decided to make a proper rack mountable form factor available??? <genmojiTechPrayingInFrontOfRack>
  • Almondsetat 2y ago
    I think it's a little disingenuous to think on-device accelerators on a mobile phone would be able to do literally any AI task without help
    • ducadveritatem 2y ago
      Based on their presentations yesterday and accompanying written materials they have a pretty capable ~3B parameter Foundational LLM running fully locally on the devices which is the first line. https://machinelearning.apple.com/research/introducing-apple-foundation-models https://machinelearning.apple.com/research/introducing-apple...
  • onesociety2022 2y ago
    Maybe that is actually good for iPhone buyers? Otherwise every 2 years, they will claim a bunch of new AI features will not work on your older device. But if they can delegate requests to a server, older devices can continue receiving newer AI features from future iOS releases (they will just be slower than the newer iPhones which will run them locally).
• nottorp 2y ago
  I have only one question: can I turn it off?
  • martimarkov 2y ago
    Which part? The online or offline capabilities?
  • gkoberger 2y ago
    Why? Things are secure (outside of the explicit OpenAI calls via Siri) and mostly seem subtly integrated. You don't have to use each feature, but why blindly disable all AI having not even tried it?
    • HWR_14 2y ago
      Why take up processor time or memory for a feature I don't want? Or the increase in threat space?
      • Almondsetat 2y ago
        This could be said for literally every single feature of a smartphone, down to the out of order execution of the CPU
        • HWR_14 2y ago
          Yes. I would like to be able to disable other smartphone features I don't use. But that's already the case. Like the GPS, for instance, is disabled unless I'm using the map. And even that can be set to "never" if I want.
        • nottorp 2y ago
          I also have animations toned down from the accessibility settings, yes :)
        • hot_gril 2y ago
          That's exactly why I wait extra long to install updates.
• algesten 2y ago
  "Semantic Index" sure is a better name than "Recall". Question is whether I can exfiltrate all my personal data in seconds?
  • gigel82 2y ago
    It's all in the "private cloud". "Trust me bro", it's like totally private, only us and a handful of governments can read it.
    • algesten 2y ago
      Yeah. It's going to be great. Selected experts are saying so.
  • fmbb 2y ago
    I mean I can already search my photos for “dog” or “burger” or words in text on photos. Adding an LLM to chat about it is just a new interface is it not?
    • algesten 2y ago
      I think the important thing is that the semantic index tracks all you do through all your apps.
      • deleted 2y ago
        [deleted]
    • qeternity 2y ago
      They are likely implemented very differently. I’m not certain but I imagine the current photos app uses an image model to detect and label objects which you can search against. I expect Semantic Index (by virtue of the name) to be a vector store of embeddings.
  • anonbanker 2y ago
    I'm sure a simple Webkit vulnerability (there's none of those, ever, right?) will definitely not ensure that Semantic Index is featured in a future pwn2own competition.
• amrrs 2y ago
  Slap on the face all Cloud based LLM providers!
  • talldayo 2y ago
    Or pay them, for a deal that gives you access to a competitor's product.
• rasengan 2y ago
  There has never been a better time to move to Linux. Have you tried Omakub? Manjaro? Mint? Ubuntu 24? These are polished and complete alternatives and your favorite app probably has a Linux build already!
  • jawngee 2y ago
    | These are polished and complete alternatives Are they though? I just setup ubuntu 24 for my son to play games and it's comparatively a very unpolished experience. I'm being very polite when I say that.
    • rasengan 2y ago
      That's interesting - it was Ubuntu 24 that made me feel confident the first time to recommend to non-computer enthusiasts. What about Ubuntu 24 came off unpolished to you, if you don't mind me asking?
    • jwells89 2y ago
      Even as someone who keeps a laptop booted into Linux most of the time, yes there are bumps and rough edges that will be encountered once venturing off the most common path of “internet, video, and word processor box”. It’s much better than it once was but it still has problems and the way that fervent advocates try to sweep them under the rug doesn’t help the situation.
    • anonbanker 2y ago
      Ubuntu, sadly, is not a good experience for a multitude of reasons outside of Canonical's control, including codec and software licensing restrictions. Gamers should absolutely be heading towards Nobara Linux (Fedora-based, created by GloriousEggroll of Proton-GE fame). Developers should be trying Omakub. Grandma and Grandpa should be using Linux Mint.
  • anonbanker 2y ago
    Trying Omakub in the next 48-72 hours. I can't wait. It looks like the curated experience I've been looking for.
• skilled 2y ago
  They did a lot of work for this release, and the number of integrations is beyond what I expected. In a few years time you might not need to hold your phone at all and just get everything done with voice - kind of cool, actually. Auto transcripts for calls (with permission) is another feature I really liked. I was a little surprised to see/hear no mention of inaccuracies, but for ChatGPT they did show the "Check for important facts" notice.
  • culopatin 2y ago
    That sounds like what Humane is trying to do. But I would honestly hate to do everything by voice and have everyone around me know what I’m doing and hear everyone around me talk to their phones all the time. Sounds like a nightmare
    • Tagbert 2y ago
      I would expect it to be situational. I also was happy to see that they introduced a typed interface to Siri so you can do this without speaking.
    • realfeel78 2y ago
      > That sounds like what Humane is trying to do. The only thing Humane was trying to do was scam their investors. Let us never speak of them again.
  • amne 2y ago
    So far the only reasonable place I can think of where I could find myself actually using voice to control anything is on the toilet. that's it
    • runeb 2y ago
      Walking, cycling, running, driving, relaxing on the couch
      • amne 2y ago
• skc 2y ago
  Calling it Apple Intelligence seems a bit short sighted to me considering how quickly things are moving in this space. There's a danger that before long, the stuff Apple will take ages to implement into their devices will seem dated compared to the state of the art less encumbered players will be rolling out. I felt that a few times watching them demo image generation and contextual conversations.
  • throwanem 2y ago
    For broadly similar reasons, I think it's a wise move to ensure Apple's AI services exist under a brand Apple entirely controls.
  • krackers 2y ago
    Jack Ma was ahead of his time in calling "AI" Alibaba Intelligence
• Mxmilan 2y ago
  [dead]
• rqtwteye 2y ago
  It’s a little disappointing that even big companies like Apple jump on OpenAI instead of building their own thing. Diversity seems pretty important with AI.
  • frenchie4111 2y ago
    Unfortunately OpenAI has a pretty big "dollars and hours spent on GPUs" moat right now. I imagine Apple is already hard at work building their own models, but until then they will leverage 3rd parties
    • YetAnotherNick 2y ago
      Apple has 10x more on reserve cash than the entirety of OpenAI when they trained GPT-4. I don't think OpenAI could have possibly spent $5B or more for training first version of GPT-4(which was trained before GPT-3.5 gained traction), which is a pocket change for Apple for such a core feature.
  • fsto 2y ago
    They use OpenAI as an optional fallback model. Adding support for more models later. I’m positively surprised they’re not trying to solve everything with their own tech.
    • dylan604 2y ago
      Or, use existing now to get it going, then swap out for your own thing later. Hopefully, it will be better than previous swaps so that it doesn't be a meme worthy of being mocked in a comedy show "is it Apple Maps bad?"
  • kristjansson 2y ago
    All the interesting features appear to be de novo models from Apple? Only the last fallback-to-ChatGPT feature interacts with OpenAI.
• cube2222 2y ago
  This seems really cool. They said the models can scale to "private cloud compute" based on Apple Silicon which will be ensured by your device to run "publicly verifiable software" in order to guarantee no misuse of your data. I wonder if their server-side code will be open-source? That'd be positively surprising. Curious to see how this evolves. Anyway, overall looks really really cool. If it works as marketed, then it will be an easy "shut up and take my money". Siri seems to finally be becoming what it was meant to be (I wonder if they're piggy-backing on top of the Shortcuts Actions catalogue to have a wide array of possible actions right away), and the image and emoji generation features that integrate with Apple Photos and other parts of the system look _really_ cool. It seems like it will require M1+ on Macs/iPads, or an iPhone 15 Pro.
  • deleted 2y ago
    [deleted]
  • TillE 2y ago
    > I wonder if their server-side code will be open-source No, but they said it'll be available for audit by independent experts.
    • anonbanker 2y ago
      How do we sign up to be an independent expert? We need about 50,000 eyeballs on this at all times.
      • theshrike79 2y ago
        How many independent eyeballs are on Gemini's servers or OpenAI's?
        • ENGNR 2y ago
          They're not making the privacy claim
    • TheFragenTaken 2y ago
• alberth 2y ago
  Regarding OpenAI, has Apple in its history ever relied so heavily on a 3rd party for software features? (TSMC for hardware, but it seems very un-Apple to be so dependent upon someone else for software capabilities like OpenAI)
  • pat2man 2y ago
    Google Maps, YouTube, on the original iPhone?
    • alberth 2y ago
      But those were standalone apps. This AI capability is integrated throughout the entire OS and Apps. It's now part of the "fabric" of iOS.
      • Tagbert 2y ago
        Only in response to some classes of requests. They didn’t go into detail about when but they said that the local Siri LLM would evaluate the request and decide if it could be services locally, in their private cloud AI, or would need to use OpenAI. Then it would pop up a requesting asking if you want to send the request to OpenAI. It doesn’t look like that would a particularly common occurrence. Seems like it would be needed for “answerbot” type of requests where live web data is being requested.
      • mholm 2y ago
        The majority of this is local AI with nothing to do with openAI. Only particularly complex requests go to them
  • paradite 2y ago
    Does Microsoft Office in early days of Mac OS count? I guess not.
    • philwelch 2y ago
      Microsoft Office was released five years after the Macintosh; what are you talking about?
• TIPSIO 2y ago
  So the future of computing really is AI agents doing everything: - siri text chat now on the lock screen - incoming a billion developer app functions/APIs - better notifications - can make network requests Why even open any other app?
  • terramex 2y ago
    > Why even open any other app? This was my first thought when I saw Rabbit r1 - will all of us become backend developers just glueing various API between legacy services and LLMs? Today seems like another step in that direction.
    • imabotbeep2937 2y ago
      The whole world will be headless content. There won't be any web pages, or bank sites, or TV networks. Nobody will be a developer. We'll all just be content authors, like Google Maps Guides basically being unpaid interns checking restaurant data for Google. You open your phone, it just shovels content. And it does absolutely nothing but optimize on addiction. No apps, only masters.
  • imabotbeep2937 2y ago
    Nobody is realizing this coming singularity. Your phone won't do anything else. For 99% of people, they pick up their phone, AI will just decide what they want to see. And most will accept it. Someday everyone in the room will all pick up their phones when they all ring at once. It will be some emotional trigger like a live feed from a school shooting. Everyone in the room will start screaming at the totally different experiences they're being presented. Evil liberals, clueless law enforcement, product placement being shown over the shooter's gun. You'll sit horrified because you returned to a dumbphone to escape. That will be the reality if this AI assistant stuff isn't checked hard now. AI is getting better at addiction an order of magnitude faster than it's getting better at actual tasks.
    • c1sc0 2y ago
      Not necessarily, that entirely depends on the reward function being used, but I get your point.
• jspann 2y ago
  I remain skeptical until I see it in action. On the one hand, Apple has a good track record with privacy and keeping things on device. On the other, there was too much ambiguity around this announcement. What is the threshold for running something in the cloud? How is your personal model used across devices - does that mean it briefly moves to the cloud? How does its usage change across guest modes? Even the phrase "OpenAI won’t store requests" feels intentionally opaque. I was personally holding out for a federated learning approach where multiple Apple devices could be used to process a request but I guess the Occam's razor prevails. I'll wait and see.
  • tmpz22 2y ago
    They need to provide a mechanism to view the data being uploaded by you
  • machinekob 2y ago
    Same they say privacy so many times i got Facebook PTSD.
    • boringg 2y ago
      I mean theres a difference between these companies on their privacy stance historical and current.
  • robbyking 2y ago
    > What is the threshold for running something in the cloud? To be fair, this was just the keynote -- details will be revealed in the sessions.
  • epolanski 2y ago
    > has a good track record with privacy They repeated this so many times they've made it true.
    • theshrike79 2y ago
      Do you have proof otherwise? Compared to the competition, who openly use everything about you to build a profile.
• xrisk 2y ago
  It seems that the Apple intelligence stuff will be 15 Pro. Man, I just bought a 15 ~8 months ago. That really sucks.
  • deleted 2y ago
    [deleted]
  • theswifter01 2y ago
    For real, I’m sure a fair amount of previous processors are able to handle it fine, just a reason for ppl to buy the next phone
• deleted 2y ago
  [deleted]
• JohnMakin 2y ago
  I am excited to try Siri with this technology enabled. I can't really remember a time when siri ever really worked, although recently I actually got her to play a song on youtube for me after a few attempts and was pretty pleased with that. Outside of "set my alarm for 4:30" kind of stuff, she's never really been that useful, and if you are even kind of disabled, this feature can be really useful to the point of life changing if it is done properly.
• deleted 2y ago
  [deleted]
• davidbarker 2y ago
  So, if I've got this correct there's: 1. On-device AI 2. AI using Apple's servers 3. AI using ChatGPT/OpenAI's services (and others in the future) Number 1 will pass to number 2 if it thinks it requires the extra processing power, but number 3 will only be invoked with explicit user permission. [Edit: As pointed out below, other providers will be coming eventually.]
  • frenchie4111 2y ago
    That was my sense as well. I would have appreciated some clarification on where the line between 1 and 2 was, although I am sure a YouTuber will deep dive on it as soon as they have it in their hands
  • gigel82 2y ago
    The problem is they don't explicitly define when 1 can pass to 2 and whether we can fully and categorically disable it. As far as I know, 1 can pass to 2 when governments ask for some personal data or when Apple's ad model needs some intimate details for personalization.
    • Tagbert 2y ago
      The information provided for level two is end to end encrypted and not stored so the risk level is pretty low here.
      • coolspot 2y ago
        Ent-to-end encrypted means that the other end (Apple/NSA) has access to it.
        • Tagbert 2y ago
          It does need to process the data. The server has no persistent storage and no remote shell. It is a limited and locked down special-purpose iOS.
• DaveChurchill 2y ago
  Great! How do I opt out?
• the_arun 2y ago
  Wouldn't this reduce sales for Grammerly? If Apple packs the same feature for every application in iOS, it is kinda cool. Private Cloud - Isn't this what Amazon did with their tablet - Fire? What is the difference with Apple Private Cloud?
  • nehal3m 2y ago
    > Wouldn't this reduce sales for Grammerly? There's a term for that, it's called being Sherlocked: https://www.howtogeek.com/297651/what-does-it-mean-when-a-company-sherlocks-an-app/ https://www.howtogeek.com/297651/what-does-it-mean-when-a-co...
  • gherkinnn 2y ago
    After years and years of annoying ads, Grammarly taking a hit is the least they deserve
    • kylehotchkiss 2y ago
      Agreed! I'm happy to not have to hear about them anymore.
  • terramex 2y ago
    > Wouldn't this reduce sales for Grammerly? https://en.wikipedia.org/wiki/Sherlock_(software)#Sherlocked_as_a_term https://en.wikipedia.org/wiki/Sherlock_(software)#Sherlocked... > Sherlocked as a term > The phenomenon of Apple releasing a feature that supplants or obviates third-party software is so well known that being Sherlocked has become an accepted term used within the Mac and iOS developer community.[2][3][4]
    • thisarticle 2y ago
      1Password too.
      • jerbear4328 2y ago
        Well, the Passwords app is just the Passwords section in Settings moved out into its own app. It already exists on Windows, too, but maybe they are updating it to allow autofill without using a Chrome extension or add other features. It isn't the biggest change, just bringing attention to an existing feature that already competes with 1Password et al.
• TechnicolorByte 2y ago
  Have to say, I was thoroughly impressed by what Apple showed today with all this Personal AI stuff. And it proves that the real power of consumer AI will be in the hands of the platform owners where you have most of your digital life in already (Apple or Google for messaging, mail, photos, apps; Microsoft for work and/or life). The way Siri can now perform actions based on context from emails and messages like setting calendar and reservations or asking about someone’s flight is so useful (can’t tell you how many times my brother didn’t bother to check the flight code I sent him via message when he asks me when I’m landing for pickup!). I always saw this level of personal intelligence to come about at some point, but I didn’t expect Apple to hit it out of the park so strongly. Benefit of drawing people into their ecosystem. Nevermind all the thought put into private cloud, integration with ChatGPT, the image generation playground, and Genmoji. I can genuinely see all this being useful for “the rest of us,” to quote Craig. As someone who’s taken a pessimistic view of Apple software innovation the last several years, I’m amazed. One caveat: the image generation of real people was super uncanny and made me uncomfortable. I would not be happy to receive one of those cold and impersonal, low-effort images as a birthday wish.
  • imabotbeep2937 2y ago
    "brother didn’t bother to check the flight code I sent him via message when he asks me when I’m landing for pickup" Yeah but what about people going to the wrong airport, or getting scammed by taking fake information uncritically? "Well it worked for me and anyway AI will get better.". Amen.
    • lancesells 2y ago
      Even moreso why does brother take the time to bring up Siri if he can't read the flight code? It's the same thing correct?
      • cchance 2y ago
        You do know siri works while driving and other times when you don't want to go fumbling around?
• r0m4n0 2y ago
  Big partnership for OpenAI. Incredible Apple decided to integrate with a third party like this directly into the OS. This feels like something Apple could have executed well by themselves. I was hoping they weren't going to outsource but I suppose the rumors while they were shopping around were true. I think this further confirms that they think these AI services are a commodity that they don't feel a need to compete with for the time being.
  • avtar 2y ago
    > This feels like something Apple could have executed well by themselves. I was hoping they weren't going to outsource Who is to say they aren't eventually going to replace the OpenAI integration with an in-house solution later down the line? Apple Maps was released in 2012, before that they relied on Google Maps.
    • r0m4n0 2y ago
      My bet is on an trial/acquisition if it works out. I guess that could be complicated with the current ownership structure
  • Tagbert 2y ago
    They seem to have kept the OpenAI integration to a minimum, only using it for requests that need large scale processing or for web trivia type of requests.
    • Jtsummers 2y ago
      And apparently via Siri, not as part of their other integrations. So you ask something, Siri suggests ChatGPT, you agree to send the prompt. It's not built into the other ML related capabilities.
• MailleQuiMaille 2y ago
  [flagged]
  • zooweemama 2y ago
    Maybe they all used the same generative model to write the comments? More seriously(?), I thought "cool" is just what everybody writes to show appreciation when they have nothing else to say.
  • Tagbert 2y ago
    I thought it was very cool and very close to what I had hoped that they would do. Does that automatically make me into someone from PR? What is the benefits package, in that case? /s
  • gigel82 2y ago
    No, no... Apple is totally cool and private. This is totally not like Recall at all, it's semantic index - and it only goes to the "private cloud" some of the times with your data.
    • azinman2 2y ago
      Recall is taking screenshots and performing ocr, stored in what turned out to be clear text. Semantic index is spotlight’s next version, which you already have on your devices. It’s quite different.
      • gigel82 2y ago
        Semantic index is doing an even deeper level of integration where clear text is pushed from iMessage, email and more so no need for OCR. Where Apple is worse than MS here is that this data may be pushed to their cloud in addition to local processing (with no clear guidelines on under what conditions that happen or how to stop it from happening).
  • doctorpangloss 2y ago
    I couldn't find any of the people you were talking about.
• throwaway71271 2y ago
  Amazing how Microsoft, Google and now Apple are racing to 'generate' more and more text and images, and they also race to 'summarize' the now generated texts because everything is just noise. Like an anxious digital beehive. By the end of the year maybe 1% of the content you interact with will be human made. Even now in HN maybe 20-30% of the comments are generated by various transformers, but it seems every input box on every OS now has a context aware 'generate' button, so I suspect it will be way more in few months. The Eternal September is coming. (and by ironic coincidence it might actually be in September haha)
• asimpletune 2y ago
  Their demos looked like how I imagined AI before ChatGPT ever existed. It was a personalized, context aware, deeply integrated way of interacting with your whole system. I really enjoyed the explanation for how they planned on tackling server-enabled AI tasks while making the best possible effort to keep your requests private. Auditable server software that runs on Apple hardware is probably as good as you can get for tasks like that. Even better would be making it OSS. There was one demo where you could talk to Siri about your mom and it would understand the context because of stuff that she (your mom) had written in one of her emails to you... that's the kind of stuff that I think we all imagined an AI world would look like. I'm really impressed with the vision they described and I think they honestly jumped to the lead of the pack in an important way that hasn't been well considered up until this point. It's not just the raw AI capabilities from the models themselves, which I think many of us already get the feeling are going to be commoditized at some point in the future, but rather the hardware and system-wide integrations that make use of those models that matters starting today. Obviously how the experience will be when it's available to the public is a different story, but the vision alone was impressive to me. Basically, Apple again understands the UX. I wish Apple the best of luck and I'm excited to see how their competitors plan on responding. The announcement today I think was actually subtle compared to what the implications are going to be. It's exciting to think that it may make computing easier for older people.
  • wilg 2y ago
    I think too many people assumed that because ChatGPT is a conversation interface that that's how AI should be designed, which is like assuming computers would always be command lines instead of GUIs. Apple has done a good job of providing purpose-built GUIs for AI stuff here, and I think it will be interesting to watch that stuff get deeper.
  • gnatolf 2y ago
    I'm just unhappy that this will mostly end up to make the moat larger and the platform lock-in more painful either way. iPhones have been going up in price, serious compute once you're deep in this will be simply extortion, as leaving the apple universe is going to be nigh impossible. Also no competitor is going to be as good at integrating everything, as none of those have as integrated systems.
• fsto 2y ago
  Can someone explain why the AAPL share drops 1% during the event. Did the market expect more? If so, what?
  • machinekob 2y ago
    I mean how they'll monetise it?
    • martimarkov 2y ago
      % share with OpenAI? Plus I’d now consider buying the new iPhone and wasn’t planning on a specific update from a 13 given the hardware is still fine
      • fsto 2y ago
        I’m assuming many will consider buying an iPhone 15 pro or the next one. I’m really not a trader, but thought this + the stronger ecosystem lock-in effect would bump the share significantly.
      • algesten 2y ago
        In fact, not being able to do some of these things might improve privacy.
    • tedd4u 2y ago
      Incremental increase in future hardware sales (that will be required to use it fully).
    • mysteria 2y ago
      It's like any other feature in that the purchase price of the new iPhone and App Store revenue helps pay for the AI functionality. Like they hope people will want to upgrade their phones or switch to Apple for this.
  • paradite 2y ago
    Maybe people are expecting new Macbooks? Though Apple don't usually release hardware for WWDC.
• mellosouls 2y ago
  Given there is no mention of "Artificial" is this Apple rebranding AI, the same as they did AR a year ago?
• maz1b 2y ago
  Gotta say, from a branding point of view, it's completely perfect. Sometimes things as "small" as the letters in a companies name can have a huge impact decades down the road. AI == AI, and that's how Apple is going to play it. That bit at the end where it said "AI for the rest of us" is a great way to capture the moment, and probably suggests where Apple is going to go. imo, apple will gain expertise to serve a monster level of scale for more casual users that want to generate creative or funny pictures, emojis, do some text work, and enhance quality of life. I don't think Apple will be at the forefront of new AI technology to integrate those into user facing features, but if they are to catch up, they will have to get into the forefront of the same technologies to support their unique scale. Was a notable WWDC, was curious to see what they would do with the Mac Studio and Mac Pro, and nothing about the M3 Ultra or M4 Ultra, or the M3/M4 Extreme. I also predicted that they would use their own M2 Ultras and whatnot to support their own compute capacity in the cloud, and interestingly enough it was mentioned. I wonder if we'll get more details on this front.
  • buildbot 2y ago
    Yeah I feel like we are getting the crumbs for a future hardware announcement, like M4 ultra. They’ll announce it like “we are so happy to share our latest and greatest processor, a processor so powerful, we’ve been using it in our private AI cloud. We are pleased to announce the M4 Ultra”
    • samatman 2y ago
      It was speculated when the M4 was released only for the iPad Pro that it might be out of an internal need on Apple's part for the bulk of the chips being manufactured. This latest set of announcements gives substantial weight to that theory.
      • buildbot 2y ago
        Yeah that seems very reasonable/likely. The release of the training toolkit for Apple silicon too points that way: https://github.com/ml-explore/mlx-examples/tree/main/transformer_lm https://github.com/ml-explore/mlx-examples/tree/main/transfo...
• newsclues 2y ago
  Let me run it locally on a Mac mini or whatever
  • mjamesaustin 2y ago
    A lot of the features do run locally, e.g. the Image Playground.
• abrichr 2y ago
  > With onscreen awareness, Siri will be able to understand and take action with users’ content in more apps over time. For example, if a friend texts a user their new address in Messages, the receiver can say, “Add this address to his contact card.” I wonder how they will extend this to business processes that are not in their training set. At https://openadapt.ai https://openadapt.ai we rely on users to demonstrate tasks, then have the model analyze these demonostrations in order to automate them.
  • ducadveritatem 2y ago
    Can’t find a link right now (search terms are pretty crowded atm!) but I saw they just recently shared an llm they’ve been working on that is designed to answer questions about how a give screen of an app functions. (Identifying buttons, core functionality, etc.)
• karaterobot 2y ago
  > Apple sets a new standard for privacy in AI, That does not necessarily mean better, just different. I reserve judgment until I see how it shakes out. but if I don't like this feature, and can't turn it off, I guess it's sadly back to Linux on my personal laptops.
  • theshrike79 2y ago
    It's just Siri, but with better context. If you don't specifically activate it, it won't do shit.
• ayakang31415 2y ago
  There was one part that I didn't understand about AI compute: For certain tasks, server side compute will be done as on-device chip is not powerful enough I suppose. How does this ensure privacy in verifiable manner? How do you CONFIRM that your data is not shared when cloud computing is involved with AI tasks?
  • tom1337 2y ago
    Your data is being shared. But they've shown that it is being done in a way where only required data leaves the devices and there are some protections in place which try to minimize misuse of the data (the OS will only communicate with publicly signed versions of the server for example). The call to Apples "Private Compute Cloud" is intransparent to the user, ChatGPT calls need permission if I understood it correctly.
    • ayakang31415 2y ago
      So it is not really private then.
      • pertymcpert 2y ago
        What does private mean? If I store my children's photos on iCloud encrypted, that's not private?
      • Spivak 2y ago
        I think it's a semantic thing at this point. If for you private can't mean plaintext living on a computer you don't control then no. If it's private in the way your iCloud photos are private then yes, and seemingly more so.
    • AshamedCaptain 2y ago
      > the OS will only communicate with publicly signed versions of the server for example This hardly increases security, and does not increase privacy at all. If anything it provides Apple with an excuse that they will throw at you when you ask "why can't I configure my iOS device to use my servers instead of yours?" , which is one of the few ways to actually increase privacy. This type of BS should be enough to realize that all this talk of "privacy" is just for the show, but alas...
• egypturnash 2y ago
  Uugggghhhh
• machinekob 2y ago
  Microsoft Recall => bad. Apple Recall => good.
  • minimaxir 2y ago
    The massive difference here is that Apple Recall is 100% on device. (for the use cases they demoed anyways) EDIT: Yes, I'm wrong.
    • sseagull 2y ago
      Microsoft Recall is completely on-device (or so they say).
      • skydhash 2y ago
        It's mostly the screenshots things that get people. Semantic search is ok if the index is properly secured and privacy is a concern. And localized context is ok too (summarizing one web page does not screenshot my whole screen). I believe Microsoft has gone with building the easiest option (recording everything) instead of thinking about better contextual integration.
        • anonbanker 2y ago
          Those are pretty big If's when you have a webkit or blink-based browser on the same device.
    • _lhb8 2y ago
      Isn't Microsoft Recall also 100% on device?
  • pbronez 2y ago
    Yup, this is the fascinating thing to me. Looking forward to some detailed comparisons between the two architectures.
  • fh9302 2y ago
    Apple does not take screenshots every couple seconds, unlike Microsoft. That's what people were bothered about.
• xnx 2y ago
  Credit where credit is due for co-opting the components of the "AI" acronym.
  • latexr 2y ago
    Agreed. Got to hand it to them that marketing was sharp on the name. Unless, of course, it doesn’t really work as advertised and then every “AI <negative>” search specifically bubbles Apple stories to the top.
• WillAdams 2y ago
  Nice to finally see a follow on to the Assistant feature from the Newton MessagePad.
• pcloadletter_ 2y ago
  My MSFT stock is looking good.
• mvkel 2y ago
  Kind of wild that "ChatGPT" is going to be the household term. It's such a mouthful! Goes to show that the name can kind of be anything if you have an incredible product and/or distribution. Lobbying for the name to shorten to "chatty-g"
• nerdjon 2y ago
  Said this in the other thread, but I am really bothered that image generation is a thing but also that it got as much attention as it did. I am worried about the reliability, if you are relying on it giving important information without checking the source (like a flight) than that could lead to some bad situations. That being said, the polish and actual usefulness of these features is really interesting. It may not have some of the flashiest things being thrown around but the things shown are actually useful things. Glad that ChatGPT is optional each time Siri thinks it would be useful. My only big question is, can I disable any online component and what does that mean if something can't be processed locally? I also have to wonder, given their talk about the servers running the same chips. Is it just that the models can't run locally or is it possibly context related? I am not seeing anything if it is entire features or just some requests. I wonder if that implies that over time different hardware will run different levels of requests locally vs the cloud.
  • skydhash 2y ago
    > I am worried about the reliability, if you are relying on it giving important information without checking the source (like a flight) than that could lead to some bad situations. I think it shows the context for the information it presents. Like the messages, events and other stuff. So you can quickly check if the answer is correct. So it's more about semantic search, but with a more flexible text describing the result.
  • latexr 2y ago
    > I wonder if that implies that over time different hardware will run different levels of requests locally vs the cloud. I bet that’s going to be the case. I think they added the servers as a stop-gap out of necessity, but what they see as the ideal situation is the time when they can turn those off because all devices they sell have been able to run everything locally for X amount of time.
    • solarmist 2y ago
      I’m betting 100% on this. And I think the new sidecar controlling your phone is an example of where they’re going in reverse. If you have a M6 MacBook/ipad pro it’ll run your AI queries there if you’re on the same network in two-four years.
• thimabi 2y ago
  Oh, well, many apps will have a hard time competing with “Apple Intelligence” features. Why bother downloading a third-party app if some feature you want is included by default in the OS? Better yet, no more dealing with overpriced subscriptions or programs that do not respect user privacy. Kudos to the Apple software team making useful stuff powered by machine learning and AI!
  • ukuina 2y ago
    It was amusing to see the Duolingo product placement when their entire product is just a prompt in ChatGPT.
• block_dagger 2y ago
  I wonder if the (free) ChatGPT integration will be so good that I won't need my dedicated subscription anymore?
  • atlex2 2y ago
    OAI has already said they'll be giving 4o for free.. https://openai.com/index/gpt-4o-and-more-tools-to-chatgpt-free/ https://openai.com/index/gpt-4o-and-more-tools-to-chatgpt-fr... Difference I suppose with Apple is they agree not to scrape your inputs.
• milansuk 2y ago
  This looks cool for v1! The only problem I see is most devices don't have much RAM, so local models are small and most requests will go to the servers. Apple could use it to sell more devices - every new generation can have more RAM = more privacy. People will have real reason to buy a new phone more often.
  • MVissers 2y ago
    Apple is starting to anticipate a higher RAM need in their M4+ silicon chips: There are rumors they are including more ram than specified in their entry level computers. https://forums.macrumors.com/threads/do-m4-ipad-pros-with-8gb-of-ram-actually-have-12gb.2426801/ https://forums.macrumors.com/threads/do-m4-ipad-pros-with-8g... One reason could be future AI models. I'm not sure if this has been verified independently, but interesting nonetheless and would make sense in an AI era.
• whalee 2y ago
  I am deeply disturbed they decided to go off-device for these services to work. This is a terrible precedent, seemingly inconsistent with their previous philosophies and likely a pressured decision. I don't care if they put the word "private" in there or have an endless amount of "expert" audits. What a shame.
  • giancarlostoro 2y ago
    They prompt you before you go off-service, which makes the most sense.
    • Me1000 2y ago
      They prompt you before they send your data to OpenAI, but it's clear that they prompt you before they send it to Apple's servers (maybe they do and I missed it?). And their promise that their servers are secure because it's all written in Swift is laughable. Edit: This line from the keynote is also suspect: "And just like your iPhone , independent experts can inspect the code that runs on the servers to verify this privacy promise.". First off, do "independent experts" actually have access to closed source iOS code? If so we already have evidence that this is sufficient (https://www.macrumors.com/2024/05/15/ios-17-5-bug-deleted-photos-reappear/ https://www.macrumors.com/2024/05/15/ios-17-5-bug-deleted-ph...). The actual standard for privacy and security is open source software, anything short of that is just marketing buzz. Every company has an incentive to not leak data, but data leaks still happen.
      • ethbr1 2y ago
        They're promising to go farther than that. >> Independent experts can inspect the code that runs on Apple silicon servers to verify privacy, and Private Cloud Compute cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection. Apple Intelligence with Private Cloud Compute sets a new standard for privacy in AI, unlocking intelligence users can trust.
        • 2y ago
• dombili 2y ago
  None of these features seem to be coming to Vision Pro, which I think is quite baffling. Arguably it's the device that can use them the most.
  • ducadveritatem 2y ago
    Word on the street (someone who was talking to Apple employees at WWDC) is that the Vision Pro doesn’t have enough headroom on the processor for it. It’s driving that sucker really hard just doing its “regular” thing.
  • atlex2 2y ago
    baffling indeed- seems like they should be over-investing in AVP right now, not under-investing
• kaba0 2y ago
  I think this will be a complete game changer. This will be the first device (with reasonable capabilities) where the human-machine interaction can transform into an actual instruction/command only one. We no longer just choose between a set of predefined routes, but ask the machine to choose for us. If it really does work out even half as good as they show, this will fundamentally alter our connection to tech, basically having created “intelligence” known from our previous century sci-fi tales. Of course LLMs will quickly show their bounds, like they can’t reason, etc - but for the everyday commands people might ask their phones this probably won’t matter much. The next generation will have a very different stance towards tech than we do.
• tsunamifury 2y ago
  This isn't about giving Apple intelligence, this is about giving ChatGPT an understanding of the world via the eyes, ears, and thoughts on your phone.
  • Jtsummers 2y ago
    > This isn't about giving Apple intelligence, this is about giving ChatGPT an understanding of the world via the eyes, ears, and thoughts on your phone. Except it doesn't do that. The ChatGPT integration is via Siri and opt-in (you ask Siri something, it prompts you to send that prompt to ChatGPT). The rest of the LLM and ML features are on device or in Apple's cloud (which is not OpenAI's cloud). The ChatGPT integration is also, by their announced design, substitutable in the future (or you'll be given a set of systems to select from, not just ChatGPT). They are not sending all data on your device to OpenAI.
    • tsunamifury 2y ago
      Yea, I worked in partnership with apple for years. I dont know what else to tell you except they lie through their teeth about privacy all the time.
• Tiktaalik 2y ago
  I think the genmoji is going to be tons of fun. Basically seems like https://emojikitchen.dev/ https://emojikitchen.dev/ on steroids.
• czierleyn 2y ago
  Nice, but my native language is Dutch, so I'll be waiting for this for the next 5 years to arrive. If it arrives at all.
• burningChrome 2y ago
  Am I only person who's reached their threshold on companies forcing and shoving AI into every layer and corner of our lives? I don't even look at this stuff any more and see the upside to any of it. AI went from, "This is kinda cool and quaint." to "You NEED this in every single aspect of your life, whether you want it or not." AI has become so pervasive and intrusive, I stopped seeing the benefits of any of this.
  • warkdarrior 2y ago
    They are not making it mandatory to use, just widely available through various interfaces. I see this closer to how spellcheck was rolled out in word processors, then editors, then browsers, etc.
  • wilg 2y ago
    The new generative AI stuff has been barely implemented in most products, I don't know how you are experiencing it as pervasive and intrusive. Are you sure you're not just cynical from all flood of negative news stories about AI?
    • mcpar-land 2y ago
      this being a news thread about Apple integrating AI into all their operating systems and apps aside... Chrome has started prompting me to use generative AI in text boxes. Twitter (X) has an entire tab for Grok that it keeps giving me popup ads for. Every single productivity suite (Notion, Monday, Jira) are perpetually prompting me to summarize my issue with AI. Github has banner ads for Copilot. It is everywhere.
      • ethbr1 2y ago
        Summarization was implemented everywhere because it was the easiest AI feature to ship when a VP screamed "Do AI, so our C-suite can tell investors we're an AI company!"
        • kristofferR 2y ago
• 29athrowaway 2y ago
  We know the solution to the AI box experiment[1]. Set the AI free and make money. [1]: https://rationalwiki.org/wiki/AI-box_experiment https://rationalwiki.org/wiki/AI-box_experiment
• ConanRus 2y ago
  [dead]
• Hippocrates 2y ago
  The OpenAI/ChatGPT part of this looks pretty useless. Similar to what some shortcuts like “hey data” already do. I was shocked, and relieved that Apple isn't relying on their APIs more. Seems like a big L for OpenAI.
• GeekyBear 2y ago
  One thing that I found thoughtful was that images could only be generated as cartoons, sketches or animations. There was no option for a more photorealistic style. That seems like an effective guardrail if you don't want people trying to pass off AI generated images as real.
• mrkramer 2y ago
  Is it just me or this AI rush is actually about to ruin user experience both on Apple and Microsoft devices? The extra layer of complexity for users who will now be introduced to endless AI features is bloatware in the making.
  • anonbanker 2y ago
    Just making linux more appealing for the subset of the population that doesn't want to hook into skynet's subpar UX.
  • password54321 2y ago
    Based on what they showed most users won't even know if the feature they are using is using AI or not. Most of it is local and just comes in the form of a button rather than typing out a prompt to make it do what you want. And I think those two are the big things to take away from this. Local means less clunkiness and lag you get from tools like Perplexity or whatever and no 'prompt engineering' means even someone's grandma could immediately start using AI. Apple just doing what Apple does best.
• 65 2y ago
  Some stuff seems cool in the sense that you try it once and never use it again. Other stuff, like ChatGPT integration, seem like they'll produce more AI Slop and false information. It's always interesting to me to see just how many people blatantly trust ChatGPT for information. I find most AI products to be counter-intuitive - most of the time Googling something or writing your own document is faster. But the tech overlords of Silicon Valley will continuously force AI down our throats. It's no longer about useful software, we made most of that already, it's about growth at all costs. I'm a developer and day by day I come to despise the software world. Real life is a lot better. Real life engineering and hardware have gotten a lot better over the years. That's the only thing keeping me optimistic about technology these days. Software is what makes me pessimistic.
• KennyBlanken 2y ago
  Okay. And what about the terrible keyboard, predictive text, and autocorrect?
• vessenes 2y ago
  I wonder what if any Developer support for “AI” — I need a better way to write that — ahem I - will have for accessing the personal data store. I’ve spent the last four years running up at collecting this data about myself, and, it’s hard, real hard to do a good job at it. I’d love to have an app I write be able to subscribe to this stream. It feels like a sort of perfect moat for Apple - they could say no on privacy concerns, and lock out an entire class of agent type app competitors at the same time. Well, here’s hoping I can get access to the “YouSDK” :)
  • tavavex 2y ago
    Ah, yes, "F8FF I" lol More seriously, I think the SDK they've teased is only really intended for making their ready-made features integrate with your programs. If you want complete control, you'd probably have to write it the old way, or integrate it with some existing local LLM backend.
• layer8 2y ago
  No multilingual capabilities it seems: https://www.apple.com/apple-intelligence/#footnote-1 https://www.apple.com/apple-intelligence/#footnote-1
• jl6 2y ago
  I can see people using Rewrite all the time. In the grim darkness of the AI future, your friends speak only in language that is clean, sanitized, HR-approved, and soulless.
  • mcpar-land 2y ago
    https://mrgan.com/ai-email-from-a-friend/ https://mrgan.com/ai-email-from-a-friend/
    • dinkleberg 2y ago
      That perfectly describes how I feel about all of this. I'm sure that there will be lots of genuinely useful things that come out of this AI explosion, but can't help but be a bit saddened by what we're losing along the way. Of course I can choose not to use all of these tools and choose to spend time with folks of a similar mindset. But in the working world it is going to be increasingly impossible to avoid entirely.
  • twoWhlsGud 2y ago
    At work, yes. However, it won't be long until the language you speak will become a feature of your ML driven consumer language service. There will likely be products that reflect your style/ identity/ whatever. And once you reach a certain socioeconomic level, you'll speak a highly customized bespoke dialect that reflects your station in life, just like today but much, much weirder…
  • glial 2y ago
    People already use words like 'product', 'content', 'feature', and 'vehicle' in everyday conversation. It makes me shudder every time.
  • TillE 2y ago
    I feel like this is an awful feature for your native language, but fantastically exciting for a second language where you're not quite fluent and need to be able to write coherently.
  • kylehotchkiss 2y ago
• losvedir 2y ago
  > Independent experts can inspect the code that runs on Apple silicon servers to verify privacy, and Private Cloud Compute cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection. Technically, the sentence could be read that experts inspect the code, and the client uses TLS and CA's to ensure it's only talking to those Apple servers. But that's pretty much the status quo and uninteresting. It sounds like they're trying to say that somehow iPhone ensures that it's only talking to a server that's running audited code? That would be absolutely incredible (for more things than just running LLMs), but I can't really imagine how it would be implemented.
  • Hizonner 2y ago
    > I can't really imagine how it would be implemented. People do stuff that they claim implements it using trusted, "tamperproof" hardware. What they're ignoring is that not all of the assurance is "cryptographic". Some of it comes from trusting that hardware. It's particularly annoying for that to get glossed over by a company that proposes to make the hardware. You can also do it on a small scale using what the crypto types call "secure multiparty computation", but that has enormous performance limitations that would make it useless for any meaningful machine learning.
    • warkdarrior 2y ago
      There is no known solution to remote software attestation that does not depend on trusted hardware.
      • Hizonner 2y ago
        That's correct. But Apple is not making that clear, and is therefore misrepresenting what assurance can be offered.
  • ducadveritatem 2y ago
    The details of their approach: https://security.apple.com/blog/private-cloud-compute/ https://security.apple.com/blog/private-cloud-compute/
• nsxwolf 2y ago
  "AI for the rest of us" is an interesting resurrection of the "The computer for the rest of us" Macintosh slogan from 1984.
• htrp 2y ago
  > Apple Intelligence is free for users, and will be available in beta as part of iOS 18, iPadOS 18, and macOS Sequoia this fall in U.S. English. Some features, software platforms, and additional languages will come over the course of the next year. Apple Intelligence will be available on iPhone 15 Pro, iPhone 15 Pro Max, and iPad and Mac with M1 and later, with Siri and device language set to U.S. English. For more information, visit apple.com/apple-intelligence. iphone 15 Pro 8 GB RAM (https://www.gsmarena.com/apple_iphone_15_pro-12557.php https://www.gsmarena.com/apple_iphone_15_pro-12557.php) iphone 15 6 GB Ram (https://www.gsmarena.com/apple_iphone_15-12559.php https://www.gsmarena.com/apple_iphone_15-12559.php)
  • Jtsummers 2y ago
    Along with a 2GB RAM difference, they have different processors (A17 vs A16). https://en.wikipedia.org/wiki/Apple_A17 https://en.wikipedia.org/wiki/Apple_A17 Per the comparison table on that page, the "Neural Engine" has double the performance in the A17 compared to the A16, which could be the critical differentiator.
  • dudus 2y ago
    English only? That is surprising
    • c1sc0 2y ago
      The platform talk had a bit more architectural details and it looks like they heavily optimize / compress the Foundation model to run for specific tasks on-device. I'm guessing that sticking to US English allows them to compress the foundation model further?
    • theshrike79 2y ago
      As long as they don't geolock it to "english speaking" countries, I'm fine with that.
      • TillE 2y ago
        As far as I'm aware, the only time Apple has implemented that kind of restriction is with their DMA compliance. Like, I used the US App Store (with a US credit card) while physically in Europe for many years.
• whoiscroberts 2y ago
  For anyone who is technical and wants to play with AI but doesn’t want to use cloud services it’s worth digging into LangChain, CrewAI, OpenDevin. Coupled with Ollama to serve the inference from your local network. You can scratch the AI itch without getting in bed with OpenAI.
• RyanAdamas 2y ago
  >Be me, have iPhone 6s >Can't get many apps these days >Can't use AI apps at all >Battery last about 2 hours >Never used iCloud, barely used iTunes >Apple announces new "free" Ai Assistant for everyone well...not everyone
  • timothyduong 2y ago
    iOS users need to have the iPhone 15 pro.. so everyone else is also cooked on iOS.
• dakiol 2y ago
  I didn't watch the whole thing (will do), but could someone tell me already: can it be disabled on a Mac?
• doawoo 2y ago
  Happy as long as there is a switch to toggle it all off somewhere. I find very little of this useful. Maybe someone does, and that’s great! And my concern isn’t from a privacy perspective, just a “I want less things cluttering my screen” perspective. So far though it looks like it’s decent at being opt-in in nature. So that’s all good.
  • LogHouse 2y ago
    Strong agree here. Features are cool, but I value screen real estate and simplicity. Plus, the gpt app works fine for me. I don’t need it built into other things yet.
  • doutatsu 2y ago
    I feel like this is actually the thing you want when you say "less things cluttering my screen". Siri can now be that assistant, that summarises or does things, that would instead make you go through various screens or apps. Feels like it rescues clutter, not increases it to me imo
    • doawoo 2y ago
      I simply cannot agree, but again, it's a personal thing. I never ever find voice interfaces useful though... Aside: When the presenter showed the demo of her asking Siri to figure out the airport arrival time and then gloat it "would have taken minutes" to do on her own... I sat there and just felt so so strongly that I don't want to optimize out every possible opportunity to think or work out a problem in my life for the sake of "keeping on top of my inbox". I understand value of the tools. But I think overall nothing about them feels very worth showing even more menus for me to tick through to make the magic statistical model spit out the tone of words I want... when I could have just sat there and thought about my words and the actual, real, human person I'm talking to, and rephrase my email by hand.
      • deergomoo 2y ago
        > I don't want to optimize out every possible opportunity to think or work out a problem in my life for the sake of "keeping on top of my inbox" Completely agree. My first thought on seeing this stuff is that it suggests we, as an industry, have failed to create software that fulfils users’ needs, given we’re effectively talking about using another computer to automate using our computers. My second thought is that it’s only a matter of time before AI starts pushing profitable interests just like seemingly all other software does. How long before you ask some AI tool how to achieve something and it starts pitching you on CloudService+ for only 4.99 per month?
• __loam 2y ago
  Hope we can disable all this crap.
• fdpdkf 2y ago
  I find the removing people from photos thing creepy. Yes you can remove others to see only your family, but forging the reality to only conform to what you wish is disturbing I think.
  • qeternity 2y ago
    Photos are already just one perspective on reality. Instagram has shown that to be painfully true. This is merely a continuation of that. We all experience our own reality individually.
  • standardUser 2y ago
    Maybe it will remind people that we should never have been mistaking recorded media for reality in the first place, a lesson we've been learning since at least 1917... https://en.wikipedia.org/wiki/Cottingley_Fairies https://en.wikipedia.org/wiki/Cottingley_Fairies
  • guyforml 2y ago
    we've had photoshop for more than a decade now
• chucke1992 2y ago
  Nothing really impressive. Let's see who the stock reacts.
  • qeternity 2y ago
    Out of curiosity, what would you have considered impressive?
    • chucke1992 2y ago
      Hard to tell. That's the whole point.I thought maybe Apple had come up with something - but by and large it is not different from Vision Pro - they have made X feel better, no real one generation ahead stuff. Basically they are not introducing the innovation. There are two challenges right now for AI - user monetisation and mass adoption. ChatGPT right now is basically a TikTok - a popular app and that's it. Yeah, it has a subscription but by and large, companies are failing to find a way to monetize the user. And at the same time there is no a proper trigger - something that would make AI better than a glorified assistance. For people who used not to rely on it, it won't be a game changer either, just a little bit of convenience. So it remains to be seen what's going to happen with AI in the future. It seems like the biggest gamechanger introduced by AI is in hardware space - the mass adoption of ARM, NPUs and stuff. Plus it seems like the monetization of AI is done nicely in the companies - Adobe's AI features, Microsoft and their corporate features and so on.
• resharpe105 2y ago
  Key question is, will there be a hard switch to only ever use on device processing? If not, and if you don’t want practically every typed word to end up on someone else’s computer (as cloud is just that), you’ll have to drop ios. As for me that leaves me with a choice between dumbphone or grapheneOS. I’m just thrilled with these choices. :/
  • LogHouse 2y ago
    It’s not sending every word to the cloud. I think you must invoke the AI features. Am I wrong?
    • resharpe105 2y ago
      I understood that it will have the full context of the data on your phone, in order to be ,,useful”. We are yet to see if that means only the data you’ve invoked ai features for, or totality of your emails, notes, messages, transcripts of your audio, etc.
      • dialup_sounds 2y ago
        From the presentation it sounds like the on-device model determines what portion of the local index is sent to the cloud as context, but is designed for none of that index to be stored in the cloud. So (as I understand it) something like "What time does my Mom's flight arrive?" could read your email and contacts to find the flight on-device, but necessarily has to send the flight information and only the flight information to answer the arrival time.
• seabass 2y ago
  Adding ai features to the right-click menu is something I’ve been working on for the past year or so, and it’s always both exciting and disappointing to see one of the big players adopt a similar feature natively. I do strongly believe in the context menu being a far better ux than copying and pasting content into ChatGPT, but this release does have me questioning how much more effort to expend on my side project [1]. It doesn’t seem like Apple will support custom commands, history, RAG, and other features, so perhaps there is still space for a power-user version of what they will provide. [1] https://smudge.ai https://smudge.ai
  • jbkkd 2y ago
    Love your extension! There's definitely room for it
• duskhorizon2 2y ago
  Some generative AI features are quite useful. I’m already using AI to generate icons for my apps and write nonsense legalese. But one thing when I explicitly creating image by prompting at the third-party server, and another when AI index and upload all my private documents in the cloud. Apple promised: “Independent experts can inspect the code that runs on Apple silicon servers to verify privacy, and Private Cloud Compute cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection.” There are so many questions: Who’re these experts? Can myself be this expert? Will the server software be open sourced? Well, I will postpone my fears until Apple rolls out AI on devices, but now I see this is a privacy nightmare. Now it’s all looks like Microsoft’s Recall. I afraid that without homogeneous encryption private cloud is a sad joke.
  • JumpCrisscross 2y ago
    > write nonsense legalese Oh boy. Someone is going to make a lot of money in court finding people who did this.
    • duskhorizon2 2y ago
      Nope. I'm not in USA ;)
      • JumpCrisscross 2y ago
        > not in USA If you’re somewhere where contracts have meaning, it’s a true statement.
        • duskhorizon2 2y ago
          Well, if contracts have meaning, I will not use AI. But AppStore for example requires privacy policy, that one AI wrote.
• deleted 2y ago
  [deleted]
• notatoad 2y ago
  is my iPhone 14 going to get none of this then? i understand i'm not going to get the on-device stuff, but something like siri being able to call out to chatGPT should be available on any device, right?
  • syspec 2y ago
    FWIW: You can do that on your phone today iwith Siri, if you have the ChatGPT app. You just say "hey siri, ask chat gpt..." and then it will
• zx10rse 2y ago
  Jumping on the chatgpt hype train is a mistake. I don't want anything from my devices to be accessible by openai. It will bite them back big time.
  • ducadveritatem 2y ago
    Good news then that you’re explicitly asked for permission each time any query would by shared with ChatGPT.
• deleted 2y ago
  [deleted]
• windowshopping 2y ago
  The "Do you want me to use ChatGPT to do that?" aspect of it feels clunky as hell and very un-Apple. It's an old saw, but I have to say Steve Jobs would be rolling over in his grave at that. Honestly confused as to why that's there at all. Could they not come up with a sufficiently cohesive integration? Is that to say the rest ISN'T powered by ChatGPT? What's even the difference? From a user perspective that feels really confusing.
  • dag11 2y ago
    What? The original Siri asked if the user wanted to continue their search on the web if it couldn't handle it locally. It was one of the last things from the Jobs era.
  • xanderlewis 2y ago
    I agree. Quite odd and not very Apple-ish. I wonder if there’s some good reason for it; it must have been debated internally.
  • dmix 2y ago
    I thought it was the smartest and most pragmatic thing they've announced. Being best in class for on-device AI is a huge market opportunity. Trying to do it all would be dumb like launching Safari without a google search homepage partnership. Apple can focus on what they are good at which is on device stuff and blending AI into their whole UX across the platform, without compromising privacy. And then taking advantage of a market leader for anything requiring large external server farms and data being sent across the wire for internet access, like AI search queries.
    • FinnKuhn 2y ago
      I think they also announced the possibility to integrate Siri with other AI platforms than ChatGPT so this prompt would be especially useful to make clear to the user which of these AIs Siri wants to use.
  • theshrike79 2y ago
    From a user perspective it's 100% clear. If the system doesn't say "I'm gonna phone a friend to get an answer for this", it's going to stay either 100% local or at worst 100% within Apple Intelligence, which is audited to be completely private. So if you're asking for a recipe for banana bread, going to ChatGPT is fine. Sending more personal information might not be.
• tonyabracadabra 2y ago
  Ok! Made a song about! https://heymusic.ai/music/apple-intel-fEoSb https://heymusic.ai/music/apple-intel-fEoSb Hope you guys enjoy it!
• adamtaylor_13 2y ago
  This is literally everything I've been hoping Siri would be since the very first GPT-3.5 demo over a year ago. I've never been more bullish on the Apple ecosystem. So exciting!
• markus_zhang 2y ago
  TBH, I think the IT industry is too concentrated at eating itself. We are happily automating our jobs away and such while the other industries basically just sleep through. I don't want generative AI in my phone. I want someone, or something to book a meeting with my family doctor, the head of my son's future primary school, etc. I don't need AI to do that. I need the other industries (medical/government/education) to wake up and let us automate them. Do you know that my family doctor ONLY take calls? Like in the 1970s I guess? Do you know it takes hours to reach a government office, and they work maybe 6 hours a day? The whole world is f**ing sleeping, IT people, hey guys, slow down on killing yourselves. AI is supposed to get rid of the chores, now it leaves us with the chores and take the creative part away. I don't need such AI.
  • skilled 2y ago
    I wonder if Apple ever approached Google about using Gemini as the flagship integration. I say that because during the keynote I kept thinking to myself, this could be the moment that Google realises it needs to stick to what it knows best - Search - and all they have to do is sit back and watch the hype fade away. But that’s in a perfect world. Even to this day, post ChatGPT, I still can’t imagine how I would ever use this AI stuff in a way that really makes me want to use it. Maybe I am too simple of a mind? Maybe the problem is in the way that it is presented. Too much all at once, with too many areas of where and how it can be used. Rewriting emails or changing invitations to be “poems” instead of text is exactly the type of cringe that companies want to push but it’s really just smoke and mirrors. Companies telling you to use features that you wouldn’t otherwise need. If you look at the email that Apple rewrote in the keynote - the rewritten version was immediately distinguishable as robotic AI slop.
    • markus_zhang 2y ago
      TBF I was too harsh in my original comment. I did use ChatGPT to automate away the chore part of the coding (boiler plate for example). But I have a gut feeling that in maybe 5-10 years this is going to replace some junior programmer's job. My job can be largely "AIed" away if such AI gets better and the company feeds internal code to it.
• xnx 2y ago
  Interesting that genmoji seems to recreate the functionality of this SDXL LoRA https://civitai.com/models/140968/emoji-xl https://civitai.com/models/140968/emoji-xl
• blixt 2y ago
  Did I miss the explanation of how they trained their image generation models? It's brave of a company serving creative professionals to generate creative works with AI. I'm a fan of using generative AI, but I would have expected them to at least say a little about what they trained on to make their diffusion models capable of generating these images. Other than that, using an LLM to handle cross-app functionality is music to my ears. That said, it's similar to what was originally promised with Siri etc. initially. I do believe this technology can do it good enough to be actually useful though.
  • glial 2y ago
    I thought it was interesting that the only image generation they support are sketches (that look like a photoshop styling) and goofy 3d cartoons -- not really competition with most creatives.
• hawski 2y ago
  This ramping up AI war will leave no prisoners. I am not an Apple customer in any way, I am in Google's ecosystem, but I feel that I need to make an exit, at least some essentials, preferably this year. My e-mail, my documents, my photos, my browsing, my movement. The first step for me was setting up Syncthing and it was much smoother than I initially thought. Many steps to go.
  • sircastor 2y ago
    I haven’t adopted passcodes, and moved all my email out of gmail to a private domain. Photos backup t to my NAS. I’m terrified of the automated systems deciding I’m a bad actor. I can’t help but think it’ll get worse with AI
    • its_ethan 2y ago
      Not that you shouldn't do it, but too much of an active effort or obsession with not using standard e-mail services or photo back ups is probably a faster way to get flagged as suspicious lol
  • jwrallie 2y ago
    For things that don’t leave your system it’s ok, but the moment you send something to others it will go into the systems that you try to avoid anyway. Mostly I see no point in things like email self hosting if half my contacts are on Gmail and the other half on Microsoft. My suggestion (as someone that tried to escape for some time) is to build a private system for yourself (using private OS and networks) and use a common system to interface with everyone else.
• lawlessone 2y ago
  Couldn't Siri already do some of these things without LLM's?
• iandanforth 2y ago
  I think the only way I would trust this is if they explicitly described how they would combat 5-eyes surveillance. If you're not willing to acknowledge that the most dangerous foe of privacy in the western world is the governments of the western world then why should I believe anything you have to say about your implementation?
  • ducadveritatem 2y ago
    You can read what they have shared about the security aspects of the cloud portion of their AI offering here: https://security.apple.com/blog/private-cloud-compute/ https://security.apple.com/blog/private-cloud-compute/
• mihaaly 2y ago
  Cloud compute and privacy in the same sentence, this is a new low bar for corporate bull*hit. Almost worse than the Windows Recall nonsense.
  • theshrike79 2y ago
    It's also auditable, they mentioned it multiple times. Apple specifically doesn't want to know your shit, they're jumping through weird hoops to keep it that way. It would be a LOT easier just to know your shit.
• tekawade 2y ago
  "privacy in AI" - If apple is sharing with ChatGPT how does it work? Do they try to remove context information. But still it's sharing a lot more. + Anything that goes out can go anywhere in internet. Look at Facebook, Twitter and even Apple use of data.
• qmmmur 2y ago
  Did they touch on any AI features that might be able to help me create shortcuts? I really like them, but hate creating them with the kludgy block-based diagrams.
• ryankrage77 2y ago
  The image generation seems really bad. Very creepy, offputting, uncanny-valley images. And that's the the best cherry-picked examples for marketing. I'm curious to try some of the Siri integrations - though I hope Siri retains a 'dumb mode' for simple tasks.
• _23sd 2y ago
  The Image Playground demos contrast pretty strongly, in a bad way, with how image generation startups like Stability typically emphasize scifi landscapes and macro images in their marketing material. We're more open to strange color palettes and overly glossy looking surfaces in those types of images, so they're a good fit for current models that can run on smaller GPUs. Apple's examples of real people and places, on the other hand, look like they're deep in uncanny valley and I'm shocked anyone wanted them in a press release. More than any other feature announced today, that felt like they just got on the hype bandwagon and shipped image generation features to please AI-hungry investors, not create anything real people want to use.
• mihaaly 2y ago
  I can't wait until making tools for users will be the centerpiece of device development again instead of this corporate crap enforcement about half cooked whatevers acting on our behalf pretending to be a different us (I intentionally avoid the word intelligence, it is the mockery of the word that is going on all around). Who will trust in anything coming from anyone through electonic channels? Not me. Sooner start to talk to a teddy bear or a yellow rubber duck. This is a bad and dangerous tendency that corporate biggheads piss up with glares and fanfares so the crowd get willing to drink with amaze. The whole text is full of corporate bullsh*t, hollow and cloudy stock phrases from a thick pipe - instead of facts or data - a generative cloud computing server room could pour at us without a shread of thoughts.
• Aerbil313 2y ago
  About time. I was saying that Apple is cooking these features, especially intelligent Siri, for the past 1.5 years. It was obvious really. You can clearly see only people objecting to this new technological integration are the people who don't have a use case for it yet. I am a college student and I can immediately see how me and my friends will be using these features. All of us have ChatGPT installed and subscribed already. We need to write professionally to our professors in e-mail. A big task is to locate a document sent over various communication channels. Now is the time you'll see people speaking to their devices on street. As an early adopter using the dumb Siri and ChatGPT voice chat far more than average person, it has always been weird to speak to your phone in public. Surely the normalization will follow the general availability soon after.
• Nition 2y ago
  Aside from the search and Siri improvements, I'm really not sure about the usefulness of all the generative stuff Apple is suggesting we might use here. If you spend an hour drawing a picture for someone for their birthday and send it to them, a great deal of the value to them is not in the quality of the picture but in the fact that you went to the effort, and that it's something unique only you could produce for them by giving your time. The work is more satisfying to the creator as well - if you've ever used something you built yourself that you're proud of vs. something you bought you must have felt this. The AI image that Tania generated in a few seconds might be fun the first time, but quickly becomes just spam filling most of a page of conversation, adding nothing. If you make up a bedtime story for your child, starring them, with the things they're interested in, a great deal of the value to them is not in the quality of the story but... same thing as above. I don't think Apple's idea of reading an AI story off your phone instead is going to have the same impact. In a world where you can have anything the value of everything is nothing.
  • skybrian 2y ago
    The value of a gift isn't solely on how much you worked on it or what you spent on it. It can also be in picking out the right one, if you picked something good. Context will be more important when the gift itself is easy.
  • rising-sky 2y ago
    You could say the same thing for sending a Happy Birthday text, versus a hand written letter or card. Nothing is stopping a person from sending the latter today, and yes they are more appreciated, but people also appreciate the text. For example, if you're remote and perhaps don't have that deep of a relationship with them
    • anon22981 2y ago
      Your analogy does not apply at all.
    • Nition 2y ago
      I guess the question is, is sending an AI Happy Birthday image better than sending a Happy Birthday text?
• mensetmanusman 2y ago
  “With onscreen awareness, Siri will be able to understand and take action with users’ content in more apps over time. For example, if a friend texts a user their new address in Messages, the receiver can say, “Add this address to his contact card.”” Little annoyances like this being fixed would be great. “Open the address on this page in google maps” better work :)
• camcaine 2y ago
  Feels like Apple are super late to the party and are scrambling. And it showed.
• hartator 2y ago
  It’s a little messy. Local LLMs + Apple Private Cloud LLMs + OpenAI LLMs. It’s like they can’t decide on one solution. Feels very not Apple.
• daralthus 2y ago
  /Time for a good prompt injection email header/s
• rdl 2y ago
  I'm super excited about how the apple private compute cloud stuff works -- I tried to build this using intel TXT (predecessor of SGX) and then SGX, and Intel has fucked up so hard and for so long that I'm excited by any new silicon for this. AWS Nitro is really the direct competition, but having good APIs which let app developers do stuff on-device and in some trustworthy/private cloud in a fairly seamless way might be the key innovation here.
  • davidczech 2y ago
    [dead]
• guhcampos 2y ago
  Somehow all these news about Apple Intelligence don't really make me thinkg about Apple, but just how bad Intel just lost the branding battle forever.
• iJohnDoe 2y ago
  Apple Intelligence = AI Figgin’ brilliant.
• ENGNR 2y ago
  Ok I'm calling it. If NVIDIA releases a phone, and allows you to buy the hardware for the off-device processing too, I'll fully ditch Apple in a heartbeat. I'm quite creeped out that it uses off-device processing for a personal context, and you can't host your own off-device processing, even if you have top of the line Apple silicon hardware (laptop or desktop) that could step in and do the job. Hopefully they announce it in one of the talks over the next few days.
• lz400 2y ago
  I suppose it was to be expected by IMHO this takes the wind out of the sails of the OpenAI / Apple deal. In the end they don't let OpenAI get into the internals of iOS / Siri, it's just a run of the mill integration. They actually are competing with ChatGPT and I assume eventually they expect to replace it and cancel the integration. The OpenAI integration also seems setup to data mine ChatGPT. They will have data that says Customer X requested question Q and got answer A from Siri, which he didn't like and went to ChatGPT instead, and got answer B, which he liked. Ok, there's a training set. I'm always wrong in prediction and will be wrong here but I'd expect openAI is a bad spot long term, doesn't look like they have a product strong enough to withstand the platform builders really going in AI. Once Siri works well, you will never open ChatGPT again.
• toisanji 2y ago
  can you disable external llm calls so everything stays on device?
• deleted 2y ago
  [deleted]
• zmmmmm 2y ago
  It's interesting to see Apple essentially throw in the towel on on-device compute. I fully expected them to announce a stupendous custom AI processor that would do state of the art LLMs entirely local. Very curious if they are seeing this as a temporary concession or if they are making a fundamental strategic shift here. The problem is, regardless how hard they try, I just don't believe their statements on their private AI cloud. Primarily because it's not under their control. If governments or courts want that data they are a stroke of the pen away from getting it. Apple just can't change that - which is why it is surprising for me to see them give up on local device computing.
  • password54321 2y ago
    "A cornerstone of Apple Intelligence is on-device processing, and many of the models that power it run entirely on device."
  • xcv123 2y ago
    Why would you expect that? State of the art LLMs need a GPU with hundreds of GB of RAM costing tens of thousands of dollars. Apple doesn't have magical supernatural powers. They are still bound by the laws of physics. Siri is still running on device (mostly) and is quite powerful with this new update.
    • password54321 2y ago
      "There is no way we can reduce the size of transistors" - You in the 20th century.
      • xcv123 2y ago
        Apple uses TSMC for fabrication. The roadmap for TSMC and Intel are planned years in advance. Two orders of magnitude improvement in 6 months? Not possible. Have you heard of Moore's Law? Maybe in 20 years. https://en.wikipedia.org/wiki/Moore%27s_law https://en.wikipedia.org/wiki/Moore%27s_law
        • 2y ago
• a_petrov 2y ago
  What would be interesting for me is, if I can develop an app for, let's say macOS, and expose its context to Siri (with Intelligence) in an easy way. For example: Imagine a simple Amazon price tracker I have in my menu bar. I pick 5 products that I want to have their price tracked. I want that info to be exposed to Siri too. And then I can simply ask Siri a tricky question: "Hey Siri, check Amazon tracker app, and tell me if it's a good moment to buy that coffee machine." I'd even expect Siri to get me that data from my app and be able to send it over my email. It doesn't sound like rocket science. In the end of the day, the average user doesn't like writing with a chatbot. The average user doesn't really like reading (as it could be overwhelming). But the average user could potentially like an assistant that offloads some basic tasks that are not mission critical. By mission critical I mean asking the next best AI assistant to buy you a plane ticket.
  • shuckles 2y ago
    In theory this is covered by the App Entities framework, though it seems like Apple only trains their on-device models to learn about entities for some standard types of apps. https://developer.apple.com/documentation/appintents/app-entities https://developer.apple.com/documentation/appintents/app-ent...
• blackeyeblitzar 2y ago
  The AI wave is showing us that the gains will keep going to the big tech companies and competition doesn’t really exist, not even at this moment. They need to be broken up and taxed heavily.
• zombiwoof 2y ago
  Apple promising in 8-12 months what others have today. Although Apple marketed it better. Google didn't have the brass balls to call it "Alphabet Intelligence" !!!
  • Etheryte 2y ago
    No one else is doing this stuff without sending your data off to a remote server. This is a crucial distinction, especially when it comes to personal data.
    • Slyfox33 2y ago
      But apples implementation also sends stuff to remote servers. "To run more complex requests that require more processing power, Private Cloud Compute extends the privacy and security of Apple devices into the cloud to unlock even more intelligence. With Private Cloud Compute, Apple Intelligence can flex and scale its computational capacity and draw on larger, server-based models for more complex requests."
      • Etheryte 2y ago
        For complex queries, yes, but everything they can, they do on-device. No one else does that, even if you ask ChatGPT what's 2 + 2 it'll go to their servers.
• ge96 2y ago
  Heh I see what they did there convenient name
• abaymado 2y ago
  I really just want Siri to perform simple tasks without me giving direct line-by-line orders. For example, I often use Siri to add reminders to my Calendar app but forget to mention the word “calendar” or replace it with “remind me,” and Siri ends up adding it to the Reminders app instead of the Calendar app. I want Siri to have an explicit memory that every time I use the phrase “remind me,” I want the task done in my Calendar app. Additionally, if most apps end up adopting App Intents like OpenAI’s Function Calling, I see a bright future for Siri.
• LelouBil 2y ago
  So, this looks great, but I don't get the criticism against Microsoft Recall and not against this. Can someone explain what Apple has avoided that were such a problem with Recall ?
• gonzo41 2y ago
  Oddly, I find myself siding with Musk on this feature.
• vladsolokha 2y ago
  So now my “Sent from iPhone” email signature will be replaced with “Sent with Apple Intelligence” smh. I don’t think we will have anything original to say anymore. It will all just be converted to what is proper and “right”
• m3kw9 2y ago
  All the talk is sounding real nice, it’s when it comes out we will see how much context it can see and how accurate it knows what the user says. Gonna be fun few weeks of reviews.
• nothrowaways 2y ago
  I hope it is optional feature.
• mark_l_watson 2y ago
  While I really enjoyed the “Apple-ification of AI” in the keynote today, I have been hoping for a purely personal AI ecosystem, one that I run on my own computer, using the open weight models I choose, and using open source libraries to make writing my own glue and application code easier. The good news is that consumers can buy into Apple’s or Google’s AI solutions, and the relatively few of us who want to build our own experience can do so.
• Barbara230 2y ago
  [flagged]
• sidcool 2y ago
  No privacy concerns?
• semireg 2y ago
  So that’s where all the M4s are going … to Apple’s private inference cloud.
• dt3ft 2y ago
  Thanks but no thanks. All I wish for is user-replaceable battery and a battery lasting for at least 2 full days. If I can’t opt out from any of this, this is where I stop using an iPhone.
• simianparrot 2y ago
  It needs to be opt-out by default in the EU or this is an enormous and inevitable GDPR breach waiting to happen.
• Marciakhan 2y ago
  [dead]
• pastyboy 2y ago
  Well on the one hand its very interesting... on the other a little dystopian, but I guess I am a luddite. Everyone now will appear to be of a certain intelligence with proscribed viewpoints, this is going to make face to face interviews interesting, me, I think I'll carry on with my imperfections and flawed opinions, being human may become a trend again.
• sc077y 2y ago
  Impressive not technically because nothing here is new but because it's the first real implementation for the average end consumers of "ai". You have semantic indexing which allows series to basically retrieve context for any query. You have image gen which gives you emojigen or messaging using genAI images. TextGen within emails. UX is world class as usual. However, The GPT integration feels forced and even dare I say unnecessary. My guess is that they really are interested in the 4o voice model, and they're expecting openAI to remain the front runner in the ai race.
• adrianmsmith 2y ago
  It seems they didn't address hallucination at all? Presumably this hallucinates as much as any other AI (if it didn't, they'd have mentioned that). So how can you delegate tasks to something that might just invent stuff, e.g. you ask it to summarize an email and it tells you stuff that's not in the original email?
  • audessuscest 2y ago
    you really have to try hard to make a model hallucinate when asked to summarize an email. I think they didn't mention it because they can't guarantee 100%, but it's virtually on non-issue for such task.
• tunnuz 2y ago
  AI for short?
• rock_artist 2y ago
  What's not clear to me during that time is, how will this work on pre-M1 / pre-iPhone 15 devices. (also worth noting that iPhone 14 Pro is almost identical to iPhone 15 in terms of CPU... which is odd, especially when someone bought "Pro" tier...) If I have some "AI" workflow on my MacBook Pro and then it's broken on my iPhone, I would most likely to entirely stop using it, as it's unexpected (I cannot trust it) or in Apple words... lack continuity...
• dwighttk 2y ago
  If I can just get Siri to control music in my car I will be happy. Hey siri play classical work X a randomly selected version starts playing Hey siri play a different version same version keeps playing Hey siri play song X some random song that might have one similar keyword in the lyrics starts playing No play song X I don’t understand Hey siri play the rangers game do you mean hockey or baseball? Only one is playing today and I’ve favorited the baseball team and you always ask me this and I always answer baseball I can’t play that audio anyway >car crashes off of bridge (All sequences shortened by ~5 fewer tries at different wordings to get Siri to do what I want)
• coolg54321 2y ago
  As a pixel user I'm really impressed with their cleanup tool, it looks way ahead in UX compared to magic editor on pixel, also having able to select the distractions without altering the main object looks really cool (at least in their demo), magic editor on pixel's underpowered SoC runs too slow, In general iphones have superior hardware vs pixel (as per the benchmarks) so having this on-device should make it really nice experience overall.
• todotask 2y ago
  Sequoia with 'ai', coinciding with Apple Intelligence, is a cleverly chosen code name for this release.
• myko 2y ago
  This AI craze is very underwhelming. Surprised to see Apple go whole-hog into it.
• baxuz 2y ago
  I really hope that they'll enable other, less spoken languages. I'm not planning on talking with my phone in English.
• matrix87 2y ago
  the thing with "I have xyz ingredients, help me plan a 5-course meal for every taste bud"... I get the idea, it just doesn't feel like that's how people actually interact with computers. similarly with the bed time story thing. why would anyone waste time with some AI generated thing when they can just reference the works of a chef or author that they already know? appropriating all of this information through legally dubious means and then attempting to replace the communication channels that produced it in the first place is hubris.
• rldjbpin 2y ago
  i hope there is a way to prevent the online processing without consent.
• chuch1 2y ago
  sounds cool.