An Honest Review of Apple Intelligence... So Far
Dec 6, 2024
Reviewing the Apple Intelligence features out so far. Not included in this video: Natural language search in Photos, memory movies, Siri product knowledge and context memory, Mail summaries, Writing Tools Describe Your Change, Image Wand.
View Video Transcript
0:00
All right, we got to talk about Apple intelligence
0:05
So Apple's made this promise. This huge thing is coming that's going to change everything across their whole lineup
0:11
They've been talking about it for a while, and I think that promise is starting to fade
0:16
This was first announced at WWDC 2024. That was nearly six months ago, and it's still not completely out yet
0:23
The new iPhones launched in September with exactly zero Apple intelligence features
0:27
but then some software updates have started to push out, and eventually it's supposed to be finished
0:32
and in everyone's hands by March 2025. That's a lot of buildup
0:38
So what I want to do now is review every single Apple intelligence feature that's out so far
0:45
And then also get into whether the promise that they're actually making is even good in the first place
0:50
So first up, writing tools. So all these features, unless otherwise specified, are on iPhone, iPad, and Mac
0:57
So no Apple intelligence features at all on the Vision Pro, their most futuristic platform
1:03
That's already kind of fascinating. But the writing tools, you may have heard about these since they're definitely referenced a lot
1:09
maybe the most out of any of these. And yes, it's basically generative AI to help adjust what you've already written
1:16
So this is easiest to demo on the Mac, but basically you have something you've written, you highlight all of it, and then select one of the writing tools
1:22
And actually, this is one of the first weird hiccups, just a strangely repetitive UI
1:27
You can access any of the writing tools in one click right here, or hit show writing tools
1:33
which again shows the same list of writing tools. Okay. So I suppose there's a world where, you know, you write some message to someone, and you just want it to be a little more friendly
1:44
Or maybe you've typed out a bunch of stuff that needs to be sent in a work email. So you want to get the AI to make it more professional for you
1:51
Sure, I guess. So I've run it through various things that I've written from, you know, whole video scripts to just a bunch of messages
1:57
And it works, technically. I think the friendly mode mostly uses like shorter sentences and lots of exclamation points
2:04
And then the professional mode kind of does the opposite. Like it's still pretty terse, but never uses exclamation points
2:11
I think maybe concise is the most useful. Basically, it takes whatever you highlight and makes it maybe 40% shorter
2:16
And then you can hit copy or just directly replace it if you trust it
2:20
And each of these things takes about three or four seconds to generate entirely on device
2:25
so it works offline as well. The proofreading is nice because it picks up on extra things like capitalization and proper nouns
2:32
if you really need that on top of the auto punctuation checker. And then summary or make table would be really nice for like really large documents
2:42
but it doesn't seem to want to work on some of my huge documents that would be nice to summarize
2:48
or make into a table. So unfortunately, even as basically a professional writer at this point, I haven't gotten much
2:55
use out of writing tools at all. So, notification summaries. This one, to me, personally, I have found
3:01
almost useless. Basically, it does exactly what it sounds like it does. When it's enabled, it summarizes
3:07
your notifications from each app. So if you get a long message from someone or several notifications
3:12
in a row from a single app, it will do its best to condense that all into a single message to help you
3:17
kind of get the gist quickly. So no matter how long or how short the messages are, whether it's just a text
3:23
or maybe a group chat has absolutely blown up and you missed 100 messages, it's going to try to summarize all that
3:29
into one or two lines. The thing is, once I enable it and started using it
3:34
it basically seems like the notifications that I'm getting are almost never benefited from being summarized or shortened
3:41
Like I've never gotten four text messages that are perfectly summarized into a single one
3:48
And I'm sure it's possible. There are going to be some instances where it works for people, but it's not just me
3:52
I've seen lots of examples online. And there's plenty of memes, too, of Apple's notification summaries doing some sometimes hilarious work, some brutal stuff
4:00
So it works, and I guess it's good for a laugh once in a while. But yeah, this is a feature I straight up turned off
4:06
Then gen moji. So, okay, believe it or not, there was some hype for this one
4:11
And once again, it's basically exactly what it sounds like. It's letting you generate any emoji using AI, anything you want
4:20
So let say I in messages and I want to react to some message with a very specific emoji that doesn exist You would describe an emoji so you write your text and then hit create a new emoji
4:32
give it about three seconds again, and it will use generative AI to create that image for you
4:38
That's fun, I guess. And yes, it will sometimes refuse to make what you ask of it if you ask for something like crazy or graphic
4:45
although it seems to have no problem making a potato with a gun. So that's an emoji reaction you can send
4:51
Sick. very specific use case. There's no doubt some people will have fun with it. I just think I'm not in the
4:55
target demographic to use this sort of thing all the time. So again, over my head, cool, it exists
5:01
but that's it. So then image playground is another maybe kind of weird one. This is almost the
5:06
same tool, but sort of standalone. This is a playground to generate images in a cartoon style
5:13
of whatever you want. So you open the playground's app and again, just describe the image you
5:19
want in text. Anything, really. But before you type anything, there are also a number of these
5:25
buttons down here, and they're kind of just inspiration suggestions for things or people to include
5:30
in the image. So yes, you can choose any of the people that your phone recognizes from your photos
5:36
app, and that'll be the starting point for the image, and then add some themes or accessories or
5:42
background or props or whatever on top of it. So here's me with a hard hat on at a disco
5:49
and it generates it again in a few seconds on device. Always cartoon style, never photorealistic
5:55
and it can give you a few options to choose from, and once you hit done, you can copy and paste that image wherever you want
6:02
Google and a few others have this on their devices too, just sort of a playground to make some artificially generated images
6:10
Again, it's of debatable usefulness. Of course, it makes sense that it won't do photorealistic images
6:15
because that would open up a whole can of worms, but it's even supposed to not do some things that could potentially be offensive
6:22
Again, like if you ask it for a gun, it typically refuses. But I found if you add a few more variables like a chef hat and some fireworks to something
6:32
then it will be a little more likely to actually pull through for you. So, yeah, good thing it says it's in beta and may create unexpected results
6:40
This is yet another app that they've added to my phone that I predict
6:44
that I will probably never use again after making this video. So then, priority notifications
6:49
So, okay, now this is one that I think had some promise, or at least I'm in the target demographic for it
6:54
because as an iPhone and Android user, you start to notice that Apple's weakness has, for a long time
7:00
been notification management. If it was just kind of had a fire hose of notifications coming in all the time
7:05
So priority notifications surfaces certain notifications above the rest when you're in a focus mode that reduces notifications
7:12
But this should also work in the mail app to put AI identified
7:17
high priority messages up at the top, plus some other categories. So if you use the default mail app, which I don't, but a lot of people do, then this could be helpful
7:25
something Gmail has had for many years. And the reduced notifications mode also specifically tries to do a good job of only letting important notifications through, but keeping the rest quiet
7:34
So then the Photos app. Yes, we all hate the new Photos app, everyone
7:41
You do, I do, everyone you know hates it. We're all on the same page. It's terrible
7:45
But Apple has added exactly one AI feature to the photos app in an age where lots of companies are comfortable adding a ton of AI to their photos apps, dozens of things
7:55
But they've decided, all right, yeah, we can do the background object removal thing
7:59
We can do that. So basically the same thing as Google's magic eraser tool. Let's say you've got a picture with a subject in the front and you just want to remove that annoying thing in the background
8:08
You hit the edit button and then on the right side you hit the cleanup tool. And a lot of times it will automatically highlight in this sort of rainbow glow
8:14
the thing that it auto detects that you want to remove. But if it doesn't, you can just tap or circle whatever you want, and it takes a few seconds
8:21
and then it just gets rid of it and uses generative fill to fill in the background
8:25
And of course, some scenes work better than others. It's kind of the same deal as Magic Eraser or Photoshop
8:29
Typically patterns or repeating backgrounds will give you the best results. I'm going to say I actually think this one works better than Google's
8:35
It's better at getting a good outline of the photo bomber or the background object in a single
8:40
gesture, which is nice. It's really smart. So to me, this is also one of the more useful features
8:47
Recording summaries. So okay this one had promise but then was kind of confusing to me because when I saw it on the list I was like oh this I would have loved this as a student This is amazing Just one place where you can record things transcribe them and then summarize them and keep them for later
9:01
That sounds amazing. But this is not built into the default voice memos app at all
9:08
So if you're on a phone call, you can turn on call recording. You hit that little button down there
9:12
It'll take a second. It'll warn the person that you're on the phone with with a little message
9:16
This call will be recorded. And then from there, it'll record everything that gets said and transcribe it
9:22
And the transcriptions are amazing. It identifies each speaker. It is accurate
9:27
I love this part. But then, if you care about the summary part, this is where it starts to get weird again
9:33
Because you go into the notes app. This is where it's saving everything. And it shows up as a new note
9:38
And the preview actually summarizes it right here pretty well. But then when you click in, there is a whole transcript
9:43
Great. and then there's another summary button up here at the top
9:47
You hit that, and there's a different summary. And this one's a little worse
9:53
The first one back in the preview actually picked up and included that I said Ridge Wallet
9:57
The second one didn't get that at all, but it did get Best Buy. Interesting
10:01
But Apple, why don't you bring this to the voice memos app? I want to be able to sit this down in a lecture or a meeting
10:07
and have it record things so I can summarize them later. That's like the main place I figured this would be useful
10:12
but it's not there, so please. Please. The only way to initiate this right now is actually to go through the Notes app, to create
10:19
a new note, and then attach, and then create a new recording, and then record your audio into there
10:25
But it just feels like it could be one step easier. So okay, visual intelligence
10:30
So these last two are kind of the big ones. Visual intelligence is only available on the iPhone 16 and 16 Pro, and you get to it by long
10:37
pressing that button on the side of those new phones, which opens it up
10:41
It's that camera control button. And when you open it up, you get a full screen viewfinder with three buttons, a shutter in the
10:47
middle, then ask on the left, and search on the right. So if you point this at any object or a subject and you hit ask, that lets you ask chat
10:55
GPT anything about what it sees. And if you hit search, then it's basically just reverse Google image searching, whatever
11:02
it sees. So chat GPT or Google. So if you hit the shutter button, it snaps a photo and then continues to give you those two
11:10
items or a pop-up menu where you can again either search or ask. Again, pretty repetitive
11:18
if you ask me, but okay, while this is a very pretty UI and it works pretty quickly, it also isn't
11:24
anything, you know, particularly new that we haven't seen before. Like I was just watching my Galaxy
11:28
S8 review from back in 2017 where I do a demo of the exact same thing. I take a picture of something
11:33
in front of me. It looks it up with Bixby AI and it could tell you if it was a landmark or a product
11:38
that you could shop for. This is going to be more capable. Obviously, chat GPT has a lot more
11:44
capabilities and maybe even a little bit more trust these days than Bixby had back then. And it's
11:49
certainly more well integrated. But yeah, so it's not something mind-blowing or groundbreakingly new
11:54
but it is ideally more accurate and more capable than before. Maybe they're going to continue to
11:59
build on top of this in the future. But then there is chat GPT integration, the sort of last but
12:04
not least new thing. That Siri works with ChatGPT. I think a lot of people thought there was a lot more
12:09
to Siri like right off the back because it has this new animation and you see the new Siri animation
12:13
so you think it's the new Siri, but most of the new Siri stuff isn't here yet. But the chat
12:19
GPT stuff is. So if you ever make a request or ask a question that's out of the normal scope of
12:25
Siri, maybe ask for a recipe or you ask for it to make a trip itinerary or something big
12:31
then it recognizes it and it can prompt you if you want to ask chat GPT instead
12:36
And if you confirm, then it pulls from chat GPT to respond
12:40
This is all free. You don't need an account for this. Apple has promised all sorts of masking so your data is not used for training models
12:47
OpenAI doesn't get to collect any of this information about you through the requests
12:51
But you can also sign into your chat GPT account if you want to keep a history of your queries
12:58
or use higher-end models or even go over the daily limit of your free. free queries. There's even actually a button to upgrade to chat GPT Plus built into iOS now
13:07
so it's pretty well considered. So yeah, the new Siri animation might be fooling some people
13:11
but really it's other than being able to type to Siri more easily, there's really not a whole lot actually new yet with Siri But that brings me to the rest of the things that aren here yet still that are coming soon with software updates That list is right here There are more Apple intelligence
13:29
features that are in the works coming soon. And honestly, Siri is the main one I'm interested in
13:35
because it's supposed to be able to take in-app actions. It should be able to reach into apps
13:40
and take action inside of them, which I think could be awesome. I think developers could all
13:46
update their apps to work really well with it, and it could be really useful. It could differentiate
13:51
Siri to actually make it useful again. But yeah, that's still coming. But yeah, then from there
13:56
my take is the rest of the AI stuff really not super amazing or compelling to me, just to be real
14:06
Like the writing tools, that seems like a nice safe use of generative AI. That's the thing they're
14:10
sort of talking about the most, but I don't even find myself needing to rewrite things that often
14:16
And like I said, I'm not in the target demographic to use the image playgrounds all that much
14:21
or gen mojis all the time. The visual intelligence is definitely super useful like three or four times a year for me
14:27
like when some interesting plant or dog or whatever is in front of me and I want to just
14:30
figure out what it is. But that's actually funny. You remember the clip from the Apple keynote of that person who walks up to a dog
14:38
And instead of asking the person walking the dog, what kind of dog it is, they just go
14:41
hey, can I take a picture of your dog? And then they ask the phone what kind of dog it is instead of just asking the person
14:46
And that to me is the perfect encapsulation of so many of these Apple intelligence features
14:50
You could use them, and they might work really well, but should you
14:56
Should you? Like, you can ask for a more friendly version of this letter to send to your friend
15:01
Or you could try to write it in a friendly way in the first place
15:05
Like, you can ask ChatchipT to plan a whole trip for you with an itinerary and everything
15:12
And honestly, it's really impressive when it works. but are you actually going to just go in blind and just follow the AI generated itinerary
15:21
If you even like packing, like I know there's two types of people when packing, maybe some people will just follow the AI generated prompt
15:28
But I feel like I'm in the type that kind of wants a little bit more than that, I think
15:33
Luckily, no matter what I'm packing, it always fits in my Ridge travel gear
15:36
So shout out to Ridge for sponsoring this portion of the video. Specifically, I helped design the new commuter bag for Ridge
15:43
And actually I've been deliating this creation for the past couple months. We got it some really good water bottle holders on the sides now
15:49
And I also added a tablet sleeve in the back. So if you've got a tablet and a laptop, they both have their own padded slot
15:54
And then I double down when I'm flying because I also have the Ridge Carry On, which is basically perfect
16:01
It's weatherproof. It's rugged. It's got, you know, these aluminum corner protectors
16:05
It also has the 360 spinning wheels. They're super smooth. Of course, it has a slot for a tracker in case it's ever separated from you
16:11
it's incredibly lightweight. It's the go-to. And you already know that they work perfectly together
16:16
like a little ecosystem to create a perfect little travel combo. So shout out to Ridge
16:20
for sponsoring this portion of the video and for letting me design some of these products
16:24
and some more that are upcoming, so we'll have to stay tuned for those
16:29
But if you want to pick up both the carry-on and the backpack, you can get them together at ridge.com slash MKBHD
16:34
and get 30% off. And they also have their Black Friday still going on right now. But yeah, I think Apple is going to
16:40
build on and sort of iterate on hopefully all of these features
16:44
Like we have this sort of standard set that we're expecting from them now and this is the worst they'll ever be
16:50
that will only get better from here. But it is pretty crazy to see how much emphasis
16:54
is in all of the advertising and all the talk about the newest devices on Apple.com
17:00
as if Apple Intelligence is this massive, game-changing, groundbreaking new thing. You know, there are parts of it that are really good
17:08
I think the background eraser tool in photos is probably the best we've seen
17:12
It's better than Google's. It's really impressive. I think the visual intelligence stuff
17:17
has potential to be really good, but honestly, the best thing I think we've gotten
17:21
from Apple Intelligence, because all this stuff is running on device, is bumping up the base memory in everything
17:27
There's more RAM in every iPhone now, and the base memory on every Mac is 16 gigs now
17:32
which made the base Mac Mini an incredible deal. So shout out to Apple Intelligence for that
17:38
Either way, hopefully a lot more coming. Thanks for watching. get you guys the next one
17:43
Peace
#Intelligent Personal Assistants
#Online Media
#Text & Instant Messaging