When Apple Intelligence launched final yr, Apple promised us that its AI system would revolutionize how we use our units. Sadly, this previous yr has been way more middling than miraculous for Apple’s AI, with the platform failing to impress within the methods we have been hoping.
Meaning there are a number of methods Apple Intelligence might be improved sooner or later. From improved automation to extra highly effective modifying instruments and past, Apple’s AI basis opens up a world of prospects for bringing new sensible instruments to our Apple units. Listed below are 10 of the highest options we’d like to see within the subsequent model of Apple Intelligence.
Apple Intelligence 2.0: Quick enhancements
Picture technology
Apple’s Picture Playground app is a enjoyable approach to shortly create quirky photos, but it surely’s nonetheless very restricted and rudimentary, particularly while you evaluate it to rival AI mills resembling Steady Diffusion and GPT-4o Picture Technology.
For starters, Apple wants to repair these persistent bugbears that appear to afflict nearly all AI mills, issues like freakishly inaccurate fingers and ft. However the enhancements must transcend that if Picture Playground is to achieve traction. We want way more management and suppleness over the photographs it whips up. Meaning having the ability to import new technology fashions and types, the power to work with totally different side ratios, alter the relative energy of every immediate, and extra.
It’s uncertain Apple will give us the power to make phot-realistic photos, however there may be nonetheless quite a bit Picture Playground can do to boost its generated artwork. For instance, the current OpenAI GPT-4o mannequin replace allowed customers to attract photos within the model of a Studio Ghibli Japanese animation movie. It was a viral sensation when it launched and precisely the form of factor Picture Playground must get some buzz.
Picture Playground provides rudimentary picture creation at greatest and must be a lot better.
Foundry
Photograph modifying
Talking of photos, Apple has introduced a couple of AI picture modifying instruments to our units, but these will also be vastly improved. Within the first model of Apple Intelligence, we will take away distractions in photographs utilizing Apple Intelligence’s Clear Up software, for instance, however having the choice to add parts to your photos could be a enjoyable additional. This might prolong to refining present components of your photos, resembling changing one sort of tree with one other in a panorama.
We’d additionally prefer to get the ability to take away one thing from one picture and add it to a different. Or to summon Siri and use pure language to make edits. Think about how a lot problem you possibly can save by merely saying, “Hey Siri, change this sky to a thunderous rainstorm.”
Foundry
Apple Intelligence 2.0: Foundational upgrades
Pure language search
One of many key concepts behind synthetic intelligence is that it’s going to simplify your day-to-day life. So why isn’t Apple Intelligence excellent at doing that? One key manner it might enhance is by including extra pure language capabilities.
This might be actually efficient if it was added to issues like Highlight search or the Messages app. We must always have the ability to open Highlight or Siri and ask, “Present me photographs I took between August 3 and 5.” Proper now, that doesn’t work. Highlight brings up photos, certain, however solely people who comprise the textual content you typed. With just a little sprinkling of Apple Intelligence, these searches might be way more helpful.
On-device search must be the inspiration of Apple intelligence.
Foundry
Apple LLM
One of many extra evident examples of Apple intelligence’s ineptitude is Siri’s integration with ChatGPT, which has the unlucky impact of straight evaluating Apple’s AI engine with a much more superior system. The comparability is just not precisely flattering to Apple’s toddler AI efforts.
What we actually want is for Apple to launch its personal LLM to compete with the likes of ChatGPT. For one factor, this is able to inject way more energy into Apple Intelligence’s engines and permit it to face toe-to-toe with the trade’s greatest platforms. For one more, it could higher protect your privateness, since you possibly can keep within the Apple intelligence sphere with out venturing off into less-secure cloud-based options. With an Apple LLM behind the wheel, there could be no want to change to different AI instruments, which might maintain your workflow clean and uninterrupted.
Rumors have urged that this type of Apple-backed LLM is within the works, however we don’t know when it would arrive. When it will definitely does drop, it might be the jump-start Apple Intelligence must maintain tempo with its rivals.
Shortcuts
Apple’s Shortcuts app is without doubt one of the greatest instruments obtainable in your iPhone, but I’d guess most individuals have by no means even opened it. A part of the issue is that Apple solely covers essentially the most fundamental of duties, so that you’re by yourself if you wish to run extra advanced workflows.
This can be a place the place Apple Intelligence might step in to fill the hole. If AI was built-in into Shortcuts in order that you possibly can merely inform it what you need to do, Shortcuts would immediately go from an underused utility to the most effective iPhone options ever. As one of many foremost tenets of Apple intelligence, Shortcuts might recommend easy time-saving shortcuts all through the day like Siri strategies, and switch your iPhone into a real digital assistant.
Automated Shortcuts might be a unbelievable approach to set Apple Intelligence aside from its rivals.
Foundry
Well being and health
Well being and health monitoring has been one among Apple’s priorities lately, with the Apple Watch main the best way. There’s a number of well being information stashed on our units, and there are many ways in which Apple’s AI might assist enhance well being and health with out compromising privateness. There are already rumors that Apple is engaged on an AI “coach” to interpret the info collected by your units and offer you a extra full image of your well being.
Such a platform might present itself in optimized exercises with Apple Intelligence crunching your health numbers after which constructing a customized exercise plan primarily based in your wants. Or specialised HIIT exercises, Pilates, weight coaching, or no matter it thinks it’s good to take your health to the following stage.
Apple
Apple Intelligence 2.0: New options
Movies
Apple Intelligence is already getting used to edit photos on our iPhones, however what if it might apply its expertise to movies as nicely? The iPhone is already one of many prime video telephones round and AI might take it to the following stage.
Maybe that might imply creating a listing of urged edits for any venture you feed into it. Or the ability to take away distractions from movies in the identical manner you’ll be able to at present do with photos. Maybe even automated shade grading and audio mixing might be added.
In fact, Apple can be very cautious about treading on video modifying – in any case, it in all probability doesn’t need to suggest it’s coming after the inventive industries after the Crush! advert fiasco – however a couple of useful instruments for novice editors to play with on their iPhones could be a welcome addition.
Notes
One of many ways in which Apple tried to reveal Apple Intelligence’s energy at WWDC 2024 was via transcribing audio within the Notes app. Sadly, that is neither a groundbreaking function nor one which’s even on par with rival AI platforms. It’d work nicely for easy voice memos, however something with multiple speaker shortly turns into a jumbled mess.
There’s a fast manner Apple can repair this by educating Apple Intelligence methods to routinely label audio system—in any case, providers resembling Otter and the tiny impartial MacWhisper app have been doing it for years.
Apple’s Notes app does an important job of transcribing with Apple Intelligence, but it surely’s not but sensible sufficient to differentiate between totally different audio system.
Apple
Maps
Over time, Apple Maps has improved a lot that many iPhone customers now choose it over Google Maps. However as a substitute of Apple working a victory lap, Apple can use AI to boost Maps even additional.
In the intervening time, you’ll be able to search Apple Maps for issues like eating places and outlets close to you. However I need greater than that – I need to have the ability to ask Apple Maps for “the most effective eating places close to me” and solely see the highest-rated ones. Or seek for eateries that serve meals with particular substances (that is at present very hit-and-miss). Or discover out the place the most effective viewpoints are in my metropolis (once more, that is unreliable). Apple Maps struggles with that proper now, however maybe Apple Intelligence would assist it get there.
Apple Intelligence may also assist with instructions. Siri is already fairly good at getting us from Level A to Level B, however as with a lot of Siri’s present options, it’s nonetheless disappointingly restricted to locations and addresses. Apple Intelligence might step in right here to make it extra highly effective. For instance, you possibly can ask Siri to “get me house utilizing essentially the most eco-friendly route,” or “create a round strolling route within the countryside close to me.” Weaving extra AI into the combo may make these requests extra achievable for Apple’s digital assistant.
With just a little Apple Intelligence, Maps might be a lot extra helpful.
Apple
House
Apple is closely rumored to be getting in on the sensible house act with a brand new HomePad hub machine reportedly launching later this yr and early subsequent, and Apple Intelligence will nearly definitely tackle a central function in the way you work together with it. However
You may sooner or later use Apple Intelligence to research the linked units in your sensible house to work out how you possibly can get monetary savings on electrical energy payments or scale back your carbon footprint. And with rumors swirling that Apple is engaged on a sequence of sensible house hubs, it’s doable that these capabilities will seem on the horizon sooner quite than later.
