During the WWDC 2024 event, Apple introduced its revolutionary Apple Intelligence system, which appears to be quite remarkable. This system includes a plethora of AI features and experiences that are powered by Apple Intelligence, offering meaningful solutions for users across various scenarios.
One of the most notable aspects is that the majority of AI tasks are processed locally, directly on the device. For more complex tasks, Apple has developed a Private Cloud Compute infrastructure, equipped with its own Apple Silicon and server stack, to provide private AI computing. Apple emphasizes that it does not store user data and assures that its privacy safeguards can be verified. Here are all the AI features that are coming to iPhone, iPad, and Mac.
Writing Tools
Writing Tools is an AI feature powered by Apple Intelligence, available for use in any text field within any app. It enables you to rewrite text, adjust tone, summarize passages, proofread paragraphs, and more. Additionally, you can input your own prompt to customize the text rewriting according to your preferences. This feature is accessible in Messages, Notes, Mail, and other supported apps.
Priority Notifications
Apple Intelligence is utilized to prioritize notifications in iOS 18. It intelligently places your important notifications at the top of the stack and provides summaries for quick review. Additionally, if a message is deemed important, a ‘maybe important’ label is displayed atop the notification stack, even when Focus mode is active.
AI in Mail App
Within the Mail app, Apple Intelligence prioritizes time-sensitive messages, ensuring they appear at the top of your inbox to prevent missing any deadlines. You can also access summaries of lengthy emails with just a single tap. Additionally, Smart Reply allows you to quickly send a personalized response if you wish to reply promptly.
Call Recording Summaries
Surprisingly, Apple has introduced call recording to iPhones with iOS 18. When you tap the recording button, an audio message will notify you that call recording has been activated. The purpose of this feature is to create call summaries for easy retrieval of important information later. Additionally, you can transcribe audio files within the Notes app.
Generate Images, Genmoji, and Memory Movies
The dedicated Image Playground app allows you to generate AI images on your Apple device, powered by Apple Intelligence. This feature is also integrated into many first-party apps. Simply add your description and choose a style, such as animation, illustration, or sketch.
Additionally, you can create a Genmoji, a custom emoji that reflects your feelings. You can either enter a description or select an image to create a Genmoji. The new AI feature, Image Wand, lets you circle a sketch to generate a new visual.
Furthermore, you can search for photos using descriptive queries and create memory movies. Apple Intelligence comprehends user intent and generates beautiful movies. You can also use the Clean Up tool to remove distractions from images, similar to Google’s Magic Eraser.
A New Siri, Powered by Apple Intelligence
Among all the new AI features coming to Apple devices, the most exciting is the new Siri, which is deeply integrated into the system and highly personalized. It features a new design with glowing light around the corners when activated. You can ask Siri questions about your iPhone if you’re unable to find a setting or feature.
If Siri doesn’t know the answer to your question, it can request your permission to send the query to ChatGPT. Apple has integrated ChatGPT into Siri as well as many other apps. Additionally, for on-device tasks, Siri is fast and capable of performing numerous tasks. It possesses “on-screen awareness,” enabling it to see your screen, understand context, and execute appropriate actions.
Furthermore, Apple noted that Apple Intelligence creates an on-device semantic index that stores all pertinent information. When a user expresses an intent for an action, this index is used to further process the request.
For instance, if you ask the new Siri to check your flight schedule, it can automatically retrieve all your flight details from the Mail app and display the current status. It can also generate a schedule based on that information. Siri can execute many such on-device tasks, which appears to be a significant advancement.
ChatGPT Integration
Apple has integrated ChatGPT into iOS, iPadOS, and macOS, accessible via Siri and many other first-party apps. This integration is separate from Apple Intelligence, as user queries are sent to OpenAI’s cloud servers. However, Apple assures that user queries won’t be logged by OpenAI.
Siri and other apps will ask for your permission before sending your requests to ChatGPT. Apple also mentions that support for additional AI models is coming to Apple devices.
These are all the new AI features powered by Apple Intelligence coming to iPhone, iPad, and Mac. For a list of devices that support Apple Intelligence, please refer to our list. Apple has indicated that Apple Intelligence features and experiences will initially be launched in US English, with a beta release later this fall.
0 Comments