Apple Launches Apple Intelligence for iPhone, iPad and Mac

System-wide writing tools

With writing tools tightly integrated across iOS, iPadOS and macOS, users can rewrite, proofread and summarize to improve their language almost anywhere they write, including Mail, Messages, Notes, Pages and third-party apps.

With Rewrite, Apple Intelligence helps users choose from different versions of their writing, tailoring it to be professional, concise or friendly for the reader or task at hand. Proofreading checks grammar, language and syntax and suggests edits with explanations so users can review and quickly approve. Users can also summarize selected text into easy-to-read paragraphs, bullet points, tables or lists.

Siri for more natural conversations

Siri is more natural, contextual and tightly integrated into the system experience, with a new shining design that wraps around the edges of the screen when working on iPhone, iPad and CarPlay. On Mac, Siri can be placed anywhere on your desktop for easy access while you work. You can type to Siri anytime on iPhone, iPad and Mac, and with Siri you can seamlessly switch between text and voice to get everyday tasks done faster.

With richer language understanding, Siri can keep up with users when they stumble and maintain context from one request to the next. Plus, with her vast product knowledge, Siri can answer thousands of questions about Apple product features and settings, and can learn everything from how to record your screen to easily share your Wi-Fi password.

A smarter photo app

The new feature in the Photos app allows users to search using natural language, so they can find almost anything by simply describing what they’re looking for, such as “Maya skateboarding in a tie-dye shirt.” Users can also search for videos, so they can find what happened in a specific part of a video and instantly view that scene. Search also provides suggestions to help users complete their search quickly.

If an unwanted object or person appears in the frame of your photo, the cleanup tools can be used to remove the unwanted elements while staying true to the intent of the moment.

(Memories movie creation is available on iPhone and iPad, and will be available on Mac in the coming months.) Using its ability to understand language and images, Apple Intelligence will select the best photos and videos based on the user’s description and create a storyline divided into chapters based on themes identified in the photos, turning the movie into a unique, narrative story.

A new way to prioritize and focus

Managing email is now easier than ever. With Priority Messaging, a new section that appears at the top of the Mail app’s inbox displays the most urgent emails, like today’s lunch invitation or boarding pass. Users can see summaries without opening messages in their entire inbox, and for long threads, simply tap or click “Summary” to see the relevant details. Plus, Smart Reply offers suggestions for quick responses and identifies questions in emails to ensure everything is answered.

Apple Intelligence helps users prioritize and stay focused with notification summaries that let you quickly view long or stacked notifications and surface important details on the Lock Screen, such as when a group chat becomes particularly interactive. A new focus mode with Reduce Disturbances shows only the notifications that need your immediate attention.

The Notes and Phone apps can record, transcribe and summarize audio. When recording starts during a call in the Phone app, participants are automatically notified and when the call ends, Apple Intelligence generates a summary to help remember key points.

Many new features for Apple Intelligence coming soon

Apple Intelligence brings new ways for users to visually express themselves. Emoji are taken to a whole new level, allowing you to create your own Jenji just by entering a description. You can also personalize emoji with photos of friends and family. Image Playground creates fun images in an instant. The Image Magic Wand transforms rough sketches into beautiful images, making your notes more visually appealing. Plus, you can draw a circle in an empty space to create an image using the surrounding context.

In December 2024, the writing tool will have the ability to explain the specific changes you want to make to your writing, such as making a dinner party invitation more impactful or adding more lively verbs to your resume. Additionally, you will be able to access ChatGPT’s extensive world knowledge and benefit from its image and document understanding capabilities within the writing tool and Siri, without having to switch between tools.

More to come in December!

Also coming in December, new visual intelligence experiences built on Apple Intelligence will come to life with new camera controls on the iPhone 16 lineup, enabling users to instantly learn about objects and places (camera controls are available on iPhone 16, iPhone 16 Plus, iPhone 16 Pro and iPhone 16 Pro Max).

For example, you can translate text from one language to another, get details about the restaurant in front of you, and use the information. Camera Control also acts as a gateway to third-party tools with specific domain expertise, like when you want to search Google to find where to buy a certain product, or when you want to benefit from ChatGPT’s problem-solving skills. Users have control over when to use third-party tools and what information is shared.

Additionally, over the coming months, priority notifications will surface what’s most important to you, Siri will be able to use your personal context to provide tailored intelligence, and Siri will add on-screen recognition to enable hundreds of new actions within and across Apple and third-party apps.

Privacy Protection

Designed to protect user privacy at every step, Apple Intelligence uses on-device processing so many of the models that power it run entirely on device, and for requests that require more processing power, Private Cloud Computing extends the privacy and security of Apple devices to the cloud, unlocking even more intelligence.

When using private cloud computing, Apple says it will not store or share user data. The data will only be used to fulfill user requests. To continually verify that this privacy promise is being met, independent experts will be able to inspect the code that runs on Apple Silicon servers, marking a major step forward for privacy in AI.

Users can choose whether to enable ChatGPT integration, which is offered as part of Siri, the writing tool, or visual intelligence for camera control. Users can access ChatGPT for free without creating an account. Privacy protection is built in, users’ IP addresses are anonymized, and OpenAI does not store requests. Users who choose to connect their account are subject to OpenAI’s data usage policy.

CEO of Apple, Tim Cook commented: