While wrapping up its WWDC Keynote, Apple announced its first major foray into generative AI: Apple Intelligence. The company says the undertaking will put generative models at the core of iPhone, iPad, and Mac, while also keeping its core values, like user privacy, at the forefront. Intelligence will touch virtually every aspect of its platforms, including notifications, messaging and email, photos, and much more.
A quick note from CEO Tim Cook:
“We’re thrilled to introduce a new chapter in Apple innovation. Apple Intelligence will transform what users can do with our products — and what our products can do for our users,” said Tim Cook, Apple’s CEO. “Our unique approach combines generative AI with a user’s personal context to deliver truly helpful intelligence. And it can access that information in a completely private and secure way to help users do the things that matter most to them. This is AI as only Apple can deliver it, and we can’t wait for users to experience what it can do.”
Writing Tools
Apple Intelligence introduces innovative features to help users improve their writing and communicate more effectively. With the new systemwide Writing Tools in iOS 18, iPadOS 18, and macOS Sequoia, users can rewrite, proofread, and summarize text across a variety of applications, including Mail, Notes, Pages, and third-party apps.
- Rewrite: Allows users to select from different versions of their text, adjusting the tone to fit the audience and purpose. Perfect for refining a cover letter or adding humor and creativity to a party invitation.
- Proofread: Enhances writing by checking grammar, word choice, and sentence structure. Suggests edits with explanations for users to review or quickly accept.
- Summarize: Condenses text into a digestible paragraph, key bullet points, a table, or a list.
- Mail Priority Messages: A new section at the top of the inbox highlights the most urgent emails, such as same-day dinner invitations or boarding passes.
- Mail Summaries: Users can see summaries of emails without needing to open each message, instead of just previewing the first few lines.
- Long Thread Details: Users can view pertinent details of long email threads with a single tap.
- Smart Reply: Provides suggestions for quick responses and identifies questions in emails to ensure all are answered.
- Priority Notifications: Appear at the top of the stack to highlight the most important alerts.
- Notifications Summaries: Help users scan long or stacked notifications by showing key details on the Lock Screen, such as during active group chats.
- Reduce Interruptions: A new Focus mode that surfaces only critical notifications, such as a text about an early pickup from daycare, to help users stay present in their activities.
- New transcription feature: In the Notes and Phone apps, users can now record, transcribe, and summarize audio. When a recording is initiated while on a call, participants are automatically notified, and once the call ends, Apple Intelligence generates a summary to help recall key points.
Image Playground
Apple Intelligence also introduces Image Playground, enabling users to create images quickly and easily. With three styles—Animation, Illustration, and Sketch—users can generate fun images directly within apps like Messages or in a dedicated app. Images are created on-device, allowing unlimited experimentation with different concepts and styles.
- Range of Concepts: Users can choose from categories like themes, costumes, accessories, and places to create images.
- Description Input: Type a description to define an image.
- Personal Photo Integration: Include someone from their personal photo library in the image.
- Style Selection: Pick their favorite style for the image.
- Messages Integration: Quickly create fun images for friends and see personalized suggested concepts related to conversations, such as hiking-related concepts if messaging about a hiking trip.
- Notes Integration: Access Image Playground through the new Image Wand in the Apple Pencil tool palette, turn rough sketches into delightful images, and create images using context from the surrounding area.
- Other App Integrations: Available in Keynote, Freeform, and Pages.
- Third-Party App Support: Accessible in third-party apps that adopt the new Image Playground API.
- Genmoji – Users can create unique emoji by typing a description or using photos of friends and family. These customizable Genmoji can be added inline to messages or shared as stickers or reactions through Tapback.
Photos
Searching for photos and videos becomes even more convenient with Apple Intelligence, allowing natural language queries like “Maya skateboarding in a tie-dye shirt” or “Katie with stickers on her face.” Videos can also be searched for specific moments, and the Clean Up tool removes distracting background objects without altering the subject. Memories lets users craft personalized stories by typing descriptions, with Apple Intelligence selecting the best media, organizing them into themed chapters, and suggesting matching songs from Apple Music—all while keeping user content private.
- Natural Language Photo and Video Search: Users can search for specific photos and videos using natural language queries.
- Powerful Video Search: Find specific moments in videos for easy access to relevant segments.
- Clean Up Tool: Identifies and removes distracting objects in the background of photos without altering the subject.
- Memories Feature: Users can create personalized stories by typing descriptions, with Apple Intelligence organizing media into themed chapters and suggesting matching songs from Apple Music.
- Privacy: User photos and videos remain private on device and are not shared with Apple or any third parties.
Siri
Powered by Apple Intelligence, Siri is deeply integrated into the system experience, offering richer language understanding, natural interactions, and personalization to simplify everyday tasks. Siri can follow along if users stumble over words, maintain context between requests, and it now supports typing for communication flexibility. Additionally, Siri’s onscreen awareness enables seamless actions related to displayed information, such as adding addresses received in Messages to contacts. With Apple Intelligence, Siri can perform hundreds of new actions across apps, including finding recommendations and handling user content intelligently.
- New glowing design: Siri has essentially been rebranded, with a new icon and new elegant glowing light effect
- Rich Language Understanding: Siri offers more natural, contextually relevant, and personalized interactions.
- Typing to Siri: Users can now communicate with Siri via text input.
- Onscreen Awareness: Siri can perform actions related to displayed information on the screen.
- Expanded Actions: Siri can execute hundreds of new actions across apps.
- Tailored Responses: Siri delivers personalized responses based on user information and device data.
ChatGPT
Apple is integrating ChatGPT access into iOS 18, iPadOS 18, and macOS Sequoia, allowing users to leverage its expertise, image, and document understanding seamlessly. Siri can tap into ChatGPT’s knowledge upon user request, providing direct answers and assistance. ChatGPT will also be integrated into Apple’s systemwide Writing Tools, aiding users in generating content and creating images to complement their writing. Privacy protections are ensured, with IP addresses obscured and no storage of requests by OpenAI.
- Seamless Integration: Access ChatGPT’s expertise, image, and document understanding within iOS 18, iPadOS 18, and macOS Sequoia.
- Siri Integration: Siri can utilize ChatGPT’s knowledge upon user request, presenting direct answers and assistance.
- Systemwide Writing Tools Integration: ChatGPT is integrated into Apple’s Writing Tools, aiding users in generating content and creating images to complement their writing.
- Privacy Protections: IP addresses are obscured, and requests are not stored by OpenAI, ensuring user privacy.
- Accessibility and Pricing: ChatGPT will be available for free without creating an account, with options for paid features for subscribers.
Privacy
Apple Intelligence prioritizes deep personal context while safeguarding user privacy, with on-device processing being a key aspect. Private Cloud Compute extends this privacy into the cloud, allowing for more complex requests while maintaining data security. With this feature, Apple Intelligence can flexibly scale its computational capacity and ensure that data remains private and secure.
- On-device Processing: Apple Intelligence relies on on-device processing, ensuring user privacy.
- Private Cloud Compute: Extends privacy into the cloud, enabling more complex requests while maintaining data security.
- Flexibility and Scalability: Allows Apple Intelligence to flexibly scale its computational capacity to handle more complex tasks.
- Server-based Models: Larger, server-based models powered by Apple silicon enable the processing of complex requests without compromising privacy.
- Code Inspection: Independent experts can inspect the code running on Apple silicon servers to verify privacy and security.
- Cryptographic Security: Private Cloud Compute ensures that devices only communicate with servers whose software has been publicly logged for inspection.
- Trustworthy Intelligence: Sets a new standard for privacy in AI, providing users with intelligence they can trust.
Availability
Apple Intelligence will be available later this year alongside iOS 18, iPadOS 18, and macOS Sequoia