Announcing Apple's next big step for Siri and iPhone

Highlight

iOS 27 upgrades Siri into a standalone app with searchable conversation history; Image Playground adds photorealistic image generation; Safari introduces Topics and Notify Me; and the system can automatically detect and update leaked passwords with one tap.

Core Content

Siri finally has its own app

Previously, when you called Siri, it appeared, completed the task, and disappeared. The conversation was broken, context was lost, and if you wanted to continue, you had to start over.

iOS 27 gives Siri a dedicated app. After you ask a question, the conversation stays in the app, and you can go back to it at any time. This is similar to the conversation lists in ChatGPT or Claude, but Siri’s advantage is system-level permission: it can directly operate on your calendar, mail, and photos, and it can understand what is on screen.

The video demonstrates one scenario: the user asks Siri to analyze the nutrition in the food in front of them. Siri searches the web, then looks at the image on screen, and gives an answer. This means Siri’s Screen Awareness capability has expanded from built-in system apps to the interfaces of third-party apps.

For developers, if your app exposes sufficiently rich operations through App Intents, Siri can complete complex multi-step tasks for users inside the standalone app, rather than merely opening a page.

Image Playground moves from illustration to photorealism

Image Playground in iOS 18 could only generate cartoon-style illustrations. iOS 27 adds a photorealistic style, producing images that can be used directly as wallpapers or Contact Posters.

The jump in compute from illustration to photorealism is exponential. Apple’s willingness to do this on device suggests that the Neural Engine in A-series and M-series chips has received substantial low-level optimization, or that the scheduling mechanism for Private Cloud Compute has matured.

Developers can generate high-quality assets directly through the API without relying on third-party image generation services. But photorealistic images also bring deepfake and copyright risks, so Apple’s API will likely require C2PA provenance watermarks and NSFW filtering.

Safari gets smarter

Safari adds two features:

Topics: Automatically groups open webpages by topic, solving tab explosion.
Notify Me: Proactively notifies users when webpage content changes, without requiring developers to build a Push Notification backend for polling.

For developers, Notify Me means users can receive key updates from your website without installing an app. That lowers the barrier to receiving information, but it also means your site needs better support for Safari’s content detection mechanism.

One-tap repair for leaked passwords

The system automatically detects compromised passwords, and users can update them with one tap. This feature depends on the AutoFill framework, so developers need to make sure their login and password-change pages correctly support password autofill. Otherwise, the system cannot complete the one-tap replacement.

Details

Technical meaning of a standalone Siri app

(00:14)

Moving Siri from a system-level UI into a standalone app is a major architectural change. Previously, Siri was attached to Spotlight or the Lock Screen and had a very short lifecycle. Now it needs to maintain long-lived Conversation History and global context.

This places new demands on App Intents design:

A single Intent should return sufficiently rich information because Siri will show results in an independent interface, not just a banner.
In multi-turn conversations, Intents need to receive context parameters so Siri can ask follow-up questions.
As screen awareness improves, the app’s UI state needs to be exposed more clearly to the system through App Intents.

Image Playground’s photorealistic style

(00:47)

The core shift from cartoon illustration to photorealism is in model resolution and realism. To keep iOS 18 Image Playground running on device, the model was compressed to generate only low-resolution images in specific styles. The photorealistic style in iOS 27 may use a hybrid path: simple requests are handled on device, while complex requests go through Private Cloud Compute.

Developers should keep several things in mind:

Photorealistic requests may time out on weak networks, so fallback logic is needed.
Generated images will carry a system-level watermark for content provenance.
Certain topics will be filtered, and a request may fail instead of generating unsafe content.

How Safari Notify Me is likely implemented

(00:55)

Notify Me is not simple webpage monitoring. It should be a built-in Change Detection mechanism in Safari, combined with Apple’s push infrastructure. Websites do not need to make changes; Safari automatically detects important content changes on a page, such as price changes, inventory updates, or article publication.

For content sites, this is effectively a free “subscribe to updates” feature. For ecommerce sites, users can receive price-drop notifications without installing an app.

The key path for automatic password updates

(01:02)

The one-tap leaked password update flow:

The system detects that a password for a website appears in a breach database.
The user receives a notification and taps “Update Password.”
The system opens that website’s password-change page.
AutoFill enters the current password, generates a new password, and submits the form.

If a website’s password-change page does not correctly mark input field types, such as type="password" and autocomplete attributes, AutoFill cannot locate the fields and the one-tap update fails.

Core Takeaways

Design App Intents for Siri multi-turn conversations: Split the old “open page” Intent into fine-grained Intents such as “query state,” “modify state,” and “get details.” Siri can combine them inside the standalone app to help users complete complex tasks. Entry points: the AppIntent protocol plus the @Parameter property wrapper.
Make app UI understandable to Siri: Add accessibilityLabel and accessibilityValue to key interface elements. Siri’s Screen Awareness depends on this information to understand on-screen content. Also expose matching App Intents so Siri can act on your app.
Adopt Image Playground for wallpapers and posters: If your app lets users customize avatars, covers, or backgrounds, integrate the Image Playground API so users can generate personal images with natural-language descriptions. Handle generation failures and style fallback.
Improve AutoFill support for password-change pages: Check the HTML structure of login and password-change pages, ensuring password fields use the correct autocomplete="current-password" and autocomplete="new-password" attributes. That is what lets users repair leaked passwords with one tap.
Use Safari Notify Me to lower the user barrier: Add structured data (JSON-LD) to key website pages such as product pages and article pages, helping Safari detect content changes more accurately. Users can receive updates without installing an app.

What’s new in Siri and App Intents — The new App Intents capabilities in iOS 27 directly determine what Siri can do for your app inside independent apps
Advanced App Intents — Intent design patterns for multi-turn conversations and complex UI interactions
Image Playground — Detailed APIs and usage limits for photorealistic image generation
Testing App Intents — Writing automated tests for Siri multi-turn conversation scenarios
Agentic Apps — Build agentic apps that can complete multi-step tasks autonomously, with the standalone Siri app as the core entry point