WWDC Quick Look 💓 By SwiftGGTeam
中文 EN 日本語
WWDC21 Monday Recap

WWDC21 Monday Recap

EssentialsWWDC21Overview
Watch original video

Highlight

Apple released iOS 15, SharePlay, Live Text, Universal Control, Xcode Cloud, Swift concurrency, Object Capture and other capabilities on the first day of WWDC21. Developers have gained new entrances for collaboration, recognition, automated construction and AR content production.

Core Content

After developers watched the first day of WWDC, the common questions were very straightforward: what should I learn first this year, which new capabilities will affect their apps, and which ones are just system function updates.

This recap condenses the first day into just over two minutes. It starts with iOS 15, mentioning Maps’ 3D redesign, Safari’s cross-platform new look, and Live Text’s recognition of text in pictures. Then move on to FaceTime, SharePlay, Apple TV, Find My, iCloud+, iPad Home Screen, AirPlay to Mac, and Universal Control.

For developers, the focus comes in several places. SharePlay is not just a system video calling feature, Apple has explicitly mentioned providing developers with new playback launch APIs, and these APIs can be plugged into the existing video experience of the app. Swift concurrency, SwiftUI, Object Capture for ARKit and Xcode Cloud are also entering the developer toolchain on day one.

The value of this session is not to talk about API details. Its function is to sort the learning routes: first look at Keynote to establish a global perspective, then look at Platforms State of the Union to find the technical entrance, and finally enter SharePlay, Swift, Xcode Cloud, ARKit and other special sessions according to your own App type.

Detailed Content

iOS 15: Starting from the system experience and affecting the app scene

(00:13) Review first click on iOS 15. System capabilities listed in Transcript include Maps 3D redesigned, Safari new look, and Live Text. These capabilities change the way users complete tasks outside the app and also affect the entry of content into the app.

iOS 15
- Maps: intuitive 3D redesign
- Safari: new look on iPhone, iPad, and Mac
- Live Text: text recognition in images

Key points:

  • iOS 15It is the starting point for the first-day platform update. -MapsThe 3D redesign affects location and navigation-like experiences. -SafariSimultaneous changes on iPhone, iPad, and Mac, web content and App deep links should be checked together. -Live TextTurn text in pictures into interactive information, suitable for scenarios such as bills, notes, and photo retrieval.

SharePlay: Integrate synchronized playback into existing video experiences

(00:26) FaceTime adds spatial audio and Portrait mode. Then, SharePlay supports simultaneous sharing of screens, music, and TV shows with friends, covering iPhone, iPad, Mac, and Apple TV.

SharePlay
- share your screen
- listen to music in sync
- watch a TV show in sync
- works across iPhone, iPad, Mac, and Apple TV
- new APIs to start playback inside an existing video experience

Key points:

  • share your screenNote that SharePlay not only serves media playback, but also serves collaborative presentations. -in syncis the core constraint that participants see or hear the same progress. -iPhone, iPad, Mac, and Apple TVExplain that the experience needs to be consistent across devices. -new APIs to start playbackIt’s a developer portal, and Apple clearly connected it to the app’s existing video experience in its review.

Universal Control: Multi-device workflows become the default assumption

(01:05) The recap mentions AirPlay coming to Mac and then shows off Universal Control. Users can move between devices, operate as if they were one device, and drag and drop files.

Universal Control
- move between different devices as if they were one
- drag and drop files between devices

Key points:

  • different devicesRefers to cross-device combinations such as Mac and iPad. -as if they were oneNote that the input focus and pointer movement must be continuous. -drag and drop filesIt is a specific interaction. File apps need to check the drag-and-drop, import, and export processes.

Xcode Cloud, Swift concurrency, SwiftUI: Development tool chain updates

(01:43) The second half of the review goes into developer content. Transcript continuously mentions Xcode Cloud, Focus mode, Swift Playgrounds, Swift concurrency, SwiftUI, high-end game development tools, Object Capture for ARKit, and SharePlay API.

Developer tools and frameworks
- Xcode Cloud
- Focus mode
- Swift Playgrounds app building
- Swift concurrency
- SwiftUI
- high-end game development tools
- Object Capture for ARKit
- APIs for SharePlay

Key points:

  • Xcode CloudPoints to continuous integration and delivery capabilities within Apple’s development process. -Focus modeAffecting notifications and user attention management, apps need to respect the user’s focus state. -Swift Playgrounds app buildingBringing app building power to Swift Playgrounds. -Swift concurrencyThis is the entrance to the Swift concurrency model. You will continue to read the special session later. -Object Capture for ARKitPoints to workflows for generating AR content from real-world objects. -APIs for SharePlayConfirm again that SharePlay has a developer API entrance.

Health, Wallet, Siri: System services open new scenarios

(01:18) The middle section also mentions Walking Steadiness, Health App health data sharing, Tai Chi, Pilates, mindfulness on Apple Watch, as well as ID cards in Wallet, Home Keys, and Siri on third-party devices.

System services
- Walking Steadiness
- Health data sharing with family and doctors
- Tai Chi, Pilates, and mindfulness on Apple Watch
- ID cards in Wallet
- Home Keys in Wallet
- Siri on third-party devices

Key points:

  • Walking SteadinessBring health risk reminders into the Health experience. -Health data sharingLet family members and doctors become health data usage scenarios. -Home KeysExtend Wallet to door lock operation. -Siri on third-party devicesIt shows that voice portals will appear in more home devices.

Core Takeaways

  1. What to do: Add SharePlay viewing entrance to the video app. Why it’s worth doing: The review explicitly mentions that Apple offers a new playback launch API that can be plugged into existing video experiences. How ​​to start: First look at the Group Activities and SharePlay special sessions to confirm the framework entrances for synchronized playback, participant status and playback control.

  2. What to do: Add text recognition operation flow to picture or scanning apps. Why it’s worth doing: Live Text turns text in images into actionable information for users. How ​​to start: Extract text from photos, screenshots, notes, and whiteboard images, and design next actions around copying, searching, and creating reminders.

  3. What to do: Check out the drag-and-drop import process between iPad and Mac. Why it’s worth it: Universal Control turns dragging and dropping files across devices into a day-one focused workflow. How ​​to start: Sort out the file types supported by the App, check drag-in, drag-out, error prompts and state recovery after import.

  4. What to do: Connect the project to Xcode Cloud’s build check. Why it’s worth it: Xcode Cloud is included in the developer toolchain on day one, suitable for automating builds, tests, and pre-distribution checks. How ​​to get started: Start with a master branch build workflow, gradually adding testing, archiving, and TestFlight distribution.

  5. What to do: Establish an Object Capture material process for AR display apps. Why it’s worth doing: Object Capture for ARKit appears in the first-day developer capabilities list, indicating that Apple has put the production process of real objects into AR content at the forefront. How ​​to start: First select a small object, take photos from multiple angles, continue reading the Object Capture special information, and then connect the generated 3D content to ARKit for display.

Comments

GitHub Issues · utterances