Apple’s 2024 Worldwide Developer Conference (WWDC) has turned out to be one of the company’s most significant events in decades. The opening keynote on Monday was dominated by a focus on artificial intelligence (AI), with Apple unveiling a range of AI features across its operating systems. Additionally, Apple announced major software upgrades for its devices, including iPhone, iPad, Apple Watch, Mac, and Vision Pro.
Apple introduced the first major upgrade to VisionOS, VisionOS 2. This update brings new capabilities to the Vision Pro, such as transforming 2D photos into Spatial Photos, creating more shared experiences through Spatial Personas, and introducing new hand motion gestures for easier navigation. Vision Pro users will also benefit from a higher resolution and bigger size when mirroring macOS, a Guest User option, and the ability to cast content from other Apple devices using AirPlay. The Vision Pro will be available in more countries starting June 28.
iPhone and iPad users can look forward to greater home screen customization, including placing apps anywhere and customizing app icon colors. The Control Center received significant upgrades, allowing users to personalize toggles and pages. Privacy options now include the ability to lock and hide apps, enhancing user security. The Messages app now supports Tapbacks with different colors and emojis, text effects, formatting options, and the ability to schedule messages. A new Messages via Satellite feature will allow users to send messages without Wi-Fi or cellular service.
The Mail app will automatically categorize emails later this year, and the Wallet app now facilitates Apple Cash exchanges without sharing personal information. The Journal app offers more statistics and insights, while a new Game Mode optimizes the gaming experience on iPhones. The Photos app received a major redesign, and the Messages app now supports Rich Communication Services (RCS).
Apple’s AI enhancements include new Siri interactions that recognize head gestures and a Personalized Spatial Audio API for game developers. Apple TV introduces the InSight feature for additional information on shows, enhanced dialogue clarity, optimized subtitles, and support for 21:9 formatting. Apple Watch users will enjoy a new Vitals app, customizable Activity Rings, improved Apple Fitness+ features, and more intelligent Smart Stack suggestions.
WatchOS brings new features such as Check In for safety, Translate, customizable photo watch faces, and the ability to control apps with a double tap gesture. The update also introduces a floating tab bar for app content and SharePlay for remote control of other devices.
iPadOS 18 finally includes a calculator app with Apple Pencil support and Smart Script for enhanced handwriting. Handwriting in Notes got an upgrade with better legibility and new text formatting options. The update also supports screen-sharing via SharePlay and all the features found in iOS 18.
MacOS Sequoia includes many new features from iOS 18 and iPadOS 18, such as the updated Safari, Photos, Messages, and a new Passwords management app. iPhone mirroring on Mac, window tiling, improved video meeting backgrounds, and an AI summarization tool in Safari are among the highlights.
Apple introduced “Apple Intelligence,” a new personal intelligence system that integrates generative models across Apple devices. It prioritizes notifications, offers AI-powered writing tools, creates personalized images, and can perform tasks based on user context. Apple Intelligence emphasizes privacy, with on-device processing and Private Cloud Compute for larger tasks.
Siri received an AI makeover, improving natural language processing, conversational context, and the ability to complete tasks across apps. It can also leverage Apple Intelligence for enhanced functionality.
Apple Intelligence also enhances the Mail app with rewriting, proofreading, and summarizing features, as well as new Smart Reply and email prioritization capabilities. The new focus option, reduce interruptions, helps users minimize distractions based on their activity and context.
Genmoji allows users to create AI-generated emojis, while Image Playground creates images from text prompts. The Photos app now features a clean-up tool, search in videos, and on-demand Memories creation. The Notes app includes audio recording and transcription with AI-generated text summaries.
Apple confirmed its partnership with OpenAI by integrating ChatGPT with Siri, allowing users to leverage ChatGPT’s writing capabilities and receive assistance from the chatbot. This integration will be available for free, with enhanced features for ChatGPT Plus users.
Overall, WWDC 2024 showcased Apple’s commitment to AI and user experience, with significant updates across its ecosystem of devices and applications.
Your First 10 AI Skills
10 practical AI skills, copy-paste prompts and a 7-day plan to start using AI with confidence.
Download the guide →