At this year’s WWDC conference, Apple announced the implementation of a range of new generative AI-based features in its devices and operating systems. Among the key innovations is the “Visual Intelligence” technology, which allows for object recognition on the screen and provides additional information about them.
Apple also introduced updates for the “Image Playground” app — now, thanks to integration with ChatGPT, users can create images in new styles, including anime, oil painting, and watercolor. Additionally, users can send requests to ChatGPT for generating even more diverse images.
Among other AI-powered features is “Workout Buddy,” a personal trainer that uses voice synthesis to motivate during workouts. The new “Live Translation” mode provides instant text and voice translation during calls. Translation results are displayed as subtitles or voiced in real-time.
iPhone users will gain additional capabilities during phone calls — the “call screening” feature will automatically answer calls from unknown numbers, and “hold assist” can notify when a “live” operator is available during hold time. The “Messages” app will feature the ability to create polls, which the model suggests based on the conversation context. Additionally, “Spotlight” will support contextual suggestions, and the “Shortcuts” app will allow using AI for automatic information summarization.
For developers, Apple has opened access to its own “Foundation Models” system, enabling the implementation of AI features in apps even without an internet connection. Meanwhile, the company announced that there will be no significant updates for the voice assistant Siri this year, with more details on new capabilities to be shared later.