Notably, instead of just shifting between the “Photos” and “Videos” tabs, there’s now a new option: Siri AI.
Previously, to trigger Siri’s “Visual Intelligence” feature, you had to press the camera control button. When you press it, Siri can see where you’re pointing the iPhone camera and provide contextual assistance – like Google Lens – such as adding dates from a concert poster to your calendar or helping identify a plant. Now that it’s apparently included in the Camera app, Apple hopes to make the feature easier to find and use.
This type of visual AI assistance is a key feature of smart glasses and AI pendants with cameras, allowing users to access AI assistance with a single tap without having to explain or type anything as the cameras do the work. Apple is reportedly working on smart glasses as well as AirPods with cameras embedded in the stem, so while this computer vision technology is making its debut on the iPhone, it may also make its way to other Apple products later on.
Then there are some artificial intelligence features coming to the Photos app that can change the final look of your photos. These include: Clean Up, Extend and Spatial Reframe. Clean Up is already present, which allows you to remove unwanted objects from your photos. Now, it works even better thanks to Apple’s updated AI Foundation Model. This will do a better job of realistically filling in the image after removing any objects.
Detail is for those moments when you want to add a little more space to your image. Using generative AI, if you’re too close to the edge of the photo and want a little breathing room, Extend can generate imagery based on what it thinks is in the shot. Google has also added almost similar features to its Pixel phones over the years.
Finally, Apple’s “spatial reframing” feature can change the perspective of a photo. You can slightly change the perspective of the photo by dragging your finger over the image. Apple also uses generative AI here to fill some shortcomings from a new perspective. It is not yet clear whether this feature is limited to select iPhones or not.
This is a developing story. Check back later for more updates.
<a href