How to use Visual Intelligence on iPhone »

Use visual intelligence to quickly learn more about what’s in front of you, whether in your physical surroundings or on your iPhone screen.

From Apple Support:

Use visual intelligence to quickly learn more about what’s in front of you, whether in your physical surroundings or on your iPhone screen.

To learn more about your physical surroundings using your iPhone camera on models that have the Camera Control, just click and hold it to do things like look up details about a restaurant or business; have text translated, summarized, or read aloud; identify plants and animals; search visually for objects around you; ask questions; and more. […You can also] access visual intelligence by customizing the Action button or Lock Screen, or opening Control Center. See Alternate options to using the Camera Control.

To learn more about the content on your iPhone screen across your apps, simply press the same buttons you use to take a screenshot. You can search visually, ask questions, and take action, like turning a flyer or invite into a calendar event.

I’ve been learning more about now that developers can integrate their app with Visual Intelligence.

View the full piece on the Apple Support site and read more about the Developer documentation.

 

Posts You Might Like

25 Apple Vision Pro Secrets & Hidden Features from Andru Edwards
Creator Andru Edwards has a great 13-minute video walking you through helpful tips for Apple Vision Pro – bet there’s at least one you didn’t know about.
You Can Scroll The Elgato Prompter With The Stream Deck + »
When you combine the dials on the Stream Deck + with the Prompter from Elgato, you get an extra special set of controls.
How to transfer data from Google Maps to Apple Maps »
If you're looking to move from Google Maps to Apple Maps, this shortcut makes it easy to process your locations one-by-one.
iOS 17.2 Includes 50 New URL Schemes You Can Use in Shortcuts on Your iPhone »
Justin Myers of GadgetHacks covers deep links for Journal, Contact Key Verification, and Accessibility settings new in iOS 17.2