How to use Visual Intelligence on iPhone »

Use visual intelligence to quickly learn more about what’s in front of you, whether in your physical surroundings or on your iPhone screen.

From Apple Support:

Use visual intelligence to quickly learn more about what’s in front of you, whether in your physical surroundings or on your iPhone screen.

To learn more about your physical surroundings using your iPhone camera on models that have the Camera Control, just click and hold it to do things like look up details about a restaurant or business; have text translated, summarized, or read aloud; identify plants and animals; search visually for objects around you; ask questions; and more. […You can also] access visual intelligence by customizing the Action button or Lock Screen, or opening Control Center. See Alternate options to using the Camera Control.

To learn more about the content on your iPhone screen across your apps, simply press the same buttons you use to take a screenshot. You can search visually, ask questions, and take action, like turning a flyer or invite into a calendar event.

I’ve been learning more about now that developers can integrate their app with Visual Intelligence.

View the full piece on the Apple Support site and read more about the Developer documentation.

 

Posts You Might Like

Shortcut to search replies and quotes for a tweet »
Search through a given tweet's Replies and Quotes using this shortcut from Twitter user @colleidoscope.
Matt Galligan’s Shared Shortcuts on Notion
Matt Galligan has published a collection of Shortcuts on Notion – including a handy one for dialing in to meetings. Seems like a great way to share shortcut if you don’t have a website.
Bike: Automate with Shortcuts »
Bike Outliner for Mac has added 14 new actions to Shortcuts to automate your outlines, including a video tutorial.
Automating Devices with Elgato Stream Deck via Apple Shortcuts »
Daniel Raffel shares his experience setting up HomeKit devices as a single-press toggle in Shortcuts – so he can control his lights via Stream Deck.