Apple’s ‘Visual Intelligence’ Can Actually See Your Screen Now
The previously camera-only feature can now create events from screenshots or search for objects in pictures.
Last year, Apple introduced Visual Intelligence, which uses your camera to translate text, identify objects, or start searches by pointing your phone at something. But if the thing you want to know about is on your phone instead of in front of it, you've been out of luck. Until today's WWDC announcement, that is.
The new Visual Intelligence update will let users take a screenshot of what's on their phone and perform searches on the image's content. If you're looking at an object, the feature can search to find where you might be able to buy it online. You can also pull up a ChatGPT box to ask questions about what you're looking at.
Perhaps the most useful, Visual Intelligence can suggest calendar events from images you screenshot. So, you can remember all those music festivals, conventions, or shows at your local bar that you find on Instagram. Frankly, this might be the coolest, most helpful AI feature I've seen on any platform in a while.
