Apple Vision Pro header display supports visual search function, which can identify items, copy real text, translate, etc.
CTOnews.com June 22 news, Apple Vision Pro head-mounted visionOS operating system includes a feature called "Visual Search," similar to the iPhone and iPad visual lookup function.
This feature allows users to access information about items via headsets, recognize and interact with text in their surroundings, copy and paste printed text from the real world into apps, translate text between 17 languages, and more.
Visual search allows users to manipulate real-world text and documents in visionOS, including contact information, web links, unit conversions, and more. For example, if a printed flyer has a link to a website, users can scan the link with Apple Vision Pro and open the website in Safari. Alternatively, if a recipe needs to be measured in grams and the user needs to measure in ounces, the user can use the headset to convert units. Real-time text translation can be useful when traveling or in other situations where you need to quickly translate text from your surroundings.
Vision Pro headsets can also automatically detect text and documents, similar to how iPhone can detect text in photos and allow users to interact with it. According to CTOnews.com, the visual search feature is found in visionOS, which is currently accessible through the latest Xcode beta, and Apple released the first developer preview of the software earlier today.