Apple's Vision Pro Will See the World With AI Soon

The latest VisionOS updates give Apple's headset a few things that future glasses could also add.

Scott Stein Editor at Large

I started with CNET reviewing laptops in 2009. Now I explore wearable tech, VR/AR, tablets, gaming and future/emerging trends in our changing world. Other obsessions include magic, immersive theater, puzzles, board games, cooking, improv and the New York Jets. My background includes an MFA in theater which I apply to thinking about immersive experiences of the future.

Expertise VR and AR | Gaming | Metaverse technologies | Wearable tech | Tablets Credentials

Nearly 20 years writing about tech, and over a decade reviewing wearable tech, VR, and AR products and apps

Apple's Vision Pro hardware, last updated in the fall with an M5 chip, is getting new software upgrades with the latest version of VisionOS announced at WWDC. A big one is Visual Intelligence, camera-aware AI, at long last.

The Vision-focused AI tools are what interest me most. They're part of Apple's new Siri-focused AI updates announced at this year's WWDC conference. Asking Siri will allow you to see things on apps you have open on VisionOS, but Siri will also be able to recognize things in the room.

This is the same type of camera-aware AI that Google and Samsung already have in the Samsung Galaxy XR headset, which arrived last fall.

Apple also announced a tool that converts panoramic photos in 3D spatial scenes, which can become new immersive backgrounds in VisionOS.

While many people have reported that the Vision Pro's life is ending in the face of a shift to smart glasses in the next few years, the Vision Pro's hardware can clearly do things no glasses could dream of anytime soon. I've been waiting for Apple's spatial computer to make the most of its processing power, sensors and high price tag. Maybe these updates will help.

This is a developing story, we'll update as more is announced.

Laptops

Desktops & Monitors

Computer Accessories

Photography

Tablets & E-Readers

3D Printers

SCOTT STEIN

Editor at Large

I started with CNET reviewing laptops in 2009. Now I explore wearable tech, VR/AR, tablets, gaming and future/emerging trends in our changing world. Other obsessions include magic, immersive theater, puzzles, board games, cooking, improv and the New York Jets. My background includes an MFA in theater which I apply to thinking about immersive experiences of the future. See full bio