Zum Hauptinhalt springen
Apple

Visual Intelligence is Dead: Long Live Siri Camera Mode

Beyond Recognition: Since 2024, Visual Intelligence was Apple’s answer to Google Lens. In iOS 27, it’s being swallowed by the assistant.

The Peer Mode Architecture #

Inside the Camera app, you will now see Siri as a mode alongside Photo and Video. Instead of just “recognizing” an object, the camera now acts as a live feed for the LLM.

Real-time Troubleshooting #

The killer app for Siri Camera Mode is Live Troubleshooting. Point your camera at a broken car engine or a complex IKEA manual, and ask: “How do I fix this?” Siri will use Screen Awareness (or rather, Lens Awareness) to overlay 3D instructions directly on the viewfinder using the new ARKit 10 hooks.

Third-Party Routing #

Because of the Extensions API, you can route the camera feed to specialized AIs.

  • Point at a math problem: Route to WolframAlpha via Siri.
  • Point at a plant: Route to a specialized botanical AI extension.

Siri Camera Mode is expected to be the centerpiece of the upcoming HomePad and Apple Glasses (2027).