TL;DR:

  • XR headsets collect data that smartphones never could: room maps, eye movement, body posture, and behavioral timing.
  • Gaze data is particularly sensitive — it reveals cognitive load, emotional state, and medical conditions in ways that conventional analytics don’t.
  • Passthrough cameras on standalone headsets create real-world surveillance risks if device security is weak.
  • Platform privacy controls are improving, but defaults aren’t always in your favour — you need to check them.

Your phone knows where you go and what you search for. Your XR headset knows the layout of your home, where you look, how long you hesitate before making a decision, and whether your hands shake. The data profile a headset builds on you is qualitatively different from anything collected before — and most people wearing one haven’t thought much about that.

This isn’t a reason to avoid XR. It’s a reason to understand what’s collected and make informed choices about where you use these devices and what you share.

What XR Headsets Actually Collect

The sensor stack on a modern headset is extensive. Understanding what each sensor captures helps you think clearly about the risk.

Spatial mapping: Devices like Apple Vision Pro and Meta Quest 3 build continuous 3D maps of your environment using outward-facing cameras and depth sensors. That map includes furniture, room dimensions, what’s on your desk, and the layout of your home. Meta’s privacy policy states that spatial data is processed on-device and not sent to Meta servers — but that policy can change, and third-party apps accessing the scene mesh face different rules.

Eye tracking: Vision Pro, Quest Pro, and most enterprise headsets track where your eyes point — not just where you’re looking in an app, but saccades, pupil dilation, blink rate, and fixation patterns. This data is used to drive foveated rendering (the headset renders in high detail where you’re actually looking, saving GPU budget elsewhere), but it’s also uniquely sensitive. Researchers have demonstrated that gaze patterns can predict cognitive states, health conditions including Parkinson’s, ADHD indicators, and emotional responses with significant accuracy. Eye tracking is biometric data in a meaningful sense.

Audio: Outward-facing microphones for passthrough audio and inward-facing mics for voice commands capture ambient sound from your environment. This includes conversations you didn’t intend to share.

Body tracking: Arm, hand, and head pose data builds a behavioral fingerprint over time. Your movement style and timing patterns are individual enough to be re-identifying even without other data.

Passthrough Cameras: The Physical Security Risk

The colour passthrough cameras on Quest 3 and Vision Pro that let you see the real world through the headset are also cameras pointing at your environment, continuously. A poorly secured device or a malicious app with camera permissions could theoretically surveil your physical space.

This is not a theoretical attack — it’s the same risk model as any camera-equipped device. The mitigations are the same too: keep the OS updated, only install apps from reputable sources, review camera permissions carefully before granting them, and treat the headset camera permissions with the same caution you’d apply to a doorbell camera.

For Quest devices, Meta controls the permission model via the operating system. For visionOS, Apple’s permission model requires explicit user consent for apps to access the passthrough camera feed, and ARKit’s room-sensing APIs surface explicit privacy prompts.

Device Security: The Basics Still Apply

A headset is a computer. The standard security hygiene applies:

Device lock: Vision Pro uses Optic ID (iris biometric) by default. Quest headsets support a PIN or pattern lock. Enable whichever is available — a device that falls off your face in a public space shouldn’t be accessible to whoever picks it up.

Account security: Your Apple ID or Meta account is the authentication layer for the device. Both should have strong passwords and multi-factor authentication enabled. If someone compromises your Meta account, they can access your purchase history, device data backups, and potentially app data depending on how developers have implemented cloud sync.

Software updates: Headset operating systems receive security patches on similar cycles to smartphones. Quest updates push automatically by default; visionOS updates are user-initiated. Don’t defer them indefinitely.

Guest mode: Both Vision Pro and Quest offer guest modes that let another person use the device without accessing your account data, purchase history, or personalized settings. If you’re lending the device, use guest mode.

Gaze Data and Third-Party Apps

The stickiest privacy question in XR right now is gaze data access for third-party applications. The platforms handle this differently.

Apple does not expose raw gaze coordinates to third-party apps on visionOS. ARKit provides eye tracking data that confirms a user is looking at a UI element (to drive interaction), but developers cannot access the full gaze stream. This is a deliberate privacy-protective decision.

Meta’s approach has been more permissive historically, though the company has added restrictions over time. The general principle is worth checking in the current privacy policy if this matters to you — policies update.

For enterprise deployments specifically, gaze data access rules may be different under managed device configurations. If you’re using a work-issued headset, ask your IT team what data the MDM profile permits the employer to collect.

Practical Steps

You don’t need to do all of this — pick the ones that match your risk appetite:

  • Review app permissions before installing anything on the headset. Spatial mapping and microphone permissions deserve particular scrutiny.
  • Check your platform’s privacy settings. On Quest: Settings → Privacy. On Vision Pro: Settings → Privacy & Security. The defaults aren’t always the most restrictive option.
  • Don’t use a personal headset for highly sensitive work in environments where the room layout or ambient audio matters (legal discussions, commercially sensitive meetings, home security codes).
  • If you’re in a shared household, consider what the spatial map of your home reveals to the platform operator and act accordingly.
  • Use guest mode when other people use your device.

XR headsets are genuinely useful and the privacy tradeoffs are manageable. But they’re different in kind from what smartphones collect — and that difference is worth understanding before you put one on in your home.