Studying Motion Perception in the Real World with Augmented Reality Headsets
Poster Presentation: Sunday, May 18, 2025, 2:45 – 6:45 pm, Pavilion
Session: Motion: Local, higher-order, in-depth
Schedule of Events | Search Abstracts | Symposia | Talk Sessions | Poster Sessions
Anthony LoPrete1 (), Johannes Burge1; 1University of Pennsylvania
Vision research has historically been dominated by experiments presented with flat-panel displays. The recent development of a large number of advanced and commercially available display technologies has widened the scope of possibilities. Here, we present our experimental development efforts on the Magic Leap 2 Augmented Reality (AR) headset. The initial aim is to investigate the Pulfrich effect in the rich visual environment produced by real-world scenes. The Pulfrich effect is a visual illusion wherein an interocular discrepancy in processing speed (commonly introduced with a darkening filter) results in depth misperceptions of moving targets. We have developed and conducted trial-randomized experiments via the Unity game engine. The stimulus is a vertical bar moving laterally (X-motion only) across the observer’s field of view alongside a stationary reference bar with the same physical dimensions. The bars were displayed at maximum luminance (i.e. Unity’s maximum machine-unit values) to minimize light bleed-through from the real 3D scene. Observers are then tasked with judging whether the moving bar was “nearer” or “farther” than the stationary reference. Responses were recorded with the Magic Leap 2 controller. Recorded data was retrieved from the headset using the Magic Leap Hub’s device bridge, and analyzed using Matlab. The psychophysical results are consistent with previous findings. Future development will enable experiments that incorporate the Magic Leap’s ability to graphically render objects consistent with the depth structure of the 3D environment, and manipulate key viewing variables like the visibility of contact points with the ground. Depth percepts in real physical units will be recorded by indicating the perceived distance of the target with the Magic Leap controller. The results of our experiments and development progress suggest that the Magic Leap 2 will be a useful experimental tool for studying the human visual system.
Acknowledgements: This work was supported by the National Eye Institute and the Office of Behavioral and Social Sciences Research, National Institutes of Health Grant R01-EY028571 to J.B. and an Ashton Fellowship from the University of Pennsylvania to A.L.