Raycast Calibration for Augmented Reality HMDs with Off-Axis Reflective Combiners

Qi Guo,Huixuan Tang,Aaron Schmitz,Wenqi Zhang,Yang Lou,Alexander Fix,Steven Lovegrove,Hauke Malte Strasdat
DOI: https://doi.org/10.1109/iccp48838.2020.9105134
2020-01-01
Abstract:Augmented reality overlays virtual objects on the real world. To do so, the head mounted display (HMD) needs to be calibrated to establish a mapping between 3D points in the real world with 2D pixels on display panels. This distortion is a high-dimensional function that also depends on pupil position and varifocal settings. We present Raycast calibration, an efficient approach to geometrically calibrate AR displays with off-axis reflective combiners. Our approach requires a small amount of data to estimate a compact, physics-based, and ray-traceable model of the HMD optics. We apply this technique to automatically calibrate an AR prototype with display, SLAM and eye-tracker, without user in the loop.
What problem does this paper attempt to address?