An Augmented Reality Pipeline to Create Scenes with Coherent Illumination Using Textured Cuboids
Realistic Augmented Reality; Natural Feature Tracking; Inverse Lighting
Shadows and illumination play an important role when generating a realistic scene in computer graphics. Most of the Augmented Reality (AR) systems track markers placed in a real scene and retrieve their position and orientation to serve as a frame of reference for added computer generated content, thereby producing an augmented scene. Realis- tic depiction of augmented content with coherent visual cues is a desired goal in many AR applications. However, rendering an augmented scene with realist illumination is a complex task. Many existent approaches rely on a non automated pre-processing phase to retrieve illumination parameters from the scene. Other techniques depend specific markers that contain light probes to perform environment lighting estimation. This study aims at designing a method to create AR applications with coherent illumination and shadows, using a textured cuboid marker, that does not requires a training phase to provide lighting information. Such marker may be easily found in common environments: most of product packaging satisfies such characteristics. We propose a way to estimate a directional light configuration using multiple texture tracking to render AR scenes in a realistic fashion.