The traditional approach for projector-based illumination has been to beam a pre-recorded two-dimensional image from a pre-determined location onto a physical object and replace only the visible texture.
Our idea introduces illumination as a basically perpspective 3D projection from a lamp enabling use of rendering with 3D computer graphics
We replace not just textures (i.e. diffuse component)
but present techniques to reproduce virtually any BRDF appearance, i.e.
view independent as well as view dependent effects
We describe a method to align rendered images quickly using well-known computer vision technique
We address the issue of complete illumination by
merging images from multiple projectors
This is useful not just for Shader Lamps but also
for traditional Image-Based Rendering (IBR) applications where multiple
(depth-enhanced) images from different views need to be merged to render
novel views. (The goal usually is to create seamless transitions from texture
provided by one camera to the texture provided by the next camera.)
We show simple extensions to walk-thru in a hybrid room-sized virtual and real environment and a 3D painting system with tracked illumination.