|Yosuke Bando||Bing-Yu Chen||Tomoyuki Nishita|
The University of Tokyo
|National Taiwan University||The University of Tokyo|
|Lens with RGB filters||Captured image||Extracted depth map||Extracted alpha matte|
|From a single photograph captured through a color-filtered aperture, its depth map and alpha matte can be extracted automatically.|
For a scene point at the focused depth,|
light rays in the Red band and those in the Green band (the Blue band is omitted for 2D illustration)
converge to the same point on the image sensor.
For a scene point off the focused depth,|
light rays in the two bands reach different positions on the image sensor,
resulting in a color shift (resulting from geometric optics, not from chromatic aberration).
As a result, a scene point farther than the focused depth is observed with
We exploit these depth-dependent color misalignment cues for depth and matte extraction.