I think a depth map is an integral part of the Lytro photo processing. I may express some discontent about this, so I want to back up and talk about what I think are weaknesses in computing depth maps.
Note that Lytro keeps their depth algorithm
secret, so
I know nothing about Lytro's depth algorithm.
I'll just go over some basics of what I think are the basics of a common algorithm and its problems.
Reconstructing a Scene From Two Cameras
|
Images from two cameras |
Start with a scene with two cameras
(L and R). Each takes an image of the world (this scene has 4 balls with
different shades of gray.) We know where our cameras were and what
direction they were pointed and we want to use the images to figure out
where the balls were. In particular, we want to know their depth.