3D geometry reconstruction from a stereoscopic video sequence

Abstract

The aim of this work is to propose a method for recovering the 3D geometry of a video sequence taken from a pair of stereo cameras. The cameras are rigidly situated in a fixed position and there are some objects which are moving in front of them. Our method estimates the displacements of objects and the 3D structure of the scene. We establish a temporal constraint that relates the computation of the optical flow and the estimation of disparity maps. We use an energy minimisation approach that yields a system of partial differential equations (PDE) which is solved by means of a gradient descent technique.