Face tracking and pose estimation with automatic three-dimensional model construction

Jiménez, Pedro; Nuevo, Jesús; Bergasa, Luis M.; Sotelo, Miguel Ángel
Year: 2009
Type of Publication: Article
Keywords: 3D pose estimation; automatic three-dimensional model construction; cameras; car; driver monitoring system; face tracking; image sequences; stereo vision; cameras; face recognition; image sequences; pose estimation; stereo image processing; visual perception;
Journal: Computer Vision, IET
Volume: 3
Number: 2
Pages: 93 -102
Month: june
ISSN: 1751-9632
DOI: 10.1049/iet-cvi.2008.0057
A method for robustly tracking and estimating the face pose of a person using stereo vision is presented. The method is invariant to identity and does not require previous training. A face model is automatically initialised and constructed online: a fixed point distribution is superposed over the face when it is frontal to the cameras, and several appropriate points close to those locations are chosen for tracking. Using the stereo correspondence of the cameras, the three-dimensional (3D) coordinates of these points are extracted, and the 3D model is created. The 2D projections of the model points are tracked separately on the left and right images using SMAT. RANSAC and POSIT are used for 3D pose estimation. Head rotations up to plusmn45deg are correctly estimated. The approach runs in real time. The purpose of this method is to serve as the basis of a driver monitoring system, and has been tested on sequences recorded in a moving car.
Hits: 3402