Data Driven 3D Face Tracking Based on a Facial Deformation Model (Unknown language)

in Vision, Modeling & Visualization ; 9-16
Vision, Modeling & Visualization

We introduce a new markerless 3D face tracking approach for 2D video streams captured by a single consumer grade camera. Our approach is based on tracking 2D features in the video and matching them with the projection of the corresponding feature points of a deformable 3D model. By this we estimate the initial shape and pose of the face. To make the tracking and reconstruction more robust we add a smoothness prior for pose changes as well as for deformations of the faces. Our major contribution lies in the formulation of the smooth deformation prior which we derive from a large database of previously captured facial animations showing different (dynamic) facial expressions of a fairly large number of subjects. We split these animation sequences into snippets of fixed length which we use to predict the facial motion based on previous frames. In order to keep the deformation model compact and independent from the individual physiognomy, we represent it by deformation gradients (instead of vertex positions) and apply a principal component analysis in deformation gradient space to extract the major modes of facial deformation. Since the facial deformation is optimized during tracking, it is particularly easy to apply them to other physiognomies and thereby re-target the facial expressions. We demonstrate the effectiveness of our technique on a number of examples.

How to get this document?
Commercial Copyright fee: €14.50 Basic fee: €4.00 Total price: €18.50
Academic Copyright fee: €4.50 Basic fee: €2.00 Total price: €6.50

Document information

Table of contents conference proceedings

The table of contents of the conference proceedings is generated automatically, so it can be incomplete, although all articles are available in the TIB.

Accurate Face Reconstruction through Anisotropic Fitting and Eye Correction
Achenbach, Jascha / Zell, Eduard / Botsch, Mario | 2015
Data Driven 3D Face Tracking Based on a Facial Deformation Model
Sibbing, Dominik / Kobbelt, Leif | 2015
Simple, Robust, Constant-Time Bounds on Surface Geodesic Distances using Point Landmarks
Burghard, Oliver / Klein, Reinhard | 2015
Point-wise Map Recovery and Refinement from Functional Correspondence
Rodolà, Emanuele / Moeller, Michael / Cremers, Daniel | 2015
Temporal Coherence Predictor for Time Varying Volume Data Based on Perceptual Functions
Noonan, Tom / Campoalegre, Lazaro / Dingliana, John | 2015
Hierarchical Hashing for Pattern Search in 3D Vector Fields
Wang, Zhongjie / Seidel, Hans-Peter / Weinkauf, Tino | 2015
Interactive GPU-based Visualization of Scalar Data with Gaussian Distributed Uncertainty
Schlegel, Steven / Goldau, Mathias / Scheuermann, Gerik | 2015
A Taxonomy of Integration Techniques for Spatial and Non-Spatial Visualizations
Sorger, Johannes / Ortner, Thomas / Piringer, Harald / Hesina, Gerd / Gröller, Eduard | 2015
Vector-to-Closest-Point Octree for Surface Ray-Casting
Demir, Ismail / Westermann, Rüdiger | 2015
Level-of-Detail for Production-Scale Path Tracing
Prus, Magdalena / Eisenacher, Christian / Stamminger, Marc | 2015
The Bounced Z-buffer for Indirect Visibility
Nalbach, Oliver / Ritschel, Tobias / Seidel, Hans-Peter | 2015
A Convex Clustering-based Regularizer for Image Segmentation
Hell, Benjamin / Magnor, Marcus | 2015
Temporally Consistent Wide Baseline Facial Performance Capture via Image Warping
Kettern, Markus / Hilsmann, Anna / Eisert, Peter | 2015
Efficient GPU Based Sampling for Scene-Space Video Processing
Klose, Felix / Wang, Oliver / Bazin, Jean-Charles / Magnor, Marcus / Sorkine-Hornung, Alexander | 2015
Rotoscoping on Stereoscopic Images and Videos
Bukenberger, Dennis R. / Schwarz, Katharina / Groh, Fabian / Lensch, Hendrik P. A. | 2015
Tongue S(t)imulator - A Comprehensive Parametrized Pose Model for Speech Therapy
Haraké, Laura / Bełtkiewicz, Dorota / Lochmann, Gerrit | 2015
Simulation of Water Condensation based on a Thermodynamic Approach
Tillmann, Sebastian-T. / Bohn, Christian-A. | 2015
Variational Separation of Light Field Layers
Johannsen, Ole / Sulc, Antonin / Goldluecke, Bastian | 2015
Extrapolating Large-Scale Material BTFs under Cross-Device Constraints
Steinhausen, Heinz Christian / Brok, Dennis den / Hullin, Matthias B. / Klein, Reinhard | 2015
Fast Multiplexed Acquisition of High-dynamic-range Material Appearance
Brok, Dennis den / Steinhausen, Heinz Christian / Klein, Reinhard | 2015
Light Field Imaging through Household Optics
Wender, Alexander / Iseringhausen, Julian / Goldluecke, Bastian / Fuchs, Martin / Hullin, Matthias B. | 2015

Similar titles