by Wilson, Cyrus A., Alexander, Oleg, Tunwattanapong, Borom, Peers, Pieter, Ghosh, Abhijeet, Busch, Jay, Hartholt, Arno and Debevec, Paul
Abstract:
We present a semi-automatic technique for computing surface correspondences between 3D facial scans in different expressions, such that scan data can be mapped into a common domain for facial animation. The technique can accurately correspond high-resolution scans of widely differing expressions – without requiring intermediate pose sequences – such that they can be used, together with reflectance maps, to create high-quality blendshape-based facial animation. We optimize correspondences through a combination of Image, Shape, and Internal forces, as well as Directable forces to allow a user to interactively guide and refine the solution. Key to our method is a novel representation, called an Active Visage, that balances the advantages of both deformable templates and correspondence computation in a 2D canonical domain. We show that our semi-automatic technique achieves more robust results than automated correspondence alone, and is more precise than is practical with unaided manual input.
Reference:
Facial Cartography: Interactive Scan Correspondence (Wilson, Cyrus A., Alexander, Oleg, Tunwattanapong, Borom, Peers, Pieter, Ghosh, Abhijeet, Busch, Jay, Hartholt, Arno and Debevec, Paul), In ACM/Eurographics Symposium on Computer Animation, 2011.
Bibtex Entry:
@inproceedings{wilson_facial_2011,
title = {Facial {Cartography}: {Interactive} {Scan} {Correspondence}},
url = {http://ict.usc.edu/pubs/Facial%20Cartography-%20Interactive%20Scan%20Correspondence.pdf},
abstract = {We present a semi-automatic technique for computing surface correspondences between 3D facial scans in different expressions, such that scan data can be mapped into a common domain for facial animation. The technique can accurately correspond high-resolution scans of widely differing expressions – without requiring intermediate pose sequences – such that they can be used, together with reflectance maps, to create high-quality blendshape-based facial animation. We optimize correspondences through a combination of Image, Shape, and Internal forces, as well as Directable forces to allow a user to interactively guide and refine the solution. Key to our method is a novel representation, called an Active Visage, that balances the advantages of both deformable templates and correspondence computation in a 2D canonical domain. We show that our semi-automatic technique achieves more robust results than automated correspondence alone, and is more precise than is practical with unaided manual input.},
booktitle = {{ACM}/{Eurographics} {Symposium} on {Computer} {Animation}},
author = {Wilson, Cyrus A. and Alexander, Oleg and Tunwattanapong, Borom and Peers, Pieter and Ghosh, Abhijeet and Busch, Jay and Hartholt, Arno and Debevec, Paul},
month = aug,
year = {2011},
keywords = {Graphics, Virtual Humans}
}