by Fyffe, Graham
Abstract:
We propose an extension to multi-view face capture that reconstructs high quality facial hair automatically. Multi-view stereo is well known for producing high quality smooth surfaces and meshes, but fails on fine structure such as hair. We exploit this failure, and automatically detect the hairs on a face by careful analysis of the pixel reconstruction error of the multi-view stereo result. Central to our work is a novel stereo matching cost function, which we call equalized cross correlation, that properly accounts for both camera sensor noise and pixel sampling variance. In contrast to previous works that treat hair modeling as a synthesis problem based on image cues, we reconstruct facial hair to explain the same highresolution input photographs used for face reconstruction, producing a result with higher fidelity to the input photographs.
Reference:
High Fidelity Facial Hair Capture (Fyffe, Graham), Technical report ICT TR 02 2012, University of Southern California Institute for Creative Technologies, 2012.
Bibtex Entry:
@techreport{fyffe_high_2012-1,
address = {Playa Vista, CA},
type = {{ICT} {Technical} {Report}},
title = {High {Fidelity} {Facial} {Hair} {Capture}},
url = {http://ict.usc.edu/pubs/High%20Fidelity%20Facial%20Hair%20Capture-TR.pdf},
abstract = {We propose an extension to multi-view face capture that reconstructs high quality facial hair automatically. Multi-view stereo is well known for producing high quality smooth surfaces and meshes, but fails on fine structure such as hair. We exploit this failure, and automatically detect the hairs on a face by careful analysis of the pixel reconstruction error of the multi-view stereo result. Central to our work is a novel stereo matching cost function, which we call equalized cross correlation, that properly accounts for both camera sensor noise and pixel sampling variance. In contrast to previous works that treat hair modeling as a synthesis problem based on image cues, we reconstruct facial hair to explain the same highresolution input photographs used for face reconstruction, producing a result with higher fidelity to the input photographs.},
number = {ICT TR 02 2012},
institution = {University of Southern California Institute for Creative Technologies},
author = {Fyffe, Graham},
month = aug,
year = {2012},
keywords = {Graphics}
}