Back
EMOCA: Emotion Driven Monocular Face Capture and Animation
EMOCA takes a single in-the-wild image as input and reconstructs a 3D face with sufficient facial expression detail to convey the emotional state of the input image. EMOCA advances the state-of-the-art monocular face reconstruction in-the-wild, putting emphasis on accurate capture of emotional content. <p>The repository provides:</p> <ul> <li>An approach to reconstruct animatable 3D faces from an in-the-wild images, that is capable of recovering facial expressions that convey the correct emotional state.</li> <li>A novel perceptual emotion-consistency loss that rewards the accuracy of the reconstructed emotion.</li> <li>A 3D geometry-based framework for in-the-wild emotion recognition, with comparable performance to current state-of-the-art image-based methods.</li> <li>Different pre-trained image-based emotion recognition networks.</li> </ul>