New tech turns portraits into photo-realistic videos of facial expressions

[The new technology described in this story from PetaPixel represents another expansion of presence illusions in our lives (and toward traversing the uncanny valley) – note the predicted applications for Facebook near the end. To watch many examples of the technology in action see the Supplementary Materials page of the project’s website. –Matthew]

This Tech Can Turn Portraits Into Photo-Realistic Videos of Facial Expressions

Will Nicholls
October 10, 2017

Researchers at Facebook and Tel Aviv University in Israel have teamed up to bring your selfies to “life.” Using a single still photo of a person’s face, their new technology is able to animate it and introduce different expressions.

The study has developed a technique that will “automatically animate” a still portrait, even a painting, creating various emotions that were not present in the original single frame.

Using a “driving video” (a video of someone performing different expressions), the technology replicates the expressions it observes onto the still image it is provided with.

It works by warping areas of the image in a 2-dimensional space, while also adding fine-scale “dynamic details” that make the animation much more realistic. Such details include creases in the skin and wrinkles.

It’s even capable of reproducing “hidden features” (such as teeth) that might be obscured from view in the original photo. These are “transferred” from the driving video.

What use is there for this technology, you may be asking? Well, with Facebook’s involvement, it is quite possible that users will be able to animate their profile picture and cause it to react to stimuli on the social network at some point in the future.

The team has released a 4.5-minute video that outlines the research and what their new technology can achieve.

(via Tel Aviv University via Engadget)

This entry was posted in Presence in the News. Bookmark the permalink. Trackbacks are closed, but you can post a comment.

Post a Comment

Your email is never published nor shared. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>


  • Find Researchers

    Use the links below to find researchers listed alphabetically by the first letter of their last name.

    A | B | C | D | E | F| G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z