[From Gizmag, where the story includes additional images and a 4:50 minute video; a second, shorter video is available on YouTube]
[Image: Face cloning: Steps in modeling the digital face and the final result in silicone (Image: Disney)]
Disney develops “face cloning” technique for animatronics
By David Szondy
August 15, 2012
Facial cloning sounds rather alarming, but its purpose is very straightforward. Basically, it’s a way of scanning a person’s face in 3D and then using that information to design and fabricate an artificial skin that will move much more realistically – not just in general, but as a close imitation of the original person right down to the wrinkles made while laughing.
The process uses scanning and digital processing techniques already used in the creation of CGI characters. This isn’t surprising, since animatronics and digital animation both have the same goal of creating realistic characters. However, animatronics is different because it uses soft materials fixed to a rigid skeleton that moves the “skin” around it. Over the past fifty years, there’s been a lot of success in creating humanoid robots, but the results have not been as realistic as desired. Worse, the method for designing and constructing animatronic characters are expensive and labor intensive. The Disney team’s goal was to produce a single skin that can reproduce the vast range of human expressions and to automate that process as much as possible.
The process they developed starts with using motion capture technology to scan a person’s head while the subject runs through a “performance” of various facial expressions. The resulting 3D scan is then used to produce a digital “mesh” – a sort of map of the face. This is used to design what the team called an optimized model of the robot head. This model defines the robot’s range of movements and locates the optimum points to attach the artificial skin.
The model also allows the researchers to select the best composition of skin. Disney isn’t aiming to reproduce many properties of real skin because its goals are output based. In other words, the key objective is that the robot looks right. This means that Disney can use silicone rubber skin instead of more realistic alternatives that may behave more like the real thing.
That said, the skin isn’t just a flat piece of silicone. It has different thicknesses at different places to help it move and deform realistically. The digital model guides how the thickness of the skin is laid out and how it should attach to the robot head. It also shows how the head should move to minimize stretching and to make sure the skin only stretches along the thickest parts of the skin.
Once the head and skin have been designed, a 3D mold is made into which liquid silicone is injected. Once the skin cures and is attached to the motorized metal and plastic skull, the result is a realistic animatronic robot head. The only obvious difference to the casual eye is that the head is slightly larger than the original person’s in order to make up for the limitations of the robot’s movements.
In the future, the team hopes to give the skin more flexibility and introduce a multi-layered skin to provide more control over its movements.
—
Source: Disney Research