A team of digital designers have created “living makeup,” a combination of CGI and face-tracking that allows the system to project computer graphics right onto the model’s face—and keep up, as the model moves. As you can see in the video, it’s a stunning demonstration:
OMOTE / REAL-TIME FACE TRACKING & PROJECTION MAPPING. from something wonderful on Vimeo.
The “electronic makeup” was created by a team of CGI experts, make-up artists, and digital designers, led by Nobumichi Asai. As you can see from the video, the combination of projection mapping and real-time facial tracking goes a little further than traditional makeup can. Asai, familiar with projection mapping through his work with Subaru and other top companies, used this system—known as Omote—to create unreal patterns on the model’s features.
As the video appears to show, Omote starts with an initial scan of the subject’s features, where the contours of the model’s face are apparently mapped. After this initial mapping, CGI graphics are overlaid, and then manipulated in real-time to follow the model’s movements.
As most projection systems have stationary subjects, the amount of movement the Omote system can handle is still up for discussion. While it can be used when the model is sitting, it might not be able to handle a walking subject.
Source Gizmodo