This is... strange: real time face tracking

Written by RedShark News Staff

OmoteReal Time Face Tracking

 This is a strange, possibly creepy, and utterly amazing video

We've become accustomed to the idea of motion capture: you put white dots on an actor's face and body, and these points are mapped on to equivalent parts of a computer generated model.

The moving computer model is essentially a framework that is then "skinned" with the appearance of the character called for in the script. It's a means to realistically animate computer models and the method is getting better all the time.

Here's a variation on the theme, that is impressive as well as being mildly disturbing.

Rather than map the motion capture data onto a computer generated model, the images are projected, in real time, back onto the actor's face.

The computer "knows" the shape and position of the face from the motion capture data, and so can modify the projected images as the actor's position changes.

For this to work, everything has to be precisely aligned. This is not a trivial thing to set up.

But the results are amazing, as you'll see below.

Credits:

PROJECT MEMBERS

NOBUMICHI ASAI (PLANNER / PRODUCER / TECHNICAL PRODUCER - P.I.C.S.)
HIROTO KUWAHARA (ART DIRECTOR & MAKEUP)
PAUL LACROIX (TECHNICAL DIRECTOR / PROGRAMMER - TRANSIT DIGITAL WORKS)
JIN HASEGAWA (CG DESIGNER - SPADE)
TAKASHI ISHIBASHI (CG DESIGNER - SPADE)
AYAKA MOTOYOSHI (PRODUCTION MANAGER - P.I.C.S.)

SPECIAL THANKS

AYA KUMAKURA (PRODUCTION MANAGER)
YOSHIHIRO UENO (PRODUCTION MANAGER - P.I.C.S.)
KOJI KOJIMA(PRODUCER)
KAZUHIRO NAKAMURA (COLORIST - McRAY)
KENJI NAKAZONO (PHOTOGRAPHER - CREATIVE STUDIO WORKS)
KIMIHIRO MORIKAWA (PHOTOGRAPHER - SHOOTING & LIGHTING)
JIN HASEGAWA (SPADE)
RHEA TOR’S INC.
DAN (STYLIST)
K.FURUMOTO (HAIR - &´S MANAGEMENT)
YUKA SEKIMIZU (MODEL - SATORU JAPAN)
HIDEAKI TAKAHASHI (MUSIC - mjuc)
SPICE (OPTITRACK MOTION CAPTURE SENSOR)

CONTACT
nobumichiasai.com

 

Tags: Technology

Comments

Related Articles

31 July, 2020

This is how Netflix is adapting Anime to modern technology

The streaming service brings 4K and HDR to the classic Japanese artform in the latest example of its prototyping production techniques.

Netflix's...

Read Story

30 July, 2020

Gigabyte Aero 17 XA review: A competition beating powerhouse [sponsored]

The Gigabyte Aero 17 XA has some pretty nifty specs on paper. How does it stack up in the real world, and more importantly against the competition?

...

Read Story

30 July, 2020

For all film makers: How to avoid losing your stuff and where to put it

Replay: The technological revolution has created great opportunities for new film-makers everywhere, but has in its wake created a new challenge:...

Read Story