This is... strange: real time face tracking

Written by RedShark News Staff

OmoteReal Time Face Tracking

 This is a strange, possibly creepy, and utterly amazing video

We've become accustomed to the idea of motion capture: you put white dots on an actor's face and body, and these points are mapped on to equivalent parts of a computer generated model.

The moving computer model is essentially a framework that is then "skinned" with the appearance of the character called for in the script. It's a means to realistically animate computer models and the method is getting better all the time.

Here's a variation on the theme, that is impressive as well as being mildly disturbing.

Rather than map the motion capture data onto a computer generated model, the images are projected, in real time, back onto the actor's face.

The computer "knows" the shape and position of the face from the motion capture data, and so can modify the projected images as the actor's position changes.

For this to work, everything has to be precisely aligned. This is not a trivial thing to set up.

But the results are amazing, as you'll see below.

Credits:

PROJECT MEMBERS

NOBUMICHI ASAI (PLANNER / PRODUCER / TECHNICAL PRODUCER - P.I.C.S.)
HIROTO KUWAHARA (ART DIRECTOR & MAKEUP)
PAUL LACROIX (TECHNICAL DIRECTOR / PROGRAMMER - TRANSIT DIGITAL WORKS)
JIN HASEGAWA (CG DESIGNER - SPADE)
TAKASHI ISHIBASHI (CG DESIGNER - SPADE)
AYAKA MOTOYOSHI (PRODUCTION MANAGER - P.I.C.S.)

SPECIAL THANKS

AYA KUMAKURA (PRODUCTION MANAGER)
YOSHIHIRO UENO (PRODUCTION MANAGER - P.I.C.S.)
KOJI KOJIMA(PRODUCER)
KAZUHIRO NAKAMURA (COLORIST - McRAY)
KENJI NAKAZONO (PHOTOGRAPHER - CREATIVE STUDIO WORKS)
KIMIHIRO MORIKAWA (PHOTOGRAPHER - SHOOTING & LIGHTING)
JIN HASEGAWA (SPADE)
RHEA TOR’S INC.
DAN (STYLIST)
K.FURUMOTO (HAIR - &´S MANAGEMENT)
YUKA SEKIMIZU (MODEL - SATORU JAPAN)
HIDEAKI TAKAHASHI (MUSIC - mjuc)
SPICE (OPTITRACK MOTION CAPTURE SENSOR)

CONTACT
nobumichiasai.com

 

Tags: Technology

Comments

Related Articles

24 May, 2020

Sensors need better technology, not more resolution

 

The Sensor of the Future

Replay: This was first published in 2013, but the discussion about sensor technology is as relevant as ever. Just how can...

Read Story

27 April, 2020

Maxon Cinema 4D S22 first release from the new subscription model

Maxon has updated Cinema 4D, the company's acclaimed VFX, 3D modelling, animation and rendering software, to version S22. This is the first release...

Read Story

27 April, 2020

LaCie Rugged drives are the perfect storage you need when going gets really tough [Sponsored]

There can't be many more extreme environments to be in than the Arctic tundra during a full white out blizzard. This is the sort of environment that...

Read Story