AI's ability to fake video comes on in leaps and bounds

Written by Adrian Pennington

Vienna University of Technology

New full body synthesis AI could be a huge step towards truly convincing deepfake video.

First crudely, and then in more seamless fashion, videos have appeared in which a person’s face has been substituted for another. Such face-off counterfeiting techniques surfaced prominently a couple of years back when celebrity faces were substituted onto those of porn actors. The words and facial gestures of politicians have also been manipulated in this way.

Inevitably, the technology has advanced such that it will soon be possible to translate not just faces but whole bodies onto the videoed movements of others.

Describing the advance in a two-minute YouTube video is Károly Zsolnai-Fehér a research scientist at the Institute of Computer Graphics and Algorithms, at the Vienna University of Technology.

Target videos of people playing tennis or performing chin-ups have been overlaid and effectively replaced by the body shape and faces of others. A machine learning generative adversarial network (GAN) can be used to create fake videos.

Remarkably the algorithm is able to synthesise angles of target subjects that it hasn’t seen before, for instance it was able to correctly guess and add-in details like a belt around the waist despite not being shown a directly corresponding image.

The resulting full body characters can also be put in a virtual environment and animated.

Zsolnai-Fehér admits that the work is raw and experimental with issues with movement, flickering and occlusion giving the trick away.

Anyone looking at this footage can tell in a second if it’s not real but the reason he is so excited is that it’s a big leap to making deepfakes a viable concept.

“It will provide fertile ground for new research to build on,” he says. 

A bit down the line it will work in HD and look significantly better, he predicts, particularly when CGI lighting and illumination techniques are applied.

Target applications are movies, computer games and telepresence but there will be others warning of the dangers of hoax videos. Reddit, Twitter and Pornhub have banned deepfakes, but will their AI’s be sophisticated enough to keep pace with research in this area?

Tags: Technology


Related Articles

24 May, 2020

Sensors need better technology, not more resolution


The Sensor of the Future

Replay: This was first published in 2013, but the discussion about sensor technology is as relevant as ever. Just how can...

Read Story

27 April, 2020

Maxon Cinema 4D S22 first release from the new subscription model

Maxon has updated Cinema 4D, the company's acclaimed VFX, 3D modelling, animation and rendering software, to version S22. This is the first release...

Read Story

27 April, 2020

LaCie Rugged drives are the perfect storage you need when going gets really tough [Sponsored]

There can't be many more extreme environments to be in than the Arctic tundra during a full white out blizzard. This is the sort of environment that...

Read Story