AI's ability to fake video comes on in leaps and bounds

Written by Adrian Pennington

Vienna University of Technology

New full body synthesis AI could be a huge step towards truly convincing deepfake video.

First crudely, and then in more seamless fashion, videos have appeared in which a person’s face has been substituted for another. Such face-off counterfeiting techniques surfaced prominently a couple of years back when celebrity faces were substituted onto those of porn actors. The words and facial gestures of politicians have also been manipulated in this way.

Inevitably, the technology has advanced such that it will soon be possible to translate not just faces but whole bodies onto the videoed movements of others.

Describing the advance in a two-minute YouTube video is Károly Zsolnai-Fehér a research scientist at the Institute of Computer Graphics and Algorithms, at the Vienna University of Technology.

Target videos of people playing tennis or performing chin-ups have been overlaid and effectively replaced by the body shape and faces of others. A machine learning generative adversarial network (GAN) can be used to create fake videos.

Remarkably the algorithm is able to synthesise angles of target subjects that it hasn’t seen before, for instance it was able to correctly guess and add-in details like a belt around the waist despite not being shown a directly corresponding image.

The resulting full body characters can also be put in a virtual environment and animated.

Zsolnai-Fehér admits that the work is raw and experimental with issues with movement, flickering and occlusion giving the trick away.

Anyone looking at this footage can tell in a second if it’s not real but the reason he is so excited is that it’s a big leap to making deepfakes a viable concept.

“It will provide fertile ground for new research to build on,” he says. 

A bit down the line it will work in HD and look significantly better, he predicts, particularly when CGI lighting and illumination techniques are applied.

Target applications are movies, computer games and telepresence but there will be others warning of the dangers of hoax videos. Reddit, Twitter and Pornhub have banned deepfakes, but will their AI’s be sophisticated enough to keep pace with research in this area?

Tags: Technology


Related Articles

31 July, 2020

This is how Netflix is adapting Anime to modern technology

The streaming service brings 4K and HDR to the classic Japanese artform in the latest example of its prototyping production techniques.


Read Story

30 July, 2020

Gigabyte Aero 17 XA review: A competition beating powerhouse [sponsored]

The Gigabyte Aero 17 XA has some pretty nifty specs on paper. How does it stack up in the real world, and more importantly against the competition?


Read Story

30 July, 2020

For all film makers: How to avoid losing your stuff and where to put it

Replay: The technological revolution has created great opportunities for new film-makers everywhere, but has in its wake created a new challenge:...

Read Story