Is this how video will work in the future?

Written by David Shapton

GoogleQuick Draw game from Google

Here's a game that wonderfully hints at the enormous possibilities of vector video.

I'm a big fan of vector video. It's the idea that instead of pixels, you describe a scene mathematically. There's nothing new about this – that's exactly how the .pdf format works – except that it's an awful lot more involved when there's video concerned, as well as the nontrivial matter of how you convert pixels into vectors.

One of the reasons I think this is so important is because, in a sense, it mirrors the way we perceive things. Nature is not presented to us through the medium of pixels, which are entirely man-made. When you have problems with your vision, you never, ever see pixels or any type of rectangular artefacts. They're just not part of the natural world.

At least part of what we do when we see things is refer to an internal database. The mechanism for doing this is quite suddenly becoming better understood. Essentially, when we perceive an object, we refer the 'data' we receive through our senses to a repository of things that we already know about. If there's a match, then we say we 'know' the thing we're looking at as well.

The part of the brain responsible for this, the Neocortex, works hierarchically. First, it looks at the small details, then builds a 'bigger picture', until finally it understands the whole scene.

It's possible to mimic this process using a Neural Net and these are cropping up everywhere these days, especially on Google (or should I say "Alphabet").

Here's a living example. Have a go at this game. You have to draw a requested object within 20 seconds. The computer tries to guess what it is. It's often successful, but sometimes, with great humility, it fails.

It's well worth a try. It's like listening to your brain talking out loud. And if you think it seems a bit clunky, just imagine what it would be like with 8K video as a source instead of a few badly-drawn lines. And then imagine the guesswork being thousands, if not millions of times better than this. And then imagine all of that being on a chip inside a video camera.

Tags: Technology


Related Articles

24 May, 2020

Sensors need better technology, not more resolution


The Sensor of the Future

Replay: This was first published in 2013, but the discussion about sensor technology is as relevant as ever. Just how can...

Read Story

27 April, 2020

Maxon Cinema 4D S22 first release from the new subscription model

Maxon has updated Cinema 4D, the company's acclaimed VFX, 3D modelling, animation and rendering software, to version S22. This is the first release...

Read Story

27 April, 2020

LaCie Rugged drives are the perfect storage you need when going gets really tough [Sponsored]

There can't be many more extreme environments to be in than the Arctic tundra during a full white out blizzard. This is the sort of environment that...

Read Story