JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
JAN 25, 2020
Plants & Animals
JAN 25, 2020
A Hamster's Stuffable Cheeks Can be Convenient, But Not in This Case
Hamsters are just one of several rodents that can stuff their mouths full of food and other goodies and carry it long distances to deposit somewhere else,...
JAN 25, 2020
Space & Astronomy
JAN 25, 2020
How Close is SpaceX to Sending Humans to Space?
NASA is one of the world’s most capable space agencies, but a crippling budget prevents it from developing a new space vehicle of its own. Instead, N...
JAN 25, 2020
Plants & Animals
JAN 25, 2020
Every River Leap a Proboscis Monkey Makes Could be its Last
Leaves are one of the most essential components of a proboscis monkey’s diet, and in some cases, getting to the tastiest leaves means taking an enorm...
JAN 25, 2020
Plants & Animals
JAN 25, 2020
Baby Penguins Are Often Bullied to Death by Adults
Most people envision penguins as fun, happy-go-lucky birds residing in the Earth’s chilly polar regions, but that’s not always the case. In fac...
JAN 25, 2020
Earth & The Environment
JAN 25, 2020
Scientists Assess GHG Emissions Related to Palm Oil Land Conversion
Palm oil production remains problematic in several ways, and a new study from researchers at the University of Nottingham has quantified one of these probl...
JAN 25, 2020
Plants & Animals
JAN 25, 2020
After Hibernation, These Grizzlies Turn to Clams for Nourishment
Grizzly bears spend up to seven Wintery months hibernating, and in that time, they can lose a substantial amount of their body weight. While surrounding ma...
Loading Comments...