JAN 25, 2018 08:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
AUG 14, 2018
Videos
AUG 14, 2018
Meditation and the Corporate World
During a busy work day it’s hard to find the time to shut it all down and take a break, but in some companies, meditation breaks are becoming a way f...
AUG 15, 2018
Space & Astronomy
AUG 15, 2018
Are Ion-Powered Rockets the Way of the Future for Space Exploration?
While chemical burn rockets are the industry standard for launching spacecraft beyond Earth’s atmosphere, the bigger question concerns how we should...
AUG 17, 2018
Videos
AUG 17, 2018
Why do I self-sabotage before a big exam?
Have you ever been so stressed about an exam that you ended up sabotaging yourself? Psychologists use the term "self-handicapping" to refer ...
AUG 19, 2018
Videos
AUG 19, 2018
Here's Why Flat Maps of the World Aren't Drawn to Scale
Whenever you glance at a flat world map, you should take what you see with a grain of salt. One in particular, known as the Mercator projection, distorts t...
SEP 10, 2018
Chemistry & Physics
SEP 10, 2018
Here's How Long it Takes Your Garbage to Decompose
  Humans produce an unbelievable amount of waste, most of which either go on to be recycled or heads to the landfill to decompose. But have you ever w...
SEP 15, 2018
Videos
SEP 15, 2018
Nature's Giant Genomes
We have around three billion base pairs in our genome. There are some organisms with far more....
Loading Comments...