JAN 25, 2018 08:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
DEC 15, 2018
Videos
DEC 15, 2018
The Near Perfect Memory
Hyperthymesia is an extremely rare neuropsychological condition. It is the condition of superior autobiographical memory characterized by the ability to re...
DEC 23, 2018
Videos
DEC 23, 2018
'Miracle Baby' Survives Ebola
An ongoing outbreak of Ebola virus disease has caused a reported 560 likely cases of the disease (512 have been confirmed), with 336 dead so far....
JAN 01, 2019
Cardiology
JAN 01, 2019
Bringing Cardiovascular Care to Rural Communities
We all know that timely access to healthcare is fundamental to good health. Still, rural residents at home and abroad face a multitude of barriers. Today,...
JAN 05, 2019
Cardiology
JAN 05, 2019
Understanding Peripheral Artery Disease
According to the American Heart Association (AHA), peripheral artery disease (PAD) is the narrowing of the arteries in the legs, stomach, arms, and head. S...
JAN 08, 2019
Videos
JAN 08, 2019
How exercise affects your brain
Although there is still so much we have left to learn about the brain, we do already know a lot about it. The brain is the most complex organ in your body,...
JAN 11, 2019
Cardiology
JAN 11, 2019
Quality Sleep Protects The Heart
Research has revealed an association between not getting enough sleep and conditions of the heart such as high blood pressure, heart disease, diabetes, obe...
Loading Comments...