JAN 25, 2018 08:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers
3 1 146

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
JUN 04, 2018
Videos
JUN 04, 2018
What is the South Atlantic Anomaly?
As satellites orbit the Earth, they must be careful to shut down while passing through particular areas. One of such areas is the South Atlantic Anomaly, w
JUL 02, 2018
Videos
JUL 02, 2018
Veterans, PTSD, and Fireworks: What to Know
It’s almost Independence Day and while there will be fireworks displays, sparklers and other pyrotechnics for the holiday, what many people don&rsquo
JUL 04, 2018
Videos
JUL 04, 2018
How Did Viruses Originate?
There is still a debate about whether or not viruses are a form of life, and we really don't know where they came from.
JUL 05, 2018
Videos
JUL 05, 2018
Can Food Be Prescribed?
Hippocrates, the father of medicine was famous for saying, "Let food be thy medicine and medicine be thy food” and what he meant was that eating
JUL 09, 2018
Videos
JUL 09, 2018
How Spiders Use Electricity To Fly
Spider rains, or ballooning spiders, are a natural phenomenon believed by scientists to be caused by the silken threads of these unique insects that genera
JUL 11, 2018
Videos
JUL 11, 2018
College Football Player Who Committed Suicide Had CTE
Chronic Traumatic Encephalopathy (CTE) is the talk of professional sports. From NFL players to ice hockey veterans, rugby teams, and soccer organizations,
Loading Comments...