JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
JAN 15, 2020
Health & Medicine
JAN 15, 2020
The "Normal" Body Temperature Has Decreased
Did you know that the standard human body temperature of 98.6 degrees Fahrenheit was established in 1868? A few modern studies have called this figure into...
JAN 16, 2020
Chemistry & Physics
JAN 16, 2020
Self-healable Sweat Sensor Fears No Wear and Tear
Sweat can provide a lot of information about a person's health. One of the current trends in wearable technology is to incorporate sweat sensing mechan...
JAN 22, 2020
Space & Astronomy
JAN 22, 2020
Astronomers Have Found the Farthest Galaxy Group
An international team of astronomers funded in part by NASA has found the farthest galaxy group identified to date.  The trio of galaxies, called EGS7...
FEB 24, 2020
Plants & Animals
FEB 24, 2020
These Pelicans Aren't After Fish
Pelicans are seabirds renowned for their unique bills, which encompass a rather discernible throat pouch that makes capturing and swallowing fish a cinch....
MAR 19, 2020
Earth & The Environment
MAR 19, 2020
What's the Ocean's Oxygen Budget?
Have you heard the statement, “every other breath you take comes from the ocean?” Oxygen-producing phytoplankton are just one part of the oxyge...
MAR 25, 2020
MAR 25, 2020
Exclusive Breastfeeding Promotes Moms Heart Health
New mothers face a vast number of choices as they welcome the new child into the world. One such choice is how to feed their infant. Options include formul...
Loading Comments...