JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
JUL 29, 2020
Chemistry & Physics
Molecular Footloose: Carbon Monoxide Molecules "Square Dance" with Each Other
JUL 29, 2020
Molecular Footloose: Carbon Monoxide Molecules "Square Dance" with Each Other
The act of "dancing" is not limited to humans, as scientists recently discovered. According to a group of Holl ...
AUG 21, 2020
Chemistry & Physics
Earth's Outer Core, in the Middle of a Laboratory
AUG 21, 2020
Earth's Outer Core, in the Middle of a Laboratory
Deep underneath our feet lies Earth's outer core, a fluid layer over two thousand kilometers (1,500 mi) in thickness ...
AUG 28, 2020
Plants & Animals
Will Traps Solve the Invasive Lionfish Problem?
AUG 28, 2020
Will Traps Solve the Invasive Lionfish Problem?
Extravagant and spiny lionfish were once highly sought after by home aquarium hobbyists. These venomous fish are native ...
SEP 17, 2020
Space & Astronomy
What the Sun's New Weather Cycle Means for Earth
SEP 17, 2020
What the Sun's New Weather Cycle Means for Earth
Scientists have confirmed that the sun is nine months into a new solar cycle, and that this 11-year cycle will resemble ...
OCT 07, 2020
Space & Astronomy
Earth-Sized Rogue Planet Found Drifting Through Our Galaxy
OCT 07, 2020
Earth-Sized Rogue Planet Found Drifting Through Our Galaxy
A team of astronomers has found a lone planet the size of Earth drifting through the Milky Way. Known as a ‘rogue ...
OCT 22, 2020
Chemistry & Physics
NASA Looks to Nuclear Fusion for Powering Deep Space Missions
OCT 22, 2020
NASA Looks to Nuclear Fusion for Powering Deep Space Missions
Nuclear fusion is the frontier of energy research, and NASA has a plan to bring this state-of-the-art power source to th ...
Loading Comments...