JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
APR 28, 2020
Space & Astronomy
NASA's Swift Telescope Measured the Water Loss of This Interstellar Comet
APR 28, 2020
NASA's Swift Telescope Measured the Water Loss of This Interstellar Comet
When the interstellar comet 2l/Borisov made its first appearance in our solar system, astronomers were quick to turn the ...
MAY 01, 2020
Chemistry & Physics
John Conway: the Late Maths Legend and His Game of Life
MAY 01, 2020
John Conway: the Late Maths Legend and His Game of Life
If maths is the only universal language, then John Horton Conway is among the few who can speak it perfectly. Unfortunat ...
MAY 12, 2020
Space & Astronomy
Here's What Would Happen if You Fired a Gun in Outer Space
MAY 12, 2020
Here's What Would Happen if You Fired a Gun in Outer Space
Many of the world’s greatest science fiction films depict massive battles in outer space between starships and eve ...
MAY 22, 2020
Earth & The Environment
Mount St. Helens: 40 Years of Recovery
MAY 22, 2020
Mount St. Helens: 40 Years of Recovery
This week marks the 40th anniversary of the Mount St. Helens volcanic eruption in southwestern Washington. According to ...
JUN 14, 2020
Space & Astronomy
NASA Picks Astrobotic to Deliver VIPER Rover to the Moon
JUN 14, 2020
NASA Picks Astrobotic to Deliver VIPER Rover to the Moon
NASA is no stranger to autonomous rovers. To date, the American space agency has sent four rovers to the Martian surface ...
JUL 07, 2020
Neuroscience
How Blindsight Helps Us Explain Consciousness
JUL 07, 2020
How Blindsight Helps Us Explain Consciousness
Blindsight is the phenomenon in which blind people can interact with their environments even though they can't see i ...
Loading Comments...