JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
NOV 06, 2020
Space & Astronomy
300 Million Planets in the Milky Way May Be Habitable
NOV 06, 2020
300 Million Planets in the Milky Way May Be Habitable
Researchers have found that there could be at least 300 million habitable worlds in the Milky Way galaxy. This could mea ...
NOV 12, 2020
Plants & Animals
Noise Pollution Threatens Norway's Orcas
NOV 12, 2020
Noise Pollution Threatens Norway's Orcas
Orca pods heavily depend on vocal communication for survival. Their unique ability to communicate with other pod members ...
APR 09, 2021
Plants & Animals
Speedbumps Reduce Endangered Red Colobus Deaths
APR 09, 2021
Speedbumps Reduce Endangered Red Colobus Deaths
The endangered Zanzibar red colobus is a rare primate that lives only in the Zanzibar archipelago. New research from Ban ...
MAY 13, 2021
Plants & Animals
Brood X Cicadas Are Here - Help Scientists Track Them
MAY 13, 2021
Brood X Cicadas Are Here - Help Scientists Track Them
Download this smartphone app to help document one of North America's natural wonders.
MAY 15, 2021
Space & Astronomy
Scientists Find Liquid Water Inside Meteorite
MAY 15, 2021
Scientists Find Liquid Water Inside Meteorite
Scientists know that water is abundant in the solar system- existing in the rings of Saturn and on its moon, Enceladus. ...
MAY 21, 2021
Space & Astronomy
Alien Radioactive Element Discovered on Earth for First Time
MAY 21, 2021
Alien Radioactive Element Discovered on Earth for First Time
  Researchers from Australian National University have discovered the first ever extraterrestrial radioactive isoto ...
Loading Comments...