JAN 25, 2018 08:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
SEP 15, 2019
Plants & Animals
SEP 15, 2019
Everything You Need to Know About a Turtle's Shell
One of the most telltale features of a turtle is its protective shell, and regardless of the species, most turtle shells are discernably similar. Despite w...
SEP 15, 2019
Clinical & Molecular DX
SEP 15, 2019
Difficulties With Diagnosing Lyme Disease
Now found in 65 countries worldwide, Lyme disease is the fastest-growing vector-borne illness in the United States. Recent estimates suggest approximately ...
SEP 15, 2019
Plants & Animals
SEP 15, 2019
Watch This Dive Team Collect a Blood Sample From a Captive Whale Shark
Getting a blood sample from a massive whale shark can be particularly challenging and would typically require administering an anesthetic to put the animal...
SEP 15, 2019
Plants & Animals
SEP 15, 2019
Watch a Baby Kangaroo Take its First Hops
When Kangaroos are first born, the bones and muscles in their legs aren’t strong enough for them to stand on their own. This is why baby kangaroos re...
SEP 15, 2019
Space & Astronomy
SEP 15, 2019
Watch SpaceX Fly its Starhopper Prototype 150 Meters in the Air
SpaceX conducted another test flight of its Starhopper prototype starship on Tuesday, this time flying it more than 150 meters in the air. Tuesday’s...
SEP 15, 2019
Chemistry & Physics
SEP 15, 2019
What is Photoacoustic Imaging?
In the last decade, photoacoustic tomography has slowly emerged as a versatile, radiation-free imaging modality that bears great potentials for basic resea...
Loading Comments...