JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
AUG 27, 2020
Plants & Animals
Polar Bear Populations Could Collapse by 2100
AUG 27, 2020
Polar Bear Populations Could Collapse by 2100
A new study reports that polar bear populations could collapse in the next 80 years if greenhouse gas emissions remain a ...
SEP 16, 2020
Space & Astronomy
Something Unexpected Happens on Mars During Solar Eclipse
SEP 16, 2020
Something Unexpected Happens on Mars During Solar Eclipse
From data captured by NASA's InSight Mars Lander, researchers in Switzerland have found that Mars behaves differentl ...
OCT 14, 2020
Chemistry & Physics
The CRISPR Nobel Win from Different Angles
OCT 14, 2020
The CRISPR Nobel Win from Different Angles
CRISPR-Cas9 was THE buzz word in the world of science after the Nobel Chemistry Prize announcement last week. But depend ...
NOV 07, 2020
Space & Astronomy
Scientists Detect Origin of Fast Radio Burst in Milky Way
NOV 07, 2020
Scientists Detect Origin of Fast Radio Burst in Milky Way
Scientists have identified a burst of cosmic radio waves- intense flashes of radio emission that last just a few millise ...
NOV 12, 2020
Health & Medicine
Measles Cases and Deaths Surge Worldwide
NOV 12, 2020
Measles Cases and Deaths Surge Worldwide
Today, the World Health Organization (WHO) and the U.S. Centers for Disease Control and Prevention (CDC) released a stat ...
MAR 23, 2021
Genetics & Genomics
Implementing Illumina NGS is a lot easier than you think.
MAR 23, 2021
Implementing Illumina NGS is a lot easier than you think.
Dr. John-Sebastian Eden is a Virologist at the Westmead Institute for Medical Research in Sydney, Australia. His group u ...
Loading Comments...