JAN 25, 2018 8:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
AUG 04, 2020
Space & Astronomy
Scientists Develop Interstellar Sunscreen to Block Deadly Rays
AUG 04, 2020
Scientists Develop Interstellar Sunscreen to Block Deadly Rays
Outside of the Earth's magnetic field exist many kinds of dangerous radiation. These include ultraviolet, X-rays, an ...
AUG 20, 2020
Health & Medicine
Studying the World's Deadliest Animal
AUG 20, 2020
Studying the World's Deadliest Animal
Imagine hundreds of mosquitoes feeding on your arm for the sake of research! This is one unique aspect fueling the work ...
SEP 01, 2020
Plants & Animals
Warsaw Zoo Testing CBD to Manage Elephants' Stress
SEP 01, 2020
Warsaw Zoo Testing CBD to Manage Elephants' Stress
Humans use cannabidiol (CBD) for its array of health benefits, and household pets even benefit from CBD treatments in sp ...
SEP 24, 2020
Plants & Animals
High Arctic Polar Bears are Temporarily Benefitting from Climate Change
SEP 24, 2020
High Arctic Polar Bears are Temporarily Benefitting from Climate Change
For the past few decades, polar bears have been harbingers of climate change. However, not every polar bear subpopu ...
NOV 06, 2020
Chemistry & Physics
The Most Powerful X-ray Source On Earth
NOV 06, 2020
The Most Powerful X-ray Source On Earth
Located inside the Sandia National Laboratories in Albuquerque, New Mexico, the Z Pulsed Power Facility (or Z Machine) i ...
DEC 15, 2020
Immunology
The Possibility of Improving an Older Adult's Response to Vaccines
DEC 15, 2020
The Possibility of Improving an Older Adult's Response to Vaccines
A recent study published in the eLife journal examined how they can improve older adults' responses to vaccines ...
Loading Comments...