JAN 25, 2018 08:46 AM PST
AI Tool Turns Video into 3D Augmented Reality Experiences
WRITTEN BY: Julia Travers
3 1 145

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
JUN 08, 2018
Videos
JUN 08, 2018
The Molecular Machinery of the Cell in Action
Cell division, also referred to as mitosis, is a critical process that keeps us alive. It has now been animated in detail.
JUN 10, 2018
Videos
JUN 10, 2018
Here's Why You Shouldn't Hold Your Pee for Too Long
Do you urinate regularly? Science shows that holding in your urine for extended periods of time imposes adverse health effects on your body. Of course, the
JUN 17, 2018
Videos
JUN 17, 2018
These Are the World's Largest Life Forms
Life forms throughout Earth’s history come in all different shapes and sizes, but have you ever wondered which ones were the largest? Mountain ash tr
JUN 21, 2018
Videos
JUN 21, 2018
The Salmonella Bacterium
Two recent outbreaks of illness were caused by food that was contaminated with Salmonella bacteria.
JUN 27, 2018
Videos
JUN 27, 2018
Will We Ever Achieve Light Speed?
Will humankind ever achieve light speed with a spacecraft? Science fiction movies keep our hopes high, but the reality of things is that it may not be poss
JUL 02, 2018
Technology
JUL 02, 2018
Video: Listen to Satellites With NASA Sound Art
The Orbit Pavilion Delivers Satellite Data as Sound
Loading Comments...