JAN 25, 2018 08:46 AM PST

AI Tool Turns Video into 3D Augmented Reality Experiences

WRITTEN BY: Julia Travers

An AI tool called Volume (volume.gl) is "reimagining" 2D images in 3D space. It analyzes a flat image, processes the pixels and tries to "predict depth" in order to make a realistic 3D augmented reality (AR) translation. Volume is the result of an artistic collaboration between Or Fleisher and Shirin Anlen. The pair uses a convolutional neural network - a deep learning artificial neural network - to train the AI to carry out this reconstruction.

"Our experiment with Pulp Fiction allows users to step inside one the film's scenes in Augmented Reality, using Apple's ARKit framework [(an AR framework for iPhones and iPads)] on an iPad. This experiment is one of a few we are conducting at the moment, which illustrate the power of being able to reconstruct 3D scenes from 2D images. The possibilities of being able to reconstruct archival and static footage into 3D environments are one of the main motivations behind the development of the tool used to create these experiments called Volume," Fleisher tells The Next Web (thenextweb.com).

Fleisher and Anlen hope to make the tech easily accessible for the general public so that anyone with a tablet, laptop or smartphone can convert their own videos and images into AR form.

While the results are not seamless or perfect yet, it's certainly an inspired and interesting step in the evolution of virtual reality (VR) and AR, and may serve as a window into their future integration into our everyday lives and environments.
About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech and conservation.
You May Also Like
OCT 11, 2018
Videos
OCT 11, 2018
An Inexpensive Kit Teaches Kids About Molecular Biology
Biology is advancing at a rapid pace. Students will be ready for those advances if they can learn about cutting-edge concepts at an early age....
OCT 16, 2018
Videos
OCT 16, 2018
Can the Bacteria That we Carry Give us Special Powers?
The bacteria that we carry in and on our bodies can affect our health and well-being in many ways....
OCT 16, 2018
Health & Medicine
OCT 16, 2018
The Science Behind Whacking Your 'Funny Bone'
If you’ve ever smacked your elbow in just the right way, then you might’ve felt a sensation comparable to pins and needles moving up your arm a...
OCT 20, 2018
Videos
OCT 20, 2018
Understanding how the Immune System is Controlled
Scientists are trying to learn more about a gene, PTPN22, that is especially critical to the immune system....
OCT 31, 2018
Videos
OCT 31, 2018
Why does severe pain cause vomiting?
Feeling nausea or vomiting are known to be common side effects of severe pain. But, why? To answer this question, research was conducted on surgical patien...
NOV 11, 2018
Health & Medicine
NOV 11, 2018
Stop Procrastinating, It's Not Good for You
Procrastination is common, but some people procrastinate much more than others. Those who do it persistently probably exhibit something known as chronic pr...
Loading Comments...