OCT 21, 2019 9:55 PM PDT

Augmented Reality System Gives Smartphone Users an Interactive Experience

WRITTEN BY: Nouran Amin

Researchers have developed a software system that converts cell phones into augmented reality (AR) portals that allows users to place virtual building blocks into real-world backdrops. The systems development stems from a small infrared sensor mounted on the back of a phone. Referred to as ‘Portal-ble’, the AR platform can someday serve as a crucial tool for artists, designers and game developers.

A new augmented reality platform gives smartphone users the capacity to use their hands to manipulate virtual objects on real backgrounds. Credit: Huang Lab / Brown University

"AR is going to be a great new mode of interaction," said Jeff Huang, an assistant professor of computer science at Brown who developed the system with his students. "We wanted to make something that made AR portable so that people could use anywhere without any bulky headsets. We also wanted people to be able to interact with the virtual world in a natural way using their hands."

Current AR apps that place virtual objects into real-world scenes require the users to swipe on the screen.

"Swiping just wasn't a satisfying way of interacting," Huang said. "In the real world, we interact with objects with our hands. We turn doorknobs, pick things up and throw things. So we thought manipulating virtual objects by hand would be much more powerful than swiping. That's what's different about Portal-ble."

The main purpose of Portal-ble is to produce the appropriate resources and feedback materials necessary to allow users to interact with virtual objects.

"It turns out that picking up a virtual object is really hard if you try to apply real-world physics," Huang said. "People try to grab in the wrong place, or they put their fingers through the objects. So we had to observe how people tried to interact with these objects and then make our system able accommodate those tendencies."

Learn more:

"It's a little like what happens when people draw lines in Photoshop," Huang said. "The lines people draw are never perfect, but the program can smooth them out and make them perfectly straight. Those were the kinds of accommodations we were trying to make with these virtual objects."

Source: Brown University

About the Author
  • Nouran earned her BS and MS in Biology at IUPUI and currently shares her love of science by teaching. She enjoys writing on various topics as well including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
DEC 02, 2019
Space & Astronomy
DEC 02, 2019
The Air Force's X-37B Plane Spent 780 Days in Space, But Why?
The United States Air Force regularly conducts top-secret missions and science experiments on behalf of the federal government. One of the military branch&...
DEC 03, 2019
Cancer
DEC 03, 2019
Using deep learning to find the patterns of cancer
Research published recently in the journal Life Science Alliance uses deep learning to analyze genomic data from colorectal tumors to ameliorate diagnosis ...
DEC 06, 2019
Technology
DEC 06, 2019
Controlling the computer with your fingertips?
Would it be considered magic if you can control your computer screen with your fingertips? No, however, it is definitely technology! University of Waterloo...
DEC 17, 2019
Space & Astronomy
DEC 17, 2019
What to Expect From Boeing's Starliner Spacecraft
NASA’s Commercial Crew Program sports two major contenders for sending astronauts to the International Space Station from American soil for the first...
JAN 01, 2020
Chemistry & Physics
JAN 01, 2020
Century-old Bretherton's Bubble Problem Solved
Some of the most common phenomena in life also hide puzzling mysteries.  When you pour water into a glass, many air bubbles would often appear. Becaus...
FEB 15, 2020
Cancer
FEB 15, 2020
New AI tool makes cancer data more efficient
Cancer is everywhere and yet it seems that the more we know about it, the more we have to learn. With almost one and every two people expected to receive a...
Loading Comments...