DEC 03, 2018 02:10 PM PST

Replicating 3D Objects Using Your Smartphone May Soon Be Possible

WRITTEN BY: Nouran Amin

The production of realistic, real-world objects for the virtual environment is a complex and time-consuming process. Nevertheless, a team of investigators created a new approach to replicating physical objects via a point-and-shoot camera with a flash. The approach is demonstrated using a digital camera, the Nikon D7000 and the built-in camera of an Android mobile phone, detailed in the paper, "Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography."

"To faithfully reproduce a real-world object in the VR/AR environment, we need to replicate the 3D geometry and appearance of the object," says Min H. Kim, associate professor of computer science at KAIST in South Korea and lead author of the research. "Traditionally, this has been either done manually by 3D artists, which is a labor-intensive task, or by using specialized, expensive hardware. Our method is straightforward, cheaper and efficient, and reproduces realistic 3D objects by just taking photos from a single camera with a built-in flash."

Current approaches for the acquisition of physical objects require special hardware setups needed for geometry and appearance modeling of the intended object. These setups might consist of a 3D laser scanner or multiple cameras. However, the developed novel approach greatly contrasts current methods by only requiring a single camera for the high-quality outputs.

“Novel, practical method that enables the capture of spatially-varying BRDFs from unstructured flash photographs. Image (a) shows the acquisition setup, while (b) - (d) show results of the reconstructions.”-ScienceDaily

Credit: Courtesy, ACM SIGGRAPH Asia 2018

"Many traditional methods using a single camera can capture only the 3D geometry of objects, but not the complex reflectance of real-world objects, given by the SVBRDF," notes Kim. SVBRDF, which stands for spatially-varying bidirectional reflectance distribution functions, is key in obtaining an object's real-world shape and appearance. "Using only 3D geometry cannot reproduce the realistic appearance of the object in the AR/VR environment. Our technique can capture high-quality 3D geometry as well as its material appearance so that the objects can be realistically rendered in any virtual environment."

The novel algorithm does not require any input geometry of the select object and can successfully capture the geometry and physical appearance of 3D objects with the basic flash photography. Examples of the novel approach include producing metal, wood, plastic, ceramic, and a finely detailed mini-statute of Nefertiti.

Watch this video below to learn more:

Source: Association for Computing Machinery

About the Author
  • Nouran enjoys writing on various topics including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
JAN 19, 2020
Space & Astronomy
JAN 19, 2020
New Technologies Are Headed for the International Space Station
Space is hard, and for that reason, researchers are always trying to come up with new ways to make it easier. One of the best places for new technologies t...
JAN 19, 2020
Space & Astronomy
JAN 19, 2020
SpaceX Puts Another 60 Starlink Satellites Into Orbit
A SpaceX Falcon 9 rocket that stood tall and proud at the launch pad at Florida’s Cape Canaveral Air Force Station ignited its engines and lofted a g...
JAN 19, 2020
Cancer
JAN 19, 2020
Using AI to determine which patients are best suited for immunotherapy
A new study published in the journal Cancer Immunology Research suggests that we can use artificial intelligence to help determine which people with lung c...
JAN 19, 2020
Neuroscience
JAN 19, 2020
Are teens addicted to their phones?
Journalists quickly jumped to the conclusion that 23% of teenagers are addicted to their smartphones thanks to findings from a new study from King’s ...
JAN 19, 2020
Cannabis Sciences
JAN 19, 2020
Beware Twitter Bots Spreading False Cannabis Claims
Twitter bots (accounts controlled by software instead of people) are spreading false claims about the medical uses of cannabis, a new study in the American...
JAN 19, 2020
Space & Astronomy
JAN 19, 2020
It's Finally the Year of the Mars 2020 Mission
It’s officially 2020, and with that in mind, anyone paying attention to NASA’s launch schedule should know already that the Mars 2020 rover is...
Loading Comments...