DEC 03, 2018 2:10 PM PST

Replicating 3D Objects Using Your Smartphone May Soon Be Possible

WRITTEN BY: Nouran Amin

The production of realistic, real-world objects for the virtual environment is a complex and time-consuming process. Nevertheless, a team of investigators created a new approach to replicating physical objects via a point-and-shoot camera with a flash. The approach is demonstrated using a digital camera, the Nikon D7000 and the built-in camera of an Android mobile phone, detailed in the paper, "Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography."

"To faithfully reproduce a real-world object in the VR/AR environment, we need to replicate the 3D geometry and appearance of the object," says Min H. Kim, associate professor of computer science at KAIST in South Korea and lead author of the research. "Traditionally, this has been either done manually by 3D artists, which is a labor-intensive task, or by using specialized, expensive hardware. Our method is straightforward, cheaper and efficient, and reproduces realistic 3D objects by just taking photos from a single camera with a built-in flash."

Current approaches for the acquisition of physical objects require special hardware setups needed for geometry and appearance modeling of the intended object. These setups might consist of a 3D laser scanner or multiple cameras. However, the developed novel approach greatly contrasts current methods by only requiring a single camera for the high-quality outputs.

“Novel, practical method that enables the capture of spatially-varying BRDFs from unstructured flash photographs. Image (a) shows the acquisition setup, while (b) - (d) show results of the reconstructions.”-ScienceDaily

Credit: Courtesy, ACM SIGGRAPH Asia 2018

"Many traditional methods using a single camera can capture only the 3D geometry of objects, but not the complex reflectance of real-world objects, given by the SVBRDF," notes Kim. SVBRDF, which stands for spatially-varying bidirectional reflectance distribution functions, is key in obtaining an object's real-world shape and appearance. "Using only 3D geometry cannot reproduce the realistic appearance of the object in the AR/VR environment. Our technique can capture high-quality 3D geometry as well as its material appearance so that the objects can be realistically rendered in any virtual environment."

The novel algorithm does not require any input geometry of the select object and can successfully capture the geometry and physical appearance of 3D objects with the basic flash photography. Examples of the novel approach include producing metal, wood, plastic, ceramic, and a finely detailed mini-statute of Nefertiti.

Watch this video below to learn more:

Source: Association for Computing Machinery

About the Author
  • Nouran earned her BS and MS in Biology at IUPUI and currently shares her love of science by teaching. She enjoys writing on various topics as well including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
SEP 04, 2020
Technology
Machine Learning May Protect Future Pregnancies
SEP 04, 2020
Machine Learning May Protect Future Pregnancies
It is critical for doctors to examine a placenta after the birth of a baby to determine a mothers health risks for any f ...
SEP 06, 2020
Technology
Can Math Determine The Sex of a Dinosaur?
SEP 06, 2020
Can Math Determine The Sex of a Dinosaur?
Can math tell us about the gender differences in dinosaurs? A new study published a novel statistical analysis that esti ...
OCT 02, 2020
Clinical & Molecular DX
Detecting Dystonia in the Blink of an AI
OCT 02, 2020
Detecting Dystonia in the Blink of an AI
A team of scientists have created a diagnostic tool, powered by artificial intelligence (AI), that can pick up on the su ...
DEC 06, 2020
Technology
Advancing Digital Communication
DEC 06, 2020
Advancing Digital Communication
Communicating technical information via touch? A prototype recently developed by engineers may do just that! "We ...
DEC 26, 2020
Technology
Math vs Language: Learning To Code
DEC 26, 2020
Math vs Language: Learning To Code
Learning a computer program is very much like learning a new language. How so? It involves training your eyes on new ter ...
DEC 30, 2020
Cell & Molecular Biology
Measuring Electrical Differences Inside of Live Cells
DEC 30, 2020
Measuring Electrical Differences Inside of Live Cells
Electricity is a key aspect of life, and is required for organisms to move and communicate. The movement of tiny charged ...
Loading Comments...