Skip to main content

To replicate physical objects for virtual reality, just turn on your smartphone

To replicate physical objects for virtual reality, just turn on your smartphone: 



Novel, practical method that enables the capture of spatially-varying BRDFs from unstructured flash photographs. Image (a) shows the acquisition setup, while (b) - (d) show results of the reconstructions.

Capturing and reproducing realistic, real-world objects for any virtual environment is complex and time-consuming. Imagine using a conventional camera with a built-in flash -- from any mobile device or off-the-shelf digital camera -- to simplify this task. A global team of computer scientists have developed a novel method that replicates physical objects for the virtual and augmented reality space just using a point-and-shoot camera with a flash, without the need for additional, and oftentimes expensive, supporting hardware.
"To faithfully reproduce a real-world object in the VR/AR environment, we need to replicate the 3D geometry and appearance of the object," says Min H. Kim, associate professor of computer science at KAIST in South Korea and lead author of the research. "Traditionally, this has been either done manually by 3D artists, which is a labor-intensive task, or by using specialized, expensive hardware. Our method is straightforward, cheaper and efficient, and reproduces realistic 3D objects by just taking photos from a single camera with a built-in flash."
Kim and his collaborators, Diego Gutierrez, professor of computer science at Universidad de Zaragoza in Spain, and KAIST PhD students Giljoo Nam and Joo Ho Lee, will present this new work at SIGGRAPH Asia 2018 in Tokyo 4 December to 7 December. The annual conference features the most respected technical and creative members in the field of computer graphics and interactive techniques, and showcases leading edge research in science, art, gaming and animation, among other sectors.
Existing approaches for the acquisition of physical objects require specialized hardware setups to achieve geometry and appearance modeling of the desired objects. Those setups might include a 3D laser scanner or multiple cameras, or a lighting dome with more than a hundred light sources. In contrast, this new technique only needs a single camera, to produce high-quality outputs.
"Many traditional methods using a single camera can capture only the 3D geometry of objects, but not the complex reflectance of real-world objects, given by the SVBRDF," notes Kim. SVBRDF, which stands for spatially-varying bidirectional reflectance distribution functions, is key in obtaining an object's real-world shape and appearance. "Using only 3D geometry cannot reproduce the realistic appearance of the object in the AR/VR environment. Our technique can capture high-quality 3D geometry as well as its material appearance so that the objects can be realistically rendered in any virtual environment."
The group demonstrated their framework using a digital camera, the Nikon D7000 and the built-in camera of an Android mobile phone, in a series of examples in their paper, "Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography." The novel algorithm, which does not require any input geometry of the target object, successfully captured the geometry and appearance of 3D objects with basic, flash photography and reproduced consistent results. Examples that were showcased in the work included diverse set of objects that spanned a wide range of geometries and materials, including metal, wood, plastic, ceramic, resin and paper, and comprised of complex shapes like a finely detailed mini-statute of Nefertiti.
In future work, the researchers hope to further simplify the capture process or extending the method to include dynamic geometry or larger scenes, for instance.

Comments

Post a Comment

Popular posts from this blog

Home births as safe as hospital births: International study suggests

A large international study led by McMaster University shows that low risk pregnant women who intend to give birth at home have no increased chance of the baby's perinatal or neonatal death compared to other low risk women who intend to give birth in a hospital. The results have been published by  The Lancet 's  EClinicalMedicine  journal. "More women in well-resourced countries are choosing birth at home, but concerns have persisted about their safety," said Eileen Hutton, professor emeritus of obstetrics and gynecology at McMaster, founding director of the McMaster Midwifery Research Centre and first author of the paper. "This research clearly demonstrates the risk is no different when the birth is intended to be at home or in hospital." The study examined the safety of place of birth by reporting on the risk of death at the time of birth or within the first four weeks, and found no clinically important or statistically different risk between home...
Post a Comment
Read more

Dark matter may be older than the Big Bang

Dark matter, which researchers believe make up about 80% of the universe's mass, is one of the most elusive mysteries in modern physics. What exactly it is and how it came to be is a mystery, but a new Johns Hopkins University study now suggests that dark matter may have existed before the Big Bang. The study, published August 7 in  Physical Review Letters , presents a new idea of how dark matter was born and how to identify it with astronomical observations. "The study revealed a new connection between particle physics and astronomy. If dark matter consists of new particles that were born before the Big Bang, they affect the way galaxies are distributed in the sky in a unique way. This connection may be used to reveal their identity and make conclusions about the times before the Big Bang too," says Tommi Tenkanen, a postdoctoral fellow in Physics and Astronomy at the Johns Hopkins University and the study's author. While not much is known about its origins,...
Post a Comment
Read more

Scientists challenge notion of binary sexuality with naming of new plant species

A collaborative team of scientists from the US and Australia has named a new plant species from the remote Outback. Bucknell University biology postdoctoral fellow Angela McDonnell and professor Chris Martine led the description of the plant that had confounded field biologists for decades because of the unusual fluidity of its flower form. The discovery, published in the open access journal  PhytoKeys , offers a powerful example of the diversity of sexual forms found among plants. The new species of bush tomato discovered in remote Australia provides a compelling example of the fact that sexuality among Earth's living creatures is far more diverse -- and interesting -- than many people likely realize. Bucknell University postdoctoral fellow Angela McDonnell and biology professor Chris Martine led the study following an expedition last year to relocate populations of the new plant, which were first noted by Australian botanists during the 1970s. Herbarium specimens from th...
Post a Comment
Read more