Home Technology Scientists recreate 3D models of objects from their reflections in the eyes

Scientists recreate 3D models of objects from their reflections in the eyes

0
Scientists recreate 3D models of objects from their reflections in the eyes

The reflection of objects in the human eye can serve to recreate them in 3D
(photo: CC0 Public Domain)

The Neural Radiance Field (NeRF) technology for converting two-dimensional images into three-dimensional models has already demonstrated its incredible capabilities, but now scientists from the University of Maryland, USA, have raised the bar high, using as input data the reflection of objects in the human eye.

To recreate a three-dimensional model, scientists need a high-resolution photo of a person. The output image is scaled, the reflection in the cornea is highlighted – inverted, color processed, and artifacts introduced by the cornea and distortions caused by the shape of the eye are removed. As a result, a 3D model is built, New Atlas explains about the process.

Of course, the quality of this model is far from ideal – in some cases it is possible to identify objects without fine details, and special lighting is required for the algorithm to work effectively.

In addition, the best results were obtained with the help of computer simulations – with a simulation of the human eye and the interior. The task is somewhat simplified due to the fact that the geometry of the cornea in most adults is approximately the same.

It is too early to judge the application of the technology, if we exclude the scenarios of spy movies. Scientists have experimented with the technology for the videos of Miley Cyrus and Lady Gaga, but the result is modest: in the eyes of the former, a lighting device is reflected, and in the latter, something like a human torso.

LEAVE A REPLY

Please enter your comment!
Please enter your name here