The “mirror” function in the phrase “eyes are the mirror of the soul” is invariably reflected, at least in the real world. Our pupils absorb the light reflected on them and therefore that of the person objects for can reflect.

As scientists at the University of Maryland pondered “how to use this reflection,” they developed a tool that suited the artificial intelligence trend. Objects seen in reflections in the eye, using computer can be transferred to the three-dimensional medium.

Your eye can now create small worlds:

Scientists used NVIDIA’s earlier development to convert reflections in the eye into three-dimensional objects. of NeRF technology took advantage. This technology was able to create an environment in three dimensions with just a few photos.

However, NeRF was insufficient to directly capture the reflections in the eye and transfer them to the 3D environment. Because with our students complex texture of the iris areacan make objects difficult to detect.

To prevent this, they developed a new method. In this method, “eye reflections”radial fieldis trained by rays ejected from the camera and reflected by the eye-like structure.

To ensure that the complex texture of the iris is not reflected in the 3D area, a 2D texture map or simply a mask is used, which simultaneously learns the iris texture.

Of course, the resulting image is still not clear. For this “eye posture optimizationA method called ‘ is used. Thanks to this optimization, the image improves as follows:

The developed method still gives no result with all kinds of eye photos. alone for now in suitable environmental and lighting conditions correct results can be obtained.

Some areas created by reflections in the eyes: