NEC combines AI and facial recognition to track what you’re looking at

Credit: vectorfusionart /

NEC has announced the development of “remote gaze detection technology” that can detect in real time the direction an individual is looking, even when using existing cameras from remote locations.

According to NEC, conventional technologies estimate an individual’s line-of-sight using specialized devices equipped with infrared lights and advanced cameras that detect light as it is reflected from an individual’s eye.

The new technology, developed as part of NEC’s portfolio of artificial intelligence (AI) technologies, uses face feature point detection technology (which is the core tech of NEC’s face recognition technology) to accurately identify characteristics in and around the eye, such as the pupil and the corners of the eye, from images taken with common cameras, including web, surveillance, tablet and smartphone cameras, without the need for specialized equipment.

The images and technology enable highly accurate detection of an individual’s line-of-sight, with a measurement error of less than 5 degrees from the left, right, top and bottom, NEC says.

Moreover, the technology’s advanced response to low resolution images and changes in brightness enable it to detect an individual’s line-of-sight, even when they are separated from the camera by 10 meters, making it well suited for applications such as, say, automatically detecting products that draw the attention of shoppers at retail stores.

Also, the high-speed computations of its “feature value extraction technology” enable it to simultaneously detect the line-of-sight of multiple individuals, without compromising the accuracy of its results. Put simply, even when multiple persons appear in a camera, it is possible to simultaneously detect the line-of-sight of each individual.

“Based on this technology, NEC can evaluate the line-of-sight of pedestrians and help to optimize the placement of important announcements on public streets,” said Akio Yamada, general manager of Data Science Research Laboratories, NEC. “Moreover, the technology can contribute to the safety and security of our communities by helping to monitor the behavior of suspicious individuals. This is in addition to its business potential, where the technology can help retailers learn more about which products are attracting the most attention from visiting customers.”

Be the first to comment

What do you think?

This site uses Akismet to reduce spam. Learn how your comment data is processed.