Frequency-encoded eye tracking smart contact lens for human–machine interaction

Date：April 2024

Teams:Nanjing University

Writers:Hengtian Zhu, Huan Yang, Siqi Xu, Yuanyuan Ma, Shugeng Zhu, Zhengyi Mao, Weiwei Chen, Zizhong Hu, Rongrong Pan, Yurui Xu, Yifeng Xiong, Ye Chen, Yanqing Lu, Xinghai Ning, Dechen Jiang, Songtao Yuan & Fei Xu

PDF:Frequency-encoded eye tracking smart contact lens for human–machine interaction

Abstract

Eye tracking techniques enable high-efficient, natural, and effortless human-machine interaction by detecting users’ eye movements and decoding their attention and intentions. Here, a miniature, imperceptible, and biocompatible smart contact lens is proposed for in situ eye tracking and wireless eye-machine interaction. Employing the frequency encoding strategy, the chip-free and battery-free lens successes in detecting eye movement and closure. Using a time-sequential eye tracking algorithm, the lens has a great angular accuracy of <0.5°, which is even less than the vision range of central fovea. Multiple eye-machine interaction applications, such as eye-drawing, Gluttonous Snake game, web interaction, pan-tilt-zoom camera control, and robot vehicle control, are demonstrated on the eye movement model and in vivo rabbit. Furthermore, comprehensive biocompatibility tests are implemented, demonstrating low cytotoxicity and low eye irritation. Thus, the contact lens is expected to enrich approaches of eye tracking techniques and promote the development of human-machine interaction technology.