A virtual keyboard implementation based on finger recognition

PubDate: July 2018

Teams: Auckland University of Technology

Writers: Y. Zhang ; W. Yan ; A. Narayanan

PDF: A virtual keyboard implementation based on finger recognition

Abstract

Keyboards still remain as the most popular input medium of choice for users needing to input large amounts of error-free text or combinations of text and numeric data. As mobile devices are being designed smaller, it becomes increasingly difficult for users to enter large amounts of input without carrying and attaching a keyboard. In this paper, we develop a new type of virtual keyboard that allows users to type on any plane to any device. The virtual keyboard is customized and printed on plain paper so that it can be put on any oblique plane or stuck on a wall. The device camera is then used for key recognition based on hand skin tone and fingertip location. If the fingertip remains on a key for a predetermined amount of time, the program will regard this key as an input. Our experiments show how various customized virtual keyboards allow users to input text of their choice if they have a real keyboard in front of them and with no identifiable performance compromise.