8. Mouse Cursor Control System using Facial Movements

Masayoshi Tabuse1, Manase Mizobe2, Yasunari Yoshitomi1, Taro Asada1
1Graduate School of Life and Environmental Sciences, Kyoto Prefectural University, 1-5 Nakaragi-cho, Shimogamo, Sakyo-ku, Kyoto 606-8522, Japan
2Toray Engineering Co., Ltd., 3-22 Yaesu Ryumeikan Building, Yaesu 1-chome, Chuo-ku, Tokyo 103-0028, Japan
pp. 40-45
ABSTRACT
It is necessary to support of computer operation for a physically disabled person. One of the possible physical movements of the physically disabled person is facial movement. Recognition of facial movement of a person makes it possible to operate a computer. Furthermore without the adjustment for a user and adjustment for the distance from a user, it is possible to reduce the burden on a user. We developed a system to resolve these problems. In our system, a web camera, dlib C++ library and OpenCV library are used to extract feature points of the face and obtain the face direction. Changing the face direction, we can move a mouse cursor. Recognizing an open mouth or closed eye, we can carry out an operation of mouse click. In this paper, we evaluated the effect on operability due to the face direction and recognition rate due to distance.

ARTICLE INFO
Article History
Received 13 November 2019
Accepted 16 July 2020

Keywords
Mouse cursor system
Dlib C++ library
Facial movements
Physically disabled people

JAALR1108

Download articlez(PDF)