Masayoshi Tabuse1, Manase Mizobe2, Yasunari Yoshitomi1, Taro Asada1
1Graduate School of Life and Environmental Sciences, Kyoto Prefectural University,
1-5 Nakaragi-cho, Shimogamo, Sakyo-ku, Kyoto 606-8522, Japan
2Toray Engineering Co., Ltd., 3-22 Yaesu Ryumeikan Building, Yaesu 1-chome,
Chuo-ku, Tokyo 103-0028, Japan
pp. 40-45
ABSTRACT
It is necessary to support of computer operation for a physically disabled
person. One of the possible physical movements of the physically disabled
person is facial movement. Recognition of facial movement of a person makes
it possible to operate a computer. Furthermore without the adjustment for
a user and adjustment for the distance from a user, it is possible to reduce
the burden on a user. We developed a system to resolve these problems.
In our system, a web camera, dlib C++ library and OpenCV library are used
to extract feature points of the face and obtain the face direction. Changing
the face direction, we can move a mouse cursor. Recognizing an open mouth
or closed eye, we can carry out an operation of mouse click. In this paper,
we evaluated the effect on operability due to the face direction and recognition
rate due to distance.
ARTICLE INFO
Article History
Received 13 November 2019
Accepted 16 July 2020
Keywords
Mouse cursor system
Dlib C++ library
Facial movements
Physically disabled people
JAALR1108
Download articlez(PDF)