5. A Fundamental Study on Hidden Surface Removal for Interactions between User’s Bare Hands and Virtual Objects in Augmented Reali ty

Makoto Sakamoto1, Takahiro Ishizu1, Kenji Sakoma1, Takahiro Shinoda1, Amane Take1, Takao Ito2
1Department of Computer Science and System Engineering, University of Miyazaki, Miyazaki-City, 889-2192, Japan
2Graduate School of Engineering, Hiroshima University, Higashi-Hiroshima, 739-8527, Japan
pp. 22–26
ABSTRACT
Augmented reality (AR) technology is a technique of superimposing information generated by a computer on perceptual information that we receive from real space. Recently, much attention has been focused on interaction techniques between users and virtual objects, such as the user directly manipulating virtual objects with his/her bare hands. On the other hand, in AR technology, since the 3-dimensional (3D) model is superimposed on the image of the real space afterwards, it is always displayed on the front side than the hand. Thus, it becomes an unnatural scene in some cases (occlusion problem). In this study, this system considers the object-context relations between the user's hand and the virtual object by acquiring depth information of the user's finger. In the evaluation experiment, it is confirmed that the hidden surface removal in this study not only makes it possible to consider the object-context relations but also can distinguish between finger boundaries and to clarify and process finger contours.

ARTICLE INFO
Article History
Received 23 October 2019
Accepted 01 July 2020

Keywords
Augmented reality (AR)
Occlusion problem
Hidden surface removal
Hand detection

JAALR1105

Download articlez(PDF)