손동작을 이용한 인간친화형 증강현실 인터페이스

Abstract

기존의증강현실을위한비전기반인터페이스는대부분환경적인제약을받거나, 특수한장비혹은복잡한모델을요 구하기때문에, 사용자에게불편함을주거나실시간동작이힘들었다. 예를들어, 마커를이용하면구현상의편의성과정 확성을보장하지만, 일반적으로마커는환경과대비되는모양을가지기때문에, 사용자에게거부감을줄수있으며무엇보 다복잡한인터랙션에는적용되기힘들다. 본논문은증강현실을위한비전기반인터페이스로서손동작을제안한다. 손동 작을이용할경우, 자연스럽고다양한인터랙션을수행할수있지만, 손동작을정확히인식하는일은쉽지않다. 이로인해 지금까지제안된방법을증강현실시스템에적용하는데는한계가있다. 본논문에서는기본적으로손동작을이용한인터 페이스를제안하는데, 손동작인식을위한알고리즘을효율적으로개선함으로써, 복잡한환경에서적은연산량으로자연 스러운인터랙션을제공하고자한다. 제안된인터페이스는손의자연스러운움직임을감지해서손의모양과동작에따라 서가상의물체를자연스럽게제어할수있도록해준다. 다양한환경에서의실험및사용자평가를통해제안된인터페이스의 유용성을 검증하였다.

A number of augmented reality interfaces have been developed for past decades, which used to have environmental or ergonomic limitation by requiring 3-D hand model or tracking hardware such as data glove. For example, even though marker-based interfaces guarantee accuracy and convenience in implementation, the marker may be visually intrusive to user, because a marker has distinct of shape and color from the scene. Moreover, it is difficult to provide natural (usually complicated) user interactions using markers. On the other hand, interface based on gesture recognition can provide natural user interactions, but the recognition rate is usually low. This paper proposes an efficient hand gesture recognition method and a natural AR interface using the method. The proposed method can provide natural interaction to users with less computational cost. It also achieves a greatly enhanced recognition rate of hand gestures by using a color band. The color information of the color band put on user's wrist extracts the hand-region in a fast and accurate manner. User can freely control virtual object using the proposed interface. For example, virtual objects can be shown up in the area where the user is pointing, can be handled and disappeared as the user controls. We verify the effectiveness of our interface by comparing with a marker-based AR interface through user evaluation.