Detecting fingertip robust scale-invariant and rotation invariant with stereo camera

Abstract

Recently, Many IT products applying the gesture recognition are developed. To recognize the hand gesture, We need technology that detect fingertip. When we detect the hand using the depth of Stereo Camera in the previous method, It couldn't separate the hand and the wrist. In this paper, we can detect separately hand, wrist and fingertip using the depth of Stereo Camera. Hand was detected by AND operation between skin color filter and disparity-map from Stereo Camera. To detect the fingertip on the detected hand, we use accumulation value of in Sub-window. Fingertips were detected by each of X, Y axis accumulation value in Sub-window on the hand region. Our method has advantages that it is scale-invariant and rotation invariant. So we can process Natural User Interface. As the experiment result indicated, our proposed detection performance is the average 96.58%. © 2015 IEEE.