Real-time Human Pose Estimation using RGB-D images and Deep LearningReal-time Human Pose Estimation using RGB-D images and Deep Learning
- Other Titles
- Real-time Human Pose Estimation using RGB-D images and Deep Learning
- Authors
- 림빈보니카; 성낙준; 마준; 최유주; 홍민
- Issue Date
- 2020
- Publisher
- 한국인터넷정보학회
- Keywords
- Human pose estimation; human skeleton tracking; keypoint localization; deep learning
- Citation
- 인터넷정보학회논문지, v.21, no.3, pp.113 - 121
- Journal Title
- 인터넷정보학회논문지
- Volume
- 21
- Number
- 3
- Start Page
- 113
- End Page
- 121
- URI
- https://scholarworks.bwise.kr/sch/handle/2021.sw.sch/3531
- DOI
- 10.7472/jksii.2020.21.3.113
- ISSN
- 1598-0170
- Abstract
- Human Pose Estimation (HPE) which localizes the human body joints becomes a high potential for high-level applications in the field of computer vision. The main challenges of HPE in real-time are occlusion, illumination change and diversity of pose appearance. The single RGB image is fed into HPE framework in order to reduce the computation cost by using depth-independent device such as a common camera, webcam, or phone cam. However, HPE based on the single RGB is not able to solve the above challenges due to inherent characteristics of color or texture. On the other hand, depth information which is fed into HPE framework and detects the human body parts in 3D coordinates can be usefully used to solve the above challenges. However, the depth information-based HPE requires the depth-dependent device which has space constraint and is cost consuming. Especially, the result of depth information-based HPE is less reliable due to the requirement of pose initialization and less stabilization of frame tracking. Therefore, this paper proposes a new method of HPE which is robust in estimating self-occlusion. There are many human parts which can be occluded by other body parts. However, this paper focuses only on head self-occlusion. The new method is a combination of the RGB image-based HPE framework and the depth information-based HPE framework. We evaluated the performance of the proposed method by COCO Object Keypoint Similarity library. By taking an advantage of RGB image-based HPE method and depth information-based HPE method, our HPE method based on RGB-D achieved the mAP of 0.903 and mAR of 0.938. It proved that our method outperforms the RGB-based HPE and the depth-based HPE.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > Department of Computer Software Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/sch/handle/2021.sw.sch/3531)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.