Gesture Recognition for Note Generation in VR Rhythm Game
- Authors
- Azizah, R.N.; Lee, Y.S.; Jung, J.J.; Sohn, B.-S.
- Issue Date
- Jan-2021
- Publisher
- IEEE Computer Society
- Keywords
- note generation; recognition; virtual reality
- Citation
- International Conference on Information Networking, v.2021-January, pp 521 - 524
- Pages
- 4
- Journal Title
- International Conference on Information Networking
- Volume
- 2021-January
- Start Page
- 521
- End Page
- 524
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/44035
- DOI
- 10.1109/ICOIN50884.2021.9333868
- ISSN
- 1976-7684
- Abstract
- This paper describes a gesture recognition algorithm for note generation in virtual reality (VR) rhythm game. VR rhythm game is a game in which a user has to move according to the rhythm or music in a virtual environment and usually takes the form of hitting objects, called notes, flying to the user with hands or tools. Notes need be generated to match the rhythm in the game. However, manual generation is often a time-consuming and tedious work. Previous research has focused mainly on the development of algorithms that automatically generate notes from music. However, notes made according to music can improve a sense of rhythm, but they do not have spatial characteristics, so it is difficult to induce spatially meaningful movements. In order to improve the drawback, we propose a method for note generation in a VR rhythm game from a dance consisting of hand taps. Dynamic Time Warning (DTW) method was applied to recognize the hand taps and determine the point at which to position the note. The experimental results show that our method accurately recognizes hand tap gestures and their location, and generates notes accordingly. © 2021 IEEE.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Software > School of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.