Real-time AR edutainment system using sensor based motion recognition

Abstract

Recently the Natural User Interface (NUI) technology which is capable of appreciating the whole human body has come to the fore with the development of digital technology. And this new interface has settled as the competitive contents in the growing experiential learning contents market, by arousing participants' interests and maximizing their learning effect, through a gesture recognition-based noncontact type interactive education. This study suggests various interpretations on the basis of the education contents production which enables participant to experience the human body in real time. Also it has developed a gesture interface by utilizing the Kinect sensor that can recognize a participant's skeleton and behavior, and its education contents design has produced the end product by using Unity 3D authoring tool which can combine the real-time 3D model and animation together. Consequently, participant will be able to learn various inner organs such as brain and heart by different gestures, and the developed real-time human body exploring augmented reality system is expected to be widely used in many educational institutions. © 2016 SERSC.