Prospective design of interactive emotional sound edutainment system: MESIG

Abstract

This paper proposes an interactive game for children to learn basic musical composition called as musical education sound interactive game (MESIG) designated as a new type of user interface. Developed an interactive game interface provides children to enjoy and play the games, so that they learn how to compose musical notes using tangible input instead of ordinary input devices. This new way to experience and play the computer games by using the body and hands' movement and interact with the virtual environment increases the children learning interest and outcome more effective. This system is developed using a single camera and skin color model tracking technique to detect hand gesture as input device to play the game. This simple technique of vision based and image processing results an expressive interactive musical education system of technology arena. To exploit the effectiveness, evaluation and analysis works are accomplished upon the realization of sound edutainment game. © 2008 IADIS.