Sound Rendering Framework for Coexistence in Real and Virtual Architectural Environments

Abstract

In this study we propose a sound rendering framework for telepresence systems to achieve an immersive spatial audio for coexistence spaces. We designed sound capturing system, sound rendering methodologies and incorporating the user movements in real-time from feedback devices (i.e., head tracker, motion detection etc.). Furthermore, the room acoustical effects for real as well as for virtual architectural structures are considered to deal with the phenomenon of sound propagation and diffractions in such environments. The whole audio rendering processing chain (i.e., from sound capturing, user movement tracking and updating, room acoustical effects, graphical objects virtual sound synthesis and finally auralization) is achieved with high fidelity spatial sound and low computational cost.