Multi-user immersive environment for excavator teleoperation in construction

Abstract

Excavation on jobsites is a collaborative effort, with a spotter serving as an extra set of eyes for the operator to ensure safety. However, current training methods using simulators are limited in immersion and primarily designed for individual operators to practice basic skills. This paper presents a multi-user teleoperation system featured with hybrid-immersive interface and between-user communication. The effectiveness of the system is evaluated through human subject experiments. The study's findings indicate that operators experienced greater immersion, a stronger sense of presence, and improved user interaction when using an immersive interface. This paper has important implications for the future of excavation training, with potential benefits including reduced utility strike damage and the opportunity to investigate human-robot collaboration in jobsites with multiple workers performing various roles within a highly immersive operational environment.