Designing Successive Target Selection in Virtual Reality via Penetrating the Intangible Interface with Handheld Controllers

Abstract

Empirical research on single target selection in Virtual Reality/Augmented Reality (VR/AR) environments has been studied extensively. However, there is a lack of methods and research on improving the coherence when successively selecting multiple targets. We propose Sewing, a successive target selection method with handheld controllers in VR environments. We leverage real-life sewing as a design metaphor for the selection of multiple targets with one single spatial movement penetrating targets with handheld controllers. We conducted an empirical study to validate the efficiency of selecting multiple targets with Sewing compared with the conventional selection method, which is based on the button pressing metaphor. Results showed that Sewing can provide promising performance and coherence for rapid and accurate target selection. Based on the results, we implemented SewTyping, a Sewing-based VR text entry method to evaluate the applicability of Sewing, and conducted an empirical study to compare the typing performance with two other techniques (Controller Pointing and Drum-like Keyboard). Results showed that 1) SewTyping achieved 26.57 words per minute with a total error rate of 3.68% and 2) users adapted to the sewing-like movement easily and achieved steady performance with essential practice. © 2022