Hey Google, Help Doing My Homework: Surveying Voice Interactive Systems

Abstract

Voice assistant devices, such as Google Home (TM) and Amazon Echo (TM), are at the forefront of natural voice interaction and natural language search through the removal of any graphical user interface (GUI). This user experience study is one of the first to compare information foraging using Google Home versus search behaviors using a traditional computer or desktop in a learning environment. We conducted research (N = 20) to investigate information foraging and retrieval behaviors of participants and measure query effectiveness, efficiency, and user satisfaction. Participants were separated into two distinct groups. The experimental group used the Google Home smart speaker to retrieve information for predefined question sets in the following categories: research, trivia, and math. The control group sought to answer the same question set using more traditional technologies including computers, tablets, cell phones, and calculators. The results show that participants with voice assistants found the correct answers almost two times faster for research and trivia questions and three times faster for math questions than participants using traditional technologies. User satisfaction also scores much higher with voice assistants than with traditional systems. Yet, despite these results, we found that privacy concerns, limited searchable databases, and voice-recognition challenges are all limiting factors to the adoption and widespread use of voice assistants. To reach the full promise of relative efficiency and user satisfaction favoring voice assistants over traditional systems, these weaknesses must be addressed.