Smart Speakers and Intelligent Personal Assistants: Experiences, Perspectives, and UX Evaluation

Abstract

This paper consolidates the efforts of our research group in designing and developing voice applications for smart speakers and intelligent personal assistants (such as Amazon Alexa, Google Assistant, Siri, and Cortana) over recent years. We present six case studies: a career guidance system, an application for educational fairs, an appointment booking system for a dentist's office, a set of games for seniors, a notification system for smart farming, and the use of smart speakers as mechanisms to evaluate user experience. These case studies encompass various contexts, each requiring unique approaches. Each voice application was individually evaluated using standardized questionnaires and customized surveys. Additionally, we conducted two parallel evaluations to address key questions about human interaction with intelligent personal assistants. These evaluations involved both expert groups and end-users of the voice applications. Finally, we synthesize the knowledge, experiences, and perspectives gathered over these years to present a list of lessons learned, aimed at guiding researchers and developers in enhancing the user experience (UX) of voice applications.