Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study

Communicating with spoken dialogue systems (SDS) such as Apple’s Siri® and Google’s Now is becoming more and more common. We report a study that manipulates an SDS’s word use with regard to politeness. In an experiment, 58 young adults evaluated the spoken messages of our self-developed SDS as it re...

Full description

Saved in:
Bibliographic Details
Main Authors: Regina Jucks, Gesa A. Linnemann, Benjamin Brummernhenrich
Format: Article
Language:English
Published: Wiley 2018-01-01
Series:Advances in Human-Computer Interaction
Online Access:http://dx.doi.org/10.1155/2018/8406187
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832551610457260032
author Regina Jucks
Gesa A. Linnemann
Benjamin Brummernhenrich
author_facet Regina Jucks
Gesa A. Linnemann
Benjamin Brummernhenrich
author_sort Regina Jucks
collection DOAJ
description Communicating with spoken dialogue systems (SDS) such as Apple’s Siri® and Google’s Now is becoming more and more common. We report a study that manipulates an SDS’s word use with regard to politeness. In an experiment, 58 young adults evaluated the spoken messages of our self-developed SDS as it replied to typical questions posed by university freshmen. The answers were either formulated politely or rudely. Dependent measures were both holistic measures of how students perceived the SDS as well as detailed evaluations of each single answer. Results show that participants not only evaluated the content of rude answers as being less appropriate and less pleasant than the polite answers, but also evaluated the rude system as less accurate. Lack of politeness also impacted aspects of the perceived trustworthiness of the SDS. We conclude that users of SDS expect such systems to be polite, and we then discuss some practical implications for designing SDS.
format Article
id doaj-art-71f2d37c437842fb9e83d32d3624e142
institution Kabale University
issn 1687-5893
1687-5907
language English
publishDate 2018-01-01
publisher Wiley
record_format Article
series Advances in Human-Computer Interaction
spelling doaj-art-71f2d37c437842fb9e83d32d3624e1422025-02-03T06:01:07ZengWileyAdvances in Human-Computer Interaction1687-58931687-59072018-01-01201810.1155/2018/84061878406187Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental StudyRegina Jucks0Gesa A. Linnemann1Benjamin Brummernhenrich2University of Muenster, Institute of Psychology for Education, GermanyUniversity of Muenster, Institute of Psychology for Education, GermanyUniversity of Muenster, Institute of Psychology for Education, GermanyCommunicating with spoken dialogue systems (SDS) such as Apple’s Siri® and Google’s Now is becoming more and more common. We report a study that manipulates an SDS’s word use with regard to politeness. In an experiment, 58 young adults evaluated the spoken messages of our self-developed SDS as it replied to typical questions posed by university freshmen. The answers were either formulated politely or rudely. Dependent measures were both holistic measures of how students perceived the SDS as well as detailed evaluations of each single answer. Results show that participants not only evaluated the content of rude answers as being less appropriate and less pleasant than the polite answers, but also evaluated the rude system as less accurate. Lack of politeness also impacted aspects of the perceived trustworthiness of the SDS. We conclude that users of SDS expect such systems to be polite, and we then discuss some practical implications for designing SDS.http://dx.doi.org/10.1155/2018/8406187
spellingShingle Regina Jucks
Gesa A. Linnemann
Benjamin Brummernhenrich
Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study
Advances in Human-Computer Interaction
title Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study
title_full Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study
title_fullStr Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study
title_full_unstemmed Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study
title_short Student Evaluations of a (Rude) Spoken Dialogue System Insights from an Experimental Study
title_sort student evaluations of a rude spoken dialogue system insights from an experimental study
url http://dx.doi.org/10.1155/2018/8406187
work_keys_str_mv AT reginajucks studentevaluationsofarudespokendialoguesysteminsightsfromanexperimentalstudy
AT gesaalinnemann studentevaluationsofarudespokendialoguesysteminsightsfromanexperimentalstudy
AT benjaminbrummernhenrich studentevaluationsofarudespokendialoguesysteminsightsfromanexperimentalstudy