Tactile Modulation of Emotional Speech Samples

Traditionally only speech communicates emotions via mobile phone. However, in daily communication the sense of touch mediates emotional information during conversation. The present aim was to study if tactile stimulation affects emotional ratings of speech when measured with scales of pleasantness,...

Full description

Saved in:
Bibliographic Details
Main Authors: Katri Salminen, Veikko Surakka, Jani Lylykangas, Jussi Rantala, Teemu Ahmaniemi, Roope Raisamo, Dari Trendafilov, Johan Kildal
Format: Article
Language:English
Published: Wiley 2012-01-01
Series:Advances in Human-Computer Interaction
Online Access:http://dx.doi.org/10.1155/2012/741304
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850163551422906368
author Katri Salminen
Veikko Surakka
Jani Lylykangas
Jussi Rantala
Teemu Ahmaniemi
Roope Raisamo
Dari Trendafilov
Johan Kildal
author_facet Katri Salminen
Veikko Surakka
Jani Lylykangas
Jussi Rantala
Teemu Ahmaniemi
Roope Raisamo
Dari Trendafilov
Johan Kildal
author_sort Katri Salminen
collection DOAJ
description Traditionally only speech communicates emotions via mobile phone. However, in daily communication the sense of touch mediates emotional information during conversation. The present aim was to study if tactile stimulation affects emotional ratings of speech when measured with scales of pleasantness, arousal, approachability, and dominance. In the Experiment 1 participants rated speech-only and speech-tactile stimuli. The tactile signal mimicked the amplitude changes of the speech. In the Experiment 2 the aim was to study whether the way the tactile signal was produced affected the ratings. The tactile signal either mimicked the amplitude changes of the speech sample in question, or the amplitude changes of another speech sample. Also, concurrent static vibration was included. The results showed that the speech-tactile stimuli were rated as more arousing and dominant than the speech-only stimuli. The speech-only stimuli were rated as more approachable than the speech-tactile stimuli, but only in the Experiment 1. Variations in tactile stimulation also affected the ratings. When the tactile stimulation was static vibration the speech-tactile stimuli were rated as more arousing than when the concurrent tactile stimulation was mimicking speech samples. The results suggest that tactile stimulation offers new ways of modulating and enriching the interpretation of speech.
format Article
id doaj-art-e95310d33d224910bb0d0b43b8704774
institution OA Journals
issn 1687-5893
1687-5907
language English
publishDate 2012-01-01
publisher Wiley
record_format Article
series Advances in Human-Computer Interaction
spelling doaj-art-e95310d33d224910bb0d0b43b87047742025-08-20T02:22:15ZengWileyAdvances in Human-Computer Interaction1687-58931687-59072012-01-01201210.1155/2012/741304741304Tactile Modulation of Emotional Speech SamplesKatri Salminen0Veikko Surakka1Jani Lylykangas2Jussi Rantala3Teemu Ahmaniemi4Roope Raisamo5Dari Trendafilov6Johan Kildal7Tampere Unit for Computer Human Interaction, School of Information Sciences, University of Tampere, Kanslerinrinne 1, 33014 Helsinki, FinlandTampere Unit for Computer Human Interaction, School of Information Sciences, University of Tampere, Kanslerinrinne 1, 33014 Helsinki, FinlandTampere Unit for Computer Human Interaction, School of Information Sciences, University of Tampere, Kanslerinrinne 1, 33014 Helsinki, FinlandTampere Unit for Computer Human Interaction, School of Information Sciences, University of Tampere, Kanslerinrinne 1, 33014 Helsinki, FinlandNokia Research Center, Itämerenkatu 11-13, 00180 Helsinki, FinlandTampere Unit for Computer Human Interaction, School of Information Sciences, University of Tampere, Kanslerinrinne 1, 33014 Helsinki, FinlandNokia Research Center, Itämerenkatu 11-13, 00180 Helsinki, FinlandNokia Research Center, Itämerenkatu 11-13, 00180 Helsinki, FinlandTraditionally only speech communicates emotions via mobile phone. However, in daily communication the sense of touch mediates emotional information during conversation. The present aim was to study if tactile stimulation affects emotional ratings of speech when measured with scales of pleasantness, arousal, approachability, and dominance. In the Experiment 1 participants rated speech-only and speech-tactile stimuli. The tactile signal mimicked the amplitude changes of the speech. In the Experiment 2 the aim was to study whether the way the tactile signal was produced affected the ratings. The tactile signal either mimicked the amplitude changes of the speech sample in question, or the amplitude changes of another speech sample. Also, concurrent static vibration was included. The results showed that the speech-tactile stimuli were rated as more arousing and dominant than the speech-only stimuli. The speech-only stimuli were rated as more approachable than the speech-tactile stimuli, but only in the Experiment 1. Variations in tactile stimulation also affected the ratings. When the tactile stimulation was static vibration the speech-tactile stimuli were rated as more arousing than when the concurrent tactile stimulation was mimicking speech samples. The results suggest that tactile stimulation offers new ways of modulating and enriching the interpretation of speech.http://dx.doi.org/10.1155/2012/741304
spellingShingle Katri Salminen
Veikko Surakka
Jani Lylykangas
Jussi Rantala
Teemu Ahmaniemi
Roope Raisamo
Dari Trendafilov
Johan Kildal
Tactile Modulation of Emotional Speech Samples
Advances in Human-Computer Interaction
title Tactile Modulation of Emotional Speech Samples
title_full Tactile Modulation of Emotional Speech Samples
title_fullStr Tactile Modulation of Emotional Speech Samples
title_full_unstemmed Tactile Modulation of Emotional Speech Samples
title_short Tactile Modulation of Emotional Speech Samples
title_sort tactile modulation of emotional speech samples
url http://dx.doi.org/10.1155/2012/741304
work_keys_str_mv AT katrisalminen tactilemodulationofemotionalspeechsamples
AT veikkosurakka tactilemodulationofemotionalspeechsamples
AT janilylykangas tactilemodulationofemotionalspeechsamples
AT jussirantala tactilemodulationofemotionalspeechsamples
AT teemuahmaniemi tactilemodulationofemotionalspeechsamples
AT rooperaisamo tactilemodulationofemotionalspeechsamples
AT daritrendafilov tactilemodulationofemotionalspeechsamples
AT johankildal tactilemodulationofemotionalspeechsamples