A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.

Face-to-face conversations are central to human communication and a fascinating example of joint action. Beyond verbal content, one of the primary ways in which information is conveyed in conversations is body language. Body motion in natural conversations has been difficult to study precisely due t...

Full description

Saved in:
Bibliographic Details
Main Authors: Guy Gaziv, Lior Noy, Yuvalal Liron, Uri Alon
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2017-01-01
Series:PLoS ONE
Online Access:https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0170786&type=printable
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850230581446574080
author Guy Gaziv
Lior Noy
Yuvalal Liron
Uri Alon
author_facet Guy Gaziv
Lior Noy
Yuvalal Liron
Uri Alon
author_sort Guy Gaziv
collection DOAJ
description Face-to-face conversations are central to human communication and a fascinating example of joint action. Beyond verbal content, one of the primary ways in which information is conveyed in conversations is body language. Body motion in natural conversations has been difficult to study precisely due to the large number of coordinates at play. There is need for fresh approaches to analyze and understand the data, in order to ask whether dyads show basic building blocks of coupled motion. Here we present a method for analyzing body motion during joint action using depth-sensing cameras, and use it to analyze a sample of scientific conversations. Our method consists of three steps: defining modes of body motion of individual participants, defining dyadic modes made of combinations of these individual modes, and lastly defining motion motifs as dyadic modes that occur significantly more often than expected given the single-person motion statistics. As a proof-of-concept, we analyze the motion of 12 dyads of scientists measured using two Microsoft Kinect cameras. In our sample, we find that out of many possible modes, only two were motion motifs: synchronized parallel torso motion in which the participants swayed from side to side in sync, and still segments where neither person moved. We find evidence of dyad individuality in the use of motion modes. For a randomly selected subset of 5 dyads, this individuality was maintained for at least 6 months. The present approach to simplify complex motion data and to define motion motifs may be used to understand other joint tasks and interactions. The analysis tools developed here and the motion dataset are publicly available.
format Article
id doaj-art-efe218ddf1b74f8bb1402c0e84044299
institution OA Journals
issn 1932-6203
language English
publishDate 2017-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj-art-efe218ddf1b74f8bb1402c0e840442992025-08-20T02:03:50ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01121e017078610.1371/journal.pone.0170786A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.Guy GazivLior NoyYuvalal LironUri AlonFace-to-face conversations are central to human communication and a fascinating example of joint action. Beyond verbal content, one of the primary ways in which information is conveyed in conversations is body language. Body motion in natural conversations has been difficult to study precisely due to the large number of coordinates at play. There is need for fresh approaches to analyze and understand the data, in order to ask whether dyads show basic building blocks of coupled motion. Here we present a method for analyzing body motion during joint action using depth-sensing cameras, and use it to analyze a sample of scientific conversations. Our method consists of three steps: defining modes of body motion of individual participants, defining dyadic modes made of combinations of these individual modes, and lastly defining motion motifs as dyadic modes that occur significantly more often than expected given the single-person motion statistics. As a proof-of-concept, we analyze the motion of 12 dyads of scientists measured using two Microsoft Kinect cameras. In our sample, we find that out of many possible modes, only two were motion motifs: synchronized parallel torso motion in which the participants swayed from side to side in sync, and still segments where neither person moved. We find evidence of dyad individuality in the use of motion modes. For a randomly selected subset of 5 dyads, this individuality was maintained for at least 6 months. The present approach to simplify complex motion data and to define motion motifs may be used to understand other joint tasks and interactions. The analysis tools developed here and the motion dataset are publicly available.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0170786&type=printable
spellingShingle Guy Gaziv
Lior Noy
Yuvalal Liron
Uri Alon
A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.
PLoS ONE
title A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.
title_full A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.
title_fullStr A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.
title_full_unstemmed A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.
title_short A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations.
title_sort reduced dimensionality approach to uncovering dyadic modes of body motion in conversations
url https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0170786&type=printable
work_keys_str_mv AT guygaziv areduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT liornoy areduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT yuvalalliron areduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT urialon areduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT guygaziv reduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT liornoy reduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT yuvalalliron reduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations
AT urialon reduceddimensionalityapproachtouncoveringdyadicmodesofbodymotioninconversations