Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?

Non-uniform temporal weights (TWs) are often reported regarding the perceptual evaluation of dynamic auditory and visual information, such as perceptual judgments of the overall intensity of time-varying stimuli. In particular, primacy effects, i.e., a stronger influence of early compared to later s...

Full description

Saved in:
Bibliographic Details
Main Authors: Oberfeld Daniel, Fischenich Alexander, Ponsot Emmanuel
Format: Article
Language:English
Published: EDP Sciences 2024-01-01
Series:Acta Acustica
Subjects:
Online Access:https://acta-acustica.edpsciences.org/articles/aacus/full_html/2024/01/aacus240013/aacus240013.html
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850197839936749568
author Oberfeld Daniel
Fischenich Alexander
Ponsot Emmanuel
author_facet Oberfeld Daniel
Fischenich Alexander
Ponsot Emmanuel
author_sort Oberfeld Daniel
collection DOAJ
description Non-uniform temporal weights (TWs) are often reported regarding the perceptual evaluation of dynamic auditory and visual information, such as perceptual judgments of the overall intensity of time-varying stimuli. In particular, primacy effects, i.e., a stronger influence of early compared to later stimulus information on the perceptual decision, have been observed across a large number of studies. Yet, it is not clear whether these non-uniform patterns of TWs result from sensory or attentional processes that coincidentally produce similar time-courses, or whether they reflect the common signature of supra-modal and subject-specific decision-making processes. The present study addresses the hypothesis that TWs in loudness (perceived auditory intensity) and brightness (perceived visual intensity) judgments result from a common supramodal evidence-integration process. In Experiment 1, we compared TWs for loudness and brightness judgments in the same participants, with task difficulty matched individually. The observed average temporal weighting profiles differed substantially between the two modalities. In Experiment 2, we assessed the additional contribution of modality-specific sensory and attentional processes to the observed differences between TWs by measuring intensity resolution at different temporal positions in the auditory and visual stimuli. We observed a significantly different dependence of sensitivity on temporal position in the two modalities, but these sensitivity differences only partially accounted for the temporal weighting differences observed in Experiment 1. The collective findings indicate that the TWs observed for loudness and brightness judgments cannot be attributed to a supramodal evidence-integration process alone. Instead, our results suggest that both sensory and decision-making processes shape patterns of TWs.
format Article
id doaj-art-a1891c1c37bd4dc5942e9d0e107e2a54
institution OA Journals
issn 2681-4617
language English
publishDate 2024-01-01
publisher EDP Sciences
record_format Article
series Acta Acustica
spelling doaj-art-a1891c1c37bd4dc5942e9d0e107e2a542025-08-20T02:13:02ZengEDP SciencesActa Acustica2681-46172024-01-0185710.1051/aacus/2024061aacus240013Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?Oberfeld Daniel0https://orcid.org/0000-0002-6710-3309Fischenich Alexander1Ponsot Emmanuel2https://orcid.org/0000-0002-8748-505XExperimental Psychology, Johannes Gutenberg-Universität MainzExperimental Psychology, Johannes Gutenberg-Universität MainzScience & Technology of Music and Sound, IRCAM/CNRS/Sorbonne UniversitéNon-uniform temporal weights (TWs) are often reported regarding the perceptual evaluation of dynamic auditory and visual information, such as perceptual judgments of the overall intensity of time-varying stimuli. In particular, primacy effects, i.e., a stronger influence of early compared to later stimulus information on the perceptual decision, have been observed across a large number of studies. Yet, it is not clear whether these non-uniform patterns of TWs result from sensory or attentional processes that coincidentally produce similar time-courses, or whether they reflect the common signature of supra-modal and subject-specific decision-making processes. The present study addresses the hypothesis that TWs in loudness (perceived auditory intensity) and brightness (perceived visual intensity) judgments result from a common supramodal evidence-integration process. In Experiment 1, we compared TWs for loudness and brightness judgments in the same participants, with task difficulty matched individually. The observed average temporal weighting profiles differed substantially between the two modalities. In Experiment 2, we assessed the additional contribution of modality-specific sensory and attentional processes to the observed differences between TWs by measuring intensity resolution at different temporal positions in the auditory and visual stimuli. We observed a significantly different dependence of sensitivity on temporal position in the two modalities, but these sensitivity differences only partially accounted for the temporal weighting differences observed in Experiment 1. The collective findings indicate that the TWs observed for loudness and brightness judgments cannot be attributed to a supramodal evidence-integration process alone. Instead, our results suggest that both sensory and decision-making processes shape patterns of TWs.https://acta-acustica.edpsciences.org/articles/aacus/full_html/2024/01/aacus240013/aacus240013.htmltemporal weightingsensory decision makingloudnessbrightnessevidence integration
spellingShingle Oberfeld Daniel
Fischenich Alexander
Ponsot Emmanuel
Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?
Acta Acustica
temporal weighting
sensory decision making
loudness
brightness
evidence integration
title Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?
title_full Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?
title_fullStr Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?
title_full_unstemmed Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?
title_short Non-uniform temporal weighting of intensity in audition and vision: The signature of an evidence integration process?
title_sort non uniform temporal weighting of intensity in audition and vision the signature of an evidence integration process
topic temporal weighting
sensory decision making
loudness
brightness
evidence integration
url https://acta-acustica.edpsciences.org/articles/aacus/full_html/2024/01/aacus240013/aacus240013.html
work_keys_str_mv AT oberfelddaniel nonuniformtemporalweightingofintensityinauditionandvisionthesignatureofanevidenceintegrationprocess
AT fischenichalexander nonuniformtemporalweightingofintensityinauditionandvisionthesignatureofanevidenceintegrationprocess
AT ponsotemmanuel nonuniformtemporalweightingofintensityinauditionandvisionthesignatureofanevidenceintegrationprocess