Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0

The concept of Multiple Sensorial Media (mulsemedia) has been explored to enhance user experiences by engaging different senses beyond sight and hearing. The growing demand for developing such applications has led to various studies focusing on the mulsemedia authoring process. However, there remain...

Full description

Saved in:
Bibliographic Details
Main Authors: Douglas Mattos, Romulo Vieira, Debora C. Muchaluat-Saade, George Ghinea
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11021610/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849682999010918400
author Douglas Mattos
Romulo Vieira
Debora C. Muchaluat-Saade
George Ghinea
author_facet Douglas Mattos
Romulo Vieira
Debora C. Muchaluat-Saade
George Ghinea
author_sort Douglas Mattos
collection DOAJ
description The concept of Multiple Sensorial Media (mulsemedia) has been explored to enhance user experiences by engaging different senses beyond sight and hearing. The growing demand for developing such applications has led to various studies focusing on the mulsemedia authoring process. However, there remains a significant gap in accessible methods for developing these applications. This article addresses this issue by assessing an event-based approach to mulsemedia creation. We implemented this approach in the graphical authoring tool STEVE 2.0, which enables users to develop mulsemedia applications by defining event-based temporal relationships that synchronize traditional media with sensory effects. Additionally, STEVE 2.0 allows for the configuration of media presentation and sensory effect rendering properties. To assess the usability, features, and user experience of the tool, we conducted experiments with 44 participants. The results show that STEVE 2.0 effectively empowers users to create mulsemedia applications. Furthermore, we discuss the integration of STEVE 2.0 with other multimedia technologies used for interactive digital TV, underscoring the importance of comprehensive platforms that support the entire life cycle of these applications, from production to distribution and rendering.
format Article
id doaj-art-12eba09fc83742b6982808908bb0d61d
institution DOAJ
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-12eba09fc83742b6982808908bb0d61d2025-08-20T03:24:01ZengIEEEIEEE Access2169-35362025-01-011310097010098610.1109/ACCESS.2025.357616711021610Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0Douglas Mattos0https://orcid.org/0000-0002-9887-4747Romulo Vieira1https://orcid.org/0000-0002-3066-4233Debora C. Muchaluat-Saade2https://orcid.org/0000-0002-1233-9736George Ghinea3https://orcid.org/0000-0003-2578-5580MídiaCom Laboratory, Fluminense Federal University (UFF), Niterói, BrazilMídiaCom Laboratory, Fluminense Federal University (UFF), Niterói, BrazilMídiaCom Laboratory, Fluminense Federal University (UFF), Niterói, BrazilDepartment of Computer Science, Brunel University of London, Uxbridge, U.K.The concept of Multiple Sensorial Media (mulsemedia) has been explored to enhance user experiences by engaging different senses beyond sight and hearing. The growing demand for developing such applications has led to various studies focusing on the mulsemedia authoring process. However, there remains a significant gap in accessible methods for developing these applications. This article addresses this issue by assessing an event-based approach to mulsemedia creation. We implemented this approach in the graphical authoring tool STEVE 2.0, which enables users to develop mulsemedia applications by defining event-based temporal relationships that synchronize traditional media with sensory effects. Additionally, STEVE 2.0 allows for the configuration of media presentation and sensory effect rendering properties. To assess the usability, features, and user experience of the tool, we conducted experiments with 44 participants. The results show that STEVE 2.0 effectively empowers users to create mulsemedia applications. Furthermore, we discuss the integration of STEVE 2.0 with other multimedia technologies used for interactive digital TV, underscoring the importance of comprehensive platforms that support the entire life cycle of these applications, from production to distribution and rendering.https://ieeexplore.ieee.org/document/11021610/Event-based synchronizationmulsemedia authoringmulsemedia toolsmultisensory applicationssensory effectsSTEVE
spellingShingle Douglas Mattos
Romulo Vieira
Debora C. Muchaluat-Saade
George Ghinea
Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0
IEEE Access
Event-based synchronization
mulsemedia authoring
mulsemedia tools
multisensory applications
sensory effects
STEVE
title Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0
title_full Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0
title_fullStr Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0
title_full_unstemmed Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0
title_short Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0
title_sort assessing mulsemedia authoring application based on events with steve 2 0
topic Event-based synchronization
mulsemedia authoring
mulsemedia tools
multisensory applications
sensory effects
STEVE
url https://ieeexplore.ieee.org/document/11021610/
work_keys_str_mv AT douglasmattos assessingmulsemediaauthoringapplicationbasedoneventswithsteve20
AT romulovieira assessingmulsemediaauthoringapplicationbasedoneventswithsteve20
AT deboracmuchaluatsaade assessingmulsemediaauthoringapplicationbasedoneventswithsteve20
AT georgeghinea assessingmulsemediaauthoringapplicationbasedoneventswithsteve20