Networked microcontrollers for accessible, distributed spatial audio

State-of-the-art systems for spatial and immersive audio are typically very costly, being reliant on specialist audio hardware capable of performing computationally intensive signal processing and delivering output to many tens, if not hundreds, of loudspeakers. Centralised systems of this sort suff...

Full description

Saved in:
Bibliographic Details
Main Authors: Thomas Albert Rushton, Romain Michon, Stefania Serafin, Tanguy Risset, Stéphane Letz
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-11-01
Series:Frontiers in Virtual Reality
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frvir.2024.1391987/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850063011702636544
author Thomas Albert Rushton
Romain Michon
Stefania Serafin
Tanguy Risset
Stéphane Letz
author_facet Thomas Albert Rushton
Romain Michon
Stefania Serafin
Tanguy Risset
Stéphane Letz
author_sort Thomas Albert Rushton
collection DOAJ
description State-of-the-art systems for spatial and immersive audio are typically very costly, being reliant on specialist audio hardware capable of performing computationally intensive signal processing and delivering output to many tens, if not hundreds, of loudspeakers. Centralised systems of this sort suffer from limited accessibility due to their inflexibility and expense. Building on the research of the past few decades in the transmission of audio data over computer networks, and the emergence in recent years of increasingly capable, low-cost microcontroller-based development platforms with support for both networking and audio functionality, we present a prototype decentralised, modular alternative. Having previously explored the feasibility of running a microcontroller device as a networked audio client, here we describe the development of a client-server system with improved scalability via multicast data transmission. The system operates on ubiquitous, commonplace computing and networking equipment, with a view to it being a simple, versatile, and highly-accessible platform, capable of granting users the freedom to explore audio spatialisation approaches at vastly reduced expense. Though faced by significant technical challenges, particularly with regard to maintaining synchronicity between distributed audio processors, the system produces perceptually plausible results. Findings are commensurate with a capability, with further development and research, to disrupt and democratise the fields of spatial and immersive audio.
format Article
id doaj-art-a3a76817a4e044fdb38ba0f0d5b36d8d
institution DOAJ
issn 2673-4192
language English
publishDate 2024-11-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Virtual Reality
spelling doaj-art-a3a76817a4e044fdb38ba0f0d5b36d8d2025-08-20T02:49:46ZengFrontiers Media S.A.Frontiers in Virtual Reality2673-41922024-11-01510.3389/frvir.2024.13919871391987Networked microcontrollers for accessible, distributed spatial audioThomas Albert Rushton0Romain Michon1Stefania Serafin2Tanguy Risset3Stéphane Letz4Inria, INSA Lyon, CITI, EA3720, Villeurbanne, FranceInria, INSA Lyon, CITI, EA3720, Villeurbanne, FranceDepartment of Architecture, Design and Media Technology, Aalborg University, Copenhagen, DenmarkInria, INSA Lyon, CITI, EA3720, Villeurbanne, FranceGRAME-CNCM, INSA Lyon, Inria, CITI, EA3720, Villeurbanne, FranceState-of-the-art systems for spatial and immersive audio are typically very costly, being reliant on specialist audio hardware capable of performing computationally intensive signal processing and delivering output to many tens, if not hundreds, of loudspeakers. Centralised systems of this sort suffer from limited accessibility due to their inflexibility and expense. Building on the research of the past few decades in the transmission of audio data over computer networks, and the emergence in recent years of increasingly capable, low-cost microcontroller-based development platforms with support for both networking and audio functionality, we present a prototype decentralised, modular alternative. Having previously explored the feasibility of running a microcontroller device as a networked audio client, here we describe the development of a client-server system with improved scalability via multicast data transmission. The system operates on ubiquitous, commonplace computing and networking equipment, with a view to it being a simple, versatile, and highly-accessible platform, capable of granting users the freedom to explore audio spatialisation approaches at vastly reduced expense. Though faced by significant technical challenges, particularly with regard to maintaining synchronicity between distributed audio processors, the system produces perceptually plausible results. Findings are commensurate with a capability, with further development and research, to disrupt and democratise the fields of spatial and immersive audio.https://www.frontiersin.org/articles/10.3389/frvir.2024.1391987/fullspatial audionetworked audiodistributed systemswave field synthesismicrocontrolleraccessibility
spellingShingle Thomas Albert Rushton
Romain Michon
Stefania Serafin
Tanguy Risset
Stéphane Letz
Networked microcontrollers for accessible, distributed spatial audio
Frontiers in Virtual Reality
spatial audio
networked audio
distributed systems
wave field synthesis
microcontroller
accessibility
title Networked microcontrollers for accessible, distributed spatial audio
title_full Networked microcontrollers for accessible, distributed spatial audio
title_fullStr Networked microcontrollers for accessible, distributed spatial audio
title_full_unstemmed Networked microcontrollers for accessible, distributed spatial audio
title_short Networked microcontrollers for accessible, distributed spatial audio
title_sort networked microcontrollers for accessible distributed spatial audio
topic spatial audio
networked audio
distributed systems
wave field synthesis
microcontroller
accessibility
url https://www.frontiersin.org/articles/10.3389/frvir.2024.1391987/full
work_keys_str_mv AT thomasalbertrushton networkedmicrocontrollersforaccessibledistributedspatialaudio
AT romainmichon networkedmicrocontrollersforaccessibledistributedspatialaudio
AT stefaniaserafin networkedmicrocontrollersforaccessibledistributedspatialaudio
AT tanguyrisset networkedmicrocontrollersforaccessibledistributedspatialaudio
AT stephaneletz networkedmicrocontrollersforaccessibledistributedspatialaudio