SONICOM: Transforming Auditory-Based Social Interaction in AR/VR
Partners: Imperial College London (Coordinator), Sorbonne Université, Austrian Academy of Sciences, University of Milan, National and Kapodistrian University of Athens, University of Glasgow, University of Málaga, Dreamwaves (Austria), Reactify (UK), USound (Austria).
Programme: Horizon 2020
Call: FETPROACT-EIC-07-2020
Grant Agreement No.: 101017743
Duration: January 2021 – June 2026
Principal Investigator at UMA: Arcadio Reyes-Lecuona
Research team at UMA: Luis Molina-Tanco, María Cuevas-Rodríguez, Daniel González-Toledo, Pablo Gutiérrez-Parera
Overview
SONICOM aims to redefine auditory-based social interactions in Augmented Reality (AR) and Virtual Reality (VR) environments. By leveraging Artificial Intelligence (AI), the project develops innovative immersive audio technologies that are personalized and realistic. Beyond auditory perception, SONICOM explores the behavioral, cognitive, and physiological effects of spatial audio, advancing how we experience sound in virtual and real-world settings.
Key Objectives
- Personalized Auditory Experiences: Develop sound models tailored to individual users.
- Enhanced AR/VR Communication: Study how spatial audio affects collaboration and interaction.
- Reproducible Research Tools: Provide open-source frameworks for auditory and psychoacoustic science.
- Behavioral Insights: Investigate how immersive audio influences cognition, behavior, and perception.
UMA’s Role
At the University of Málaga, led by Prof. Arcadio Reyes-Lecuona, the team is at the forefront of developing the Binaural Rendering Toolbox (BRT). This open-source library facilitates real-time spatial audio processing with advanced features like Head-Related Transfer Functions (HRTFs) and Binaural Room Impulse Responses (BRIRs). The BRT is central to psychoacoustic research and immersive AR/VR applications, enabling precise and customizable auditory experiences.
Publications by UMA
Cuevas-Rodriguez M; Gonzalez-Toledo D; Lawson A; Keren N; Reyes-Lecuona A
Addressing Acoustic Simulation Pitfalls in Virtual Reality for Occupational Safety Research Proceedings Article
In: Forum Acusticum 2025 – 11th Convention EAA, Málaga, Spain, 2025.
@inproceedings{Cuevas-Rodriguez2025,
title = {Addressing Acoustic Simulation Pitfalls in Virtual Reality for Occupational Safety Research},
author = {Maria Cuevas-Rodriguez and Daniel Gonzalez-Toledo and Andrew Lawson and Nir Keren and Arcadio Reyes-Lecuona},
year = {2025},
date = {2025-06-01},
booktitle = {Forum Acusticum 2025 - 11th Convention EAA},
address = {Málaga, Spain},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Lawson A; Gonzalez-Toledo D; Cuevas-Rodriguez M; Reyes-Lecuona A; Keren N
Protecting workers through advanced acoustic-virtual training: integrating sound simulation and immersive technology Proceedings Article
In: INTED 2025 – 19th International Technology, Education and Development Conference, pp. 1058–1058, Valencia, Spain, 2025.
@inproceedings{Lawson2025,
title = {Protecting workers through advanced acoustic-virtual training: integrating sound simulation and immersive technology},
author = {Andrew Lawson and Daniel Gonzalez-Toledo and Maria Cuevas-Rodriguez and Arcadio Reyes-Lecuona and Nir Keren},
url = {https://library.iated.org/view/LAWSON2025PRO},
doi = {10.21125/inted.2025.0353},
year = {2025},
date = {2025-03-01},
booktitle = {INTED 2025 - 19th International Technology, Education and Development Conference},
pages = {1058–1058},
address = {Valencia, Spain},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Vicente T; González-Toledo D; Cuevas-Rodríguez M; Molina-Tanco L; Reyes-Lecuona A; Picinali L
In: Hearing Research, pp. 109490, 2025, ISSN: 0378-5955.
@article{VICENTE2025109490,
title = {Exploring the relationship between task difficulty, head-related transfer function and spatial release from masking in a speech-on-speech experiment},
author = {Thibault Vicente and Daniel González-Toledo and María Cuevas-Rodríguez and Luis Molina-Tanco and Arcadio Reyes-Lecuona and Lorenzo Picinali},
url = {https://www.sciencedirect.com/science/article/pii/S0378595525003077},
doi = {https://doi.org/10.1016/j.heares.2025.109490},
issn = {0378-5955},
year = {2025},
date = {2025-01-01},
urldate = {2025-01-01},
journal = {Hearing Research},
pages = {109490},
abstract = {It is known that individuals make use of spatial hearing cues to improve the audibility of a target signal and separate it from competing sounds. This phenomenon is known as spatial release from masking (SRM). Recent research has shown that this happens also when sources are located in the median plane, where interaural differences are limited. When assessing this within virtual conditions, it has been shown that employing individually measured head-related transfer functions (HRTFs) results in higher SRM abilities compared to using non-individual filters. In a previously published work, we found that Spanish speakers benefit from individual HRTFs when discriminating a target English speech from a single masker in the median plane. This study replicates the protocol of that previous work, varying the number of maskers and participants’ English proficiency levels to explore relationships among task difficulty and HRTF use. Results from a first experiment show that English speakers behave differently to Spanish ones; their SRM advantage is not significant. We suggest that this is due to their language proficiency, which allows them to rely on spectral glimpsing alone, that is, exploiting spectro-temporal gaps between voices rather than spectral cues introduced by spatial separation. A second experiment introduces a second speech masker, co-located with the first; by making the task more complex, participants seem to increase their reliance on spatial cues, resulting in significant effects of masker position and HRTF. This highlights a trade-off between the use of target glimpsing and spatial cues and the need for further exploration into how task difficulty influences SRM with different HRTFs.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Reyes‐Lecuona A; Cuevas-Rodriguez M; Gonzalez-Toledo D; Gutierrez-Parera P
Binaural Rendering Toolbox (BRT). Una herramienta de auralización 3D en tiempo real para investigación en psicoacústica y realidad virtual Journal Article
In: Sociedad Española de Acústica SEA – Revista de Acústica, vol. 56, no. 1-2, pp. 3–12, 2025.
@article{ReyesLecuona2025,
title = {Binaural Rendering Toolbox (BRT). Una herramienta de auralización 3D en tiempo real para investigación en psicoacústica y realidad virtual},
author = {Arcadio Reyes‐Lecuona and Maria Cuevas-Rodriguez and Daniel Gonzalez-Toledo and Pablo Gutierrez-Parera},
year = {2025},
date = {2025-01-01},
journal = {Sociedad Española de Acústica SEA - Revista de Acústica},
volume = {56},
number = {1-2},
pages = {3–12},
abstract = {Binaural Rendering Toolbox (BRT) es un conjunto de herramientas diseñadas para la simulación acústica espacial 3D en tiempo real, que incluyen, como núcleo principal, una librería C++ de código abierto. Su arquitectura flexible permite la creación de cadenas de procesamiento personalizadas mediante modelos acústicos independientes de fuente, entorno y oyente, así como filtros postbinaurales. BRT se adapta a diversas aplicaciones en acústica aplicada, como la auralización de salas reales, la simulación de acústica virtual para realidad extendida interactiva y la investigación en psicoacústica. Este artículo presenta los conceptos clave que sustentan la herramienta e ilustra su funcionamiento mediante una serie de casos de uso representativos.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Gonzalez-Toledo D; Cuevas-Rodriguez M; Molina-Tanco L; Picinali L; Reyes-Lecuona A
New Release of the Binaural Rendering Toolbox: Introducing Version 2.0 Proceedings Article
In: Forum Acusticum 2025 – 11th Convention EAA, Málaga, Spain, 2025.
@inproceedings{Gonzalez-Toledo2025,
title = {New Release of the Binaural Rendering Toolbox: Introducing Version 2.0},
author = {Daniel Gonzalez-Toledo and Maria Cuevas-Rodriguez and Luis Molina-Tanco and Lorenzo Picinali and Arcadio Reyes-Lecuona},
year = {2025},
date = {2025-01-01},
booktitle = {Forum Acusticum 2025 - 11th Convention EAA},
address = {Málaga, Spain},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Reyes‐Lecuona A; Gonzalez-Toledo D; Cuevas-Rodriguez M
Renderizado de Audio Espacial en Realidad Virtual con el Binaural Rendering Toolbox (BRT) Journal Article
In: Interaccion – Revista Digital de AIPO, vol. 6, no. 1, pp. 51–61, 2025.
@article{ReyesLecuona2025a,
title = {Renderizado de Audio Espacial en Realidad Virtual con el Binaural Rendering Toolbox (BRT)},
author = {Arcadio Reyes‐Lecuona and Daniel Gonzalez-Toledo and Maria Cuevas-Rodriguez},
year = {2025},
date = {2025-01-01},
journal = {Interaccion - Revista Digital de AIPO},
volume = {6},
number = {1},
pages = {51–61},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Gutierrez-Parera P; Arrebola F; Cuevas-Rodriguez M; Gonzalez-Toledo D; Molina-Tanco L; Reyes-Lecuona A
Exploring simple methods for room absorption estimation in early reflections for binaural audio rendering Proceedings Article
In: Forum Acusticum 2025 – 11th Convention EAA, European Acoustics Association, Malaga, Spain, 2025.
@inproceedings{Gutierrez-Parera2025,
title = {Exploring simple methods for room absorption estimation in early reflections for binaural audio rendering},
author = {Pablo Gutierrez-Parera and Fabian Arrebola and Maria Cuevas-Rodriguez and Daniel Gonzalez-Toledo and Luis Molina-Tanco and Arcadio Reyes-Lecuona},
year = {2025},
date = {2025-01-01},
booktitle = {Forum Acusticum 2025 - 11th Convention EAA},
number = {June},
publisher = {European Acoustics Association},
address = {Malaga, Spain},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
González-Toledo D; Cuevas-Rodríguez M; Vicente T; Picinali L; Molina-Tanco L; Reyes-Lecuona A
Spatial release from masking in the median plane with non-native speakers using individual and mannequin head related transfer functions Journal Article
In: The Journal of the Acoustical Society of America, vol. 155, no. 1, pp. 284-293, 2024, ISSN: 0001-4966.
@article{10.1121/10.0024239,
title = {Spatial release from masking in the median plane with non-native speakers using individual and mannequin head related transfer functions},
author = {Daniel González-Toledo and María Cuevas-Rodríguez and Thibault Vicente and Lorenzo Picinali and Luis Molina-Tanco and Arcadio Reyes-Lecuona},
url = {https://doi.org/10.1121/10.0024239},
doi = {10.1121/10.0024239},
issn = {0001-4966},
year = {2024},
date = {2024-01-01},
urldate = {2024-01-01},
journal = {The Journal of the Acoustical Society of America},
volume = {155},
number = {1},
pages = {284-293},
abstract = {Spatial release from masking (SRM) in speech-on-speech tasks has been widely studied in the horizontal plane, where interaural cues play a fundamental role. Several studies have also observed SRM for sources located in the median plane, where (monaural) spectral cues are more important. However, a relatively unexplored research question concerns the impact of head-related transfer function (HRTF) personalisation on SRM, for example, whether using individually-measured HRTFs results in better performance if compared with the use of mannequin HRTFs. This study compares SRM in the median plane in a speech-on-speech virtual task rendered using both individual and mannequin HRTFs. SRM is obtained using English sentences with non-native English speakers. Our participants show lower SRM performances compared to those found by others using native English participants. Furthermore, SRM is significantly larger when the source is spatialised using the individual HRTF, and this effect is more marked for those with lower English proficiency. Further analyses using a spectral distortion metric and the estimation of the better-ear effect, show that the observed SRM can only partially be explained by HRTF-specific factors and that the effect of the familiarity with individual spatial cues is likely to be the most significant element driving these results.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Reyes-Lecuona A; Cuevas-Rodríguez M; González-Toledo D; Molina-Tanco L; Poirier-Quinot D; Picinali L
Hearing loss and hearing aid simulations for accessible user experience Proceedings Article
In: Proceedings of the XXIII International Conference on Human Computer Interaction, Association for Computing Machinery, Lleida, Spain, 2024, ISBN: 9798400707902.
@inproceedings{10.1145/3612783.3612816,
title = {Hearing loss and hearing aid simulations for accessible user experience},
author = {Arcadio Reyes-Lecuona and María Cuevas-Rodríguez and Daniel González-Toledo and Luis Molina-Tanco and David Poirier-Quinot and Lorenzo Picinali},
url = {https://doi.org/10.1145/3612783.3612816},
doi = {10.1145/3612783.3612816},
isbn = {9798400707902},
year = {2024},
date = {2024-01-01},
urldate = {2024-01-01},
booktitle = {Proceedings of the XXIII International Conference on Human Computer Interaction},
publisher = {Association for Computing Machinery},
address = {Lleida, Spain},
series = {Interaccion '23},
abstract = {This paper presents an open-source real-time hearing loss and hearing aids simulator implemented within the 3D Tune-In Toolkit C++ library. These simulators provide a valuable tool for improving auditory accessibility, promoting inclusivity and foster new research. The hearing loss simulator accurately simulates various types and levels of hearing loss, while the hearing aid simulator replicates different hearing aid technologies, allowing for the simulation of real-world hearing aid experiences. Both simulators are implemented to work in real-time, allowing for immediate feedback and adjustment during testing and development. As an open-source tool, the simulators can be customised and modified to meet specific needs, and the scientific community can collaborate and improve upon the algorithms. The technical details of the simulators and their implementation in the C++ library are presented, and the potential applications of the simulators are discussed, showing that they can be used as a valuable support software for UX designers to ensure the accessibility of their products to individuals with hearing impairment. Moreover, these simulators can be used to raise awareness about auditory accessibility issues. Overall, this paper also aims to provide some insight into the development and implementation of accessible technology for individuals with hearing impairments.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Gonzalez-Toledo D; Gutierrez-Parera P; Soto-Romero C; Cuevas-Rodriguez M; Reyes‐Lecuona A
A pilot experiment on user individualization for sound localization within interactive virtual environments Proceedings Article
In: 21st EuroXR International Conference, Athens, Greece, 2024.
@inproceedings{Gonzalez-Toledo2024,
title = {A pilot experiment on user individualization for sound localization within interactive virtual environments},
author = {Daniel Gonzalez-Toledo and Pablo Gutierrez-Parera and Carmen Soto-Romero and Maria Cuevas-Rodriguez and Arcadio Reyes‐Lecuona},
doi = {10.32040/2242-122X.2024.T4232},
year = {2024},
date = {2024-01-01},
urldate = {2024-01-01},
booktitle = {21st EuroXR International Conference},
address = {Athens, Greece},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Cuevas-Rodriguez M; González-Toledo D; Gutierrez-Parera P; Reyes-Lecuona A
An experiment replication on dynamic 3D sound loalisation using auditory Virtual Reality Proceedings Article
In: Proceedings of the 10th Convention of the European Acoustics Association, 2023.
@inproceedings{ForumAcusticum2023Experiment,
title = {An experiment replication on dynamic 3D sound loalisation using auditory Virtual Reality},
author = {Maria Cuevas-Rodriguez and Daniel González-Toledo and Pablo Gutierrez-Parera and Arcadio Reyes-Lecuona},
url = {https://dael.euracoustics.org/confs/landing_pages/fa2023/000744.html},
year = {2023},
date = {2023-09-01},
urldate = {2023-09-01},
booktitle = {Proceedings of the 10th Convention of the European Acoustics Association},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
González-Toledo D; Molina-Tanco L; Cuevas-Rodríguez M; Majdak P; Reyes-Lecuona A
The Binaural Rendering Toolbox. A Virtual Laboratory for Reproducible Research in Psychoacoustics Proceedings Article
In: Proceedings of the 10th Convention of the European Acoustics Association, 2023.
@inproceedings{ForumAcusticum2023BRT,
title = {The Binaural Rendering Toolbox. A Virtual Laboratory for Reproducible Research in Psychoacoustics},
author = {Daniel González-Toledo and Luis Molina-Tanco and María Cuevas-Rodríguez and Piotr Majdak and Arcadio Reyes-Lecuona},
url = {https://dael.euracoustics.org/confs/landing_pages/fa2023/001042.html},
year = {2023},
date = {2023-09-01},
urldate = {2023-09-01},
booktitle = {Proceedings of the 10th Convention of the European Acoustics Association},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Picinali L; Katz B F; Geronazzo M; Majdak P; Reyes-Lecuona A; Vinciarelli A
The SONICOM Project: Artificial Intelligence-Driven Immersive Audio, From Personalization to Modeling [Applications Corner] Journal Article
In: IEEE Signal Processing Magazine, vol. 39, no. 6, pp. 85-88, 2022.
@article{9931551,
title = {The SONICOM Project: Artificial Intelligence-Driven Immersive Audio, From Personalization to Modeling [Applications Corner]},
author = {Lorenzo Picinali and Brian FG Katz and Michele Geronazzo and Piotr Majdak and Arcadio Reyes-Lecuona and Alessandro Vinciarelli},
url = {https://ieeexplore.ieee.org/document/9931551},
doi = {10.1109/MSP.2022.3182929},
year = {2022},
date = {2022-01-01},
journal = {IEEE Signal Processing Magazine},
volume = {39},
number = {6},
pages = {85-88},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Arrebola F; Gonzalez-Toledo D; Garcia-Jimenez P; Molina-Tanco L; Cuevas-Rodriguez M; Reyes-Lecuona A
Simulación en tiempo real de las reflexiones tempranas mediante el método de las imágenes Proceedings Article
In: 53 Congreso Español de Acústica -TECNIACUSTICA 2022., 2022.
@inproceedings{arrebola2022simulacion,
title = {Simulación en tiempo real de las reflexiones tempranas mediante el método de las imágenes},
author = {F. Arrebola and D. Gonzalez-Toledo and P Garcia-Jimenez and L. Molina-Tanco and M. Cuevas-Rodriguez and A. Reyes-Lecuona},
url = {https://documentacion.sea-acustica.es/publicaciones/Elche22/ID-99.pdf},
year = {2022},
date = {2022-01-01},
urldate = {2022-01-01},
booktitle = {53 Congreso Español de Acústica -TECNIACUSTICA 2022.},
abstract = {Se presenta una herramienta de código abierto para simular las reflexiones tempranas de una sala mediante el método de las imágenes. Para ello, el orden de reflexión y la distancia máxima de las fuentes espejo son controlables por el usuario. Asimismo, son configurables la geometría y los perfiles de absorción de las paredes. Se trata de una extensión del 3D Tune-In Toolkit, en la que se ha añadido la simulación del retardo de propagación y la implementación del método de las imágenes. Esta simulación de reverberación se puede completar con otros renderizadores mediante una aproximación hibrida.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Cuevas-Rodríguez M; González-Toledo D; Reyes-Lecuona A; Picinali L
Impact of non-individualised head related transfer functions on speech-in-noise performances within a synthesised virtual environment Journal Article
In: The Journal of the Acoustical Society of America, vol. 149, no. 4, pp. 2573–2586, 2021, ISSN: 0001-4966.
@article{Imp/2021,
title = {Impact of non-individualised head related transfer functions on speech-in-noise performances within a synthesised virtual environment},
author = {María Cuevas-Rodríguez and Daniel González-Toledo and Arcadio Reyes-Lecuona and Lorenzo Picinali},
url = {https://asa.scitation.org/doi/10.1121/10.0004220},
doi = {10.1121/10.0004220},
issn = {0001-4966},
year = {2021},
date = {2021-04-01},
urldate = {2021-04-01},
journal = {The Journal of the Acoustical Society of America},
volume = {149},
number = {4},
pages = {2573–2586},
abstract = {When performing binaural spatialisation, it is widely accepted that the choice of the head related transfer functions (HRTFs), and in particular the use of individually measured ones, can have an impact on localisation accuracy, externalization, and overall realism. Yet the impact of HRTF choices on speech-in-noise performances in cocktail party-like scenarios has not been investigated in depth. This paper introduces a study where 22 participants were presented with a frontal speech target and two lateral maskers, spatialised using a set of non-individual HRTFs. Speech reception threshold (SRT) was measured for each HRTF. Furthermore, using the SRT predicted by an existing speech perception model, the measured values were compensated in the attempt to remove overall HRTF-specific benefits. Results show significant overall differences among the SRTs measured using different HRTFs, consistently with the results predicted by the model. Individual differences between participants related to their SRT performances using different HRTFs could also be found, but their significance was reduced after the compensation. The implications of these findings are relevant to several research areas related to spatial hearing and speech perception, suggesting that when testing speech-in-noise performances within binaurally rendered virtual environments, the choice of the HRTF for each individual should be carefully considered.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Reyes-Lecuona A; Márquez-Moncada A; Luis B H; González-Toledo D; Cuevas-Rodriguez M; Molina-Tanco L
Binaural Audio and Rotation Gain in Virtual Environments Journal Article
In: Interaccion – Revista Digital de AIPO, vol. 2, iss. 2, pp. 54-62, 2021.
@article{Reyes-Lecuona2021c,
title = {Binaural Audio and Rotation Gain in Virtual Environments},
author = {Arcadio Reyes-Lecuona and Ana Márquez-Moncada and Bottcher Hauke Luis and Daniel González-Toledo and María Cuevas-Rodriguez and Luis Molina-Tanco},
year = {2021},
date = {2021-01-01},
urldate = {2021-01-01},
journal = {Interaccion - Revista Digital de AIPO},
volume = {2},
issue = {2},
pages = {54-62},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
