SENSORAMA: Multisensory Technologies for Adaptive XR Training
Partners: University of Bremen (Coordinator, Germany); IDENER Research & Development AIE (Spain); CNR (Italy); Haption (France); Institute of Entrepreneurship Development (Greece); EuroXR (Belgium); Leipzig University (Germany); Medical University of Graz (Austria); Chemnitz University of Technology (Germany); UMA – University of Málaga (Spain); VirtualiSurg (France); NeuroX Group (Switzerland); SenseGlove (Netherlands); Noise Makers (France); FAKT Software (Germany).
Programme: Horizon Europe
Call: HORIZON-CL4-2025-03
Topic: HORIZON-CL4-2025-03-HUMAN-14
Grant Agreement No.: 101297303
Duration: 36 months (September 2026 – August 2029)
Research team at UMA: Arcadio reyes-Lecuona (PI), María Cuevas-Rodríguez, Daniel González-Toledo, Pablo Gutiérrez-Parera
Overview
SENSORAMA develops multisensory extended-reality training, bringing together sight, sound, touch and temperature. Its approach combines coordinated rendering, improved haptic devices and adaptive interaction.
Five demonstrators will address hip arthroplasty, pedicle screw surgery, dentistry, anatomy education and industrial assembly.
Key Objectives
- Unified Representation: Connect sensory modalities through a common data model.
- Synchronised Rendering: Target multimodal latency of at most 20 ms.
- Haptic Interaction: Advance force-feedback, tactile and thermal technologies.
- Adaptive Training: Use physiological feedback and AI-driven scenario variations.
- Interoperability: Provide open SDKs/APIs compatible with OpenUSD, OpenXR and MPEG-I Haptics.
- Validation: Evaluate five training demonstrators with users.
UMA’s role
The University of Málaga (UMA) brings its experience in spatial audio, binaural rendering and interactive virtual acoustics to SENSORAMA. This contribution is intended to support the integration of spatial sound into the project’s multisensory XR training environments.
For more details, visit:
https://cordis.europa.eu/project/id/101297303
Publications by UMA
Gutierrez-Parera P; Arrebola F; Cuevas-Rodriguez M; Gonzalez-Toledo D; Molina-Tanco L; Reyes-Lecuona A
Hybrid ISM+BRIR convolution reverberation acoustic model with tuning of absorption coefficients based on single-position measurements Journal Article
In: Applied Acoustics, vol. 254, pp. 111448, 2026, ISSN: 0003-682X.
@article{GUTIERREZPARERA2026111448,
title = {Hybrid ISM+BRIR convolution reverberation acoustic model with tuning of absorption coefficients based on single-position measurements},
author = {Pablo Gutierrez-Parera and Fabian Arrebola and Maria Cuevas-Rodriguez and Daniel Gonzalez-Toledo and Luis Molina-Tanco and Arcadio Reyes-Lecuona},
url = {https://www.sciencedirect.com/science/article/pii/S0003682X26002306},
doi = {https://doi.org/10.1016/j.apacoust.2026.111448},
issn = {0003-682X},
year = {2026},
date = {2026-01-01},
urldate = {2026-01-01},
journal = {Applied Acoustics},
volume = {254},
pages = {111448},
abstract = {Spatial audio for Virtual and Augmented Reality requires perceptual fidelity and computational efficiency to deliver interactive, immersive experiences across dynamic environments. This paper presents a hybrid reverberation model to render real-time and perceptually convincing binaural room acoustics simulation by combining the Image Source Method (ISM) for early reflections with convolution of a given Binaural Room Impulse Response (BRIR) for late reverberation. The approach uses a single measurement at a fixed room position to derive frequency-dependent wall absorption coefficients by means of an iterative optimization based on a selected acoustic parameter. These coefficients are used for ISM rendering early reflections up to the perceptual mixing time, while the measured BRIR tail preserves the characteristics of the late reverberation, enabling the synthesis of different source-listener configurations. Objective evaluation and subjective tests were performed comparing simulations of the hybrid model against real room measurements. The results highlight the importance of parameter tuning and the early-late transition time for achieving perceptually plausible simulations. The proposed method provides a practical solution for generating spatially varying binaural responses from a limited set of measurements.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Spatial audio for Virtual and Augmented Reality requires perceptual fidelity and computational efficiency to deliver interactive, immersive experiences across dynamic environments. This paper presents a hybrid reverberation model to render real-time and perceptually convincing binaural room acoustics simulation by combining the Image Source Method (ISM) for early reflections with convolution of a given Binaural Room Impulse Response (BRIR) for late reverberation. The approach uses a single measurement at a fixed room position to derive frequency-dependent wall absorption coefficients by means of an iterative optimization based on a selected acoustic parameter. These coefficients are used for ISM rendering early reflections up to the perceptual mixing time, while the measured BRIR tail preserves the characteristics of the late reverberation, enabling the synthesis of different source-listener configurations. Objective evaluation and subjective tests were performed comparing simulations of the hybrid model against real room measurements. The results highlight the importance of parameter tuning and the early-late transition time for achieving perceptually plausible simulations. The proposed method provides a practical solution for generating spatially varying binaural responses from a limited set of measurements.
