The system was developed at CYENS – Centre of Excellence totally from scratch. The system appears in the form of an intelligent virtual mirror, where a digital twin of the user (the musician) appears in a full-body 3D representation and is augmented with musculoskeletal corrective feedback. The advantage of this is that the user can observe themselves from different view-angles (for example from behind) and at the same time toggle various muscular and postural biofeedback parameters which are provided to the user in real-time. Muscular feedback is provided via heat maps where the user can see the muscular activity of each of their muscles along with any sign of asymmetry between contralateral muscles. Skeletal-related feedback is provided about the wrists, shoulders, feet, and spine.
A second component of the TONE project is AirTone. It is a game that is aimed at musicians with chronic pain and aims to allow them to play music for a longer time. The game is an endless-runner where the musician controls a flying vehicle using the sound coming out from the instrument and collects musical notes that each have different properties. Three different levels have been implemented along with customization parameters that can adapt gameplay based on the musicians’ instrument and style of play.
Both components of the project have been evaluated in ongoing user studies.
2nd Opportunity “Call of the “RESTART 2016-2020” Program for Research, Technological Development, and Innovation – September 2020 – May 2021
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 101028715.
University of Cyprus
IMMM Institue of Music Physiology and Musicians’ Medicine.
Biofeedback, musculoskeletal disorders, musicians, technology, VR
Participant/ Christos quote
Dr Christos Ioannou