Children with hearing impairments face ongoing challenges in language and motor development. MeloKids explores how multisensory feedback in virtual reality, integrating auditory, visual and tactile stimuli, can support their rehabilitation.

In pitch-matching tasks, children see and feel their own voice: pitch is mapped in real time to a visual trajectory in VR and to a vibrotactile array on the forearm. Using functional near-infrared spectroscopy (fNIRS), we measure cortical activation across interaction modes to inform personalized, interactive rehabilitation systems that strengthen cognitive engagement and motor control.