Format

Send to

Choose Destination
Front Neurosci. 2016 Aug 25;10:385. doi: 10.3389/fnins.2016.00385. eCollection 2016.

Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies.

Author information

1
STMS Ircam-Centre National de la Recherche Scientifique-UPMC Paris, France.
2
STMS Ircam-Centre National de la Recherche Scientifique-UPMCParis, France; UMR7222 ISIR - Université Pierre et Marie CurieParis, France.
3
UMR7222 ISIR - Université Pierre et Marie Curie Paris, France.
4
UMR 8242 Centre National de la Recherche Scientifique - Université Paris Descartes Paris, France.

Abstract

This article reports on an interdisciplinary research project on movement sonification for sensori-motor learning. First, we describe different research fields which have contributed to movement sonification, from music technology including gesture-controlled sound synthesis, sonic interaction design, to research on sensori-motor learning with auditory-feedback. In particular, we propose to distinguish between sound-oriented tasks and movement-oriented tasks in experiments involving interactive sound feedback. We describe several research questions and recently published results on movement control, learning and perception. In particular, we studied the effect of the auditory feedback on movements considering several cases: from experiments on pointing and visuo-motor tracking to more complex tasks where interactive sound feedback can guide movements, or cases of sensory substitution where the auditory feedback can inform on object shapes. We also developed specific methodologies and technologies for designing the sonic feedback and movement sonification. We conclude with a discussion on key future research challenges in sensori-motor learning with movement sonification. We also point out toward promising applications such as rehabilitation, sport training or product design.

KEYWORDS:

interactive systems; learning; movement; sensori-motor; sonification; sound design

Supplemental Content

Full text links

Icon for Frontiers Media SA Icon for PubMed Central
Loading ...
Support Center