Music Coding Collective, Autumn week 8
Event details
In this Music Coding Collective session, the authors will present the Gestural Sound Toolkit (GST), a toolkit they have developed for rapid prototyping of gesture sound mappings using the Cycling'74 Max environment and MUBU library. The toolkit has been primarily developed using a research through design approach, and it is currently used as a pedagogical tool for teaching in Sound Design and Music Technology courses, movement and gestural analysis, sound synthesis, and mapping.
The toolkit works with a range of input sensors and deploys machine learning techniques allowing gesture recognition and personalised mappings of user movements to interactive sound playback and synthesis. The machine learning components of the toolkit enable static and temporal classification, as well as static and temporal regression. In addition to the technical demonstration of the toolkit, the authors will talk about the design process of the toolkit, current research projects at IRCAM and ISIR, and future directions of development.
Toolkit and installation instruction websites:
About the speakers
Alessandro Altavilla (School of Arts and Creative Technologies)
Alessandro Altavilla is a lecturer in Digital Creativity in the School of Arts and Creative Technologies at the University of York. His research and creative practice explores listening experience and embodied sonic interactions mediated by digital technology, through the design of interactive artefacts, installations, and performances.
Baptiste Caramiaux (McGill University)
Baptiste Caramiaux is a CNRS researcher at the Institute of Intelligent Systems and Robotics (ISIR), Sorbonne Université in Paris, and member of the HCI Sorbonne group. His research area is human-computer interaction (HCI), focusing on examining how machine learning (or artificial intelligence) algorithms can be used in various fields such as performing arts, health or pedagogy.
Frederic Bevilacqua (Institute for Research and Coordination in Music or IRCAM)
Frédéric Bevilacqua is the head of the Sound Music Movement Interaction team at IRCAM in Paris (part of the joint research lab Science and Technology for Music and Sound for IRCAM, CNRS and Sorbonne Université). His research concerns the modelling and the design of movement-sound interaction, and the development of gesture-based interactive systems.