Web Applications and Projects { Sound Music Movement } Interaction

CoMote

CoMote is a smartphone applications (iOS and Android) that allows for streaming motion data (accelerometer, gyroscope) from the smartphone to desktop applications using either the OSC protocol or Websockets. The network's setup is facilitated by the use of a QR code generated by the targeted remote application receiving the motion sensor data.

CoMote is especially designed for the CoMo applications family that enables real-time interaction between gestures/movements and sounds. Nevertheless, the CoMote application can be used with any software that makes use of the OSC protocol.

Among the CoMo applications that make use of CoMote are CoMo-Vox to learn and train conducting gestures, and CoMo-Elements to interact collectively thought body movements with recorded sounds.

CoMote and the CoMo applications are software designed and developed by IRCAM in the Sound-Music-Movement-Interaction team (UMR STMS).

Demo

Technical details

The CoMote application is open-source and available on Github: https://github.com/ircam-ismm/comote.

One of the main goal of the application is to provide unified axis and units across the different platforms. For this reason, we choose to follow the devicemotion W3C specification.

To integrate the CoMote application within your own application, we provide 2 different related packages for Node.js and Max/MSP. You can find more information on our dedicated github repository https://github.com/ircam-ismm/comote-helpers.

The Max/MSP package can be directly downloaded at the following url https://github.com/ircam-ismm/comote-helpers/releases/latest/download/CoMote.zip

If you want to adapat existing application using R-IoTs to CoMote, you can follow the conversion guildelines described here

Screenshots

Home
Configuration
Play mode

Credits

CoMote is developed by Ircam and the Music and Sound Science and Technology Joint Research Unit (STMS), supported by Ircam, CNRS, the French Ministry of Culture and Sorbonne University.

Produced with the support of the French Ministry of Education, Youth and Sports (Edu-up system), the National Research Agency (ELEMENT project), and in partnership with Radio France.