The KymeroClust algorithm was used to analyze human motion in order to perform live music. Preliminary results were presented at the International Conference on Computer Simulation of Musical Creativity (CSMC 2016) [Abernot et al. 2016], and a more detailed article has been published in the Journal of Creative Music Systems [Abernot et al. 2017]. This initial version aimed at combining an evolving music generation algorithm (Extramuros) with the EvoMove evolving motion-sensitive interface. The music generation algorithm generates live code that evolves during the dance performance, and the motion-sensitive algorithm also adapts its underlying clustering model continuously. Therefore, the system can be used as a dance-driven musical instrument that allows an immediate and evolving physical interaction with music. In practice, the system is split in two organisms: a host which generates music from input moves; and a symbiont which simplifies the representation of the input moves for the host. Both systems are organized in a commensal computation architecture, a way of organising artificially evolving system inspired by biological symbiotic relationships.
A recent paper describing the EvoMove system has been presented in the European Conference on Artificial Life (ECAL) [Peignier et al. 2017]. The system relies on wireless sensors to detect dancer moves. The sensor information is sent to KymeroClust, an evolutionary algorithm that identifies and maintains a clustering model of the move categories. The system uses this information to play audio samples according to the detected categories. These categories are not predefined, but are built dynamically by clustering the stream of data coming from the motion sensors. The EvoMove system has been tested by different users and subjective promising experiences were reported. Two demonstration videos produced with the dance company Anouskan have been uploaded on Youtube, as well as an informal presentation during an EvoEvo meeting. You can watch them hereafter:
Anouskan Experiment I
Anouskan Experiment II
EvoEvo meeting informal demonstration