Jaime Arias, Myriam Desainte-Catherine and Shlomo Dubnov Université de Bordeaux, LaBRI, UMR 5800 Inria - Bordeaux Sud-Ouest University of California, San Diego, CREL MuMe Workshop International Conference on Computational Creativity June 27, 2016
Exchange for Meta-Creation Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 1/20 1/20
An incomplete knowledge of the system is an essential feature Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 2/20 2/20
in 19 fragments Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 3/20 3/20
https://github.com/himito/i-score • VMO-Score: https://himito.github.io/vmo_i-score_generator Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 4/20 4/20
(VMO) Audio Segmentation Audio Oracle SNAKES Petri Net Model input output output input output Configuration File output (a) Generation of the structure Petri Net Model Offline Improviser output input input Audio Synthesizer Audio File output input Audio Oracle input Petri Net Parameters Actions Oracle Parameters Performer Controls Configuration File Oracle Regions Sequence Audio Buffer input (b) Offline improvisation Figure: Improvisation Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 5/20 5/20
(VMO) Audio Segmentation Audio Oracle SNAKES Petri Net Model input output output input output Configuration File output (a) Generation of the structure Petri Net Model Audio Oracle i-score Petri Net Parameters Configuration File PyOracle input input input Real-time Performer Controls input input inout Real-time Audio Output Output (b) Real-time improvisation Figure: Composition Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 6/20 6/20
University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 7/20 7/20
before firing the enabled transition t. G D C t (b) The marking after firing transition t, where t is disabled. Figure: Illustration of a firing rule in a Petri Net. Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 10/20 10/20
t3 t4 t5 t6 t7 t8 t9 t10 t11 Figure: Timed Petri Net Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 11/20 11/20
3 actions: 4 - address : '/volume/sensor/pos_x' 5 value : 10 6 time : 250 7 8 - address : ... Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 13/20 13/20
3.0] Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 14/20 14/20
(a,v,t) /device/key == 10 [0.0, 3.0] (b) i-score Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 15/20 15/20
/device/key) ∧ (v == 10) ∧ (t == get_time()) [0.0, 3.0] Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 16/20 16/20
get_time() > t (a == /device/key) ∧ (v == 10) ∧ (t == get_time()) [0.0, 3.0] Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 17/20 17/20
with concurrency control • Improvisation as a stylistic combinatorial system • Open form establishes a set of conditions and actions for synchronization • Generalizes and automates existing DAW tools (session view - clip, follow...) Combinatorial systems date back to ars inventendi (Leibniz) and are the core of ars magna (great art) of the Franciscan monk Ramon Llull (1232-1316), as well as the ecstatic Kabbalah of Abraham Abulafia (1240-1291), and Renaissance philosophers such as Giordano Bruno (1548-1600). ’́One should not pay attention to the properties of terms but only to the fact that they define an order, a texture, an architecture‘̀ U. Eco, The Search for the Perfect Language, Wiley-Blackwell 1997 Shlomo Dubnov - University of California, San Diego - CREL (2016) Automatic Construction of Interactive Machine Improvisation Scenarios from Audio Recordings 20/20 20/20
Jaime Arias, Myriam Desainte-Catherine and Shlomo Dubnov Université de Bordeaux, LaBRI, UMR 5800 Inria - Bordeaux Sud-Ouest University of California, San Diego, CREL MuMe Workshop International Conference on Computational Creativity June 27, 2016