Share
Embed
Survey of programming languages for sound and music
2021/03/19 SIGPX #8
Tomoya Matsuura
March 19, 2021
Transcript
32 slides
-
• ਆಸݝכϲ࡚ࢢग़(1994) • ਆಸ૯߹ߴߍଔ(2013) • ౦ژܳज़େֶԻָڥՊଔ(2017) • भେֶେֶӃܳज़ֶ म࢜/ത࢜ޙظ՝ఔ(2017,2019~)
• ࿇পࣥଠϑϧϑΟϧ(2018~) • YCAM(Intern,2015),teamlab(2015~2017), School for Poetic Computation(2018) ࣗݾհ 2 photo: Takehiro Goto -
3 minimal musical medium / a programming language as an
Infrastructure for sound & music. https://github.com/mimium-org/mimium 3 -
• Իָϓϩάϥϛϯάݴޠͷ֓೦తཧɺൺֱΛͨ͠ࢿྉ͕গͳ͍ • ಛʹ࣮ऀ͔Βݟͨڞ௨ͷޠኮɺඞཁͳ͕ࣝڞ༗͞Ε͓ͯΒ ͣɺԻָͷͨΊͷݴޠΛ࡞Δϋʔυϧ͕ߴ͍ɺධՁ͢Δͷ͕͠ ͍ • ۩ମతࣄྫͷࡉ͔͍հաڈͷαʔϕΠʹͳΔͤͯ͘ཧ తཧΛ͍ͨ͠ •
ࠓճಛʹϦΞϧλΠϜ৴߸ॲཧͰ͖ΔݴޠΛத৺ʹ͠·͢ ൃදࣗମͷత 4 -
• ԻָϓϩάϥϛϯάݴޠΛ࡞Δత • ԻָϓϩάϥϛϯάݴޠͷաڈͷαʔϕΠ • දతͳڥͷհ • 2000Ҏޙͷݴޠઃܭʹ͓͚Δओཁͳ՝ • ݴޠͷ࣮ύλʔϯͱΞʔΩςΫνϟ
• ݴޠΛಛ͚ͮΔཁૉͱಛͷྨ • ·ͱΊɺະདྷͷԻָݴޠͷ͋Γํ ߏ 5 -
ԻָʹίϯϐϡʔλʔΛ༻͍ΔϞνϕʔγϣϯ ԻָϓϩάϥϛϯάݴޠΛ࡞ΔϞνϕʔγϣϯ • ϋʔυΣΞૢ࡞ʢϝϞϦɺεϨουɺεέδϡʔϦϯάʣ ͷӅṭʢԻָՈϝϞϦͷ͜ͱΛؾʹͨ͘͠ͳ͍ʣ • ԋ/࡞ۂΠϯλʔϑΣʔεͱͯ͠ͷϓϩάϥϛϯάʢLive Codingʣ • ϝσΟϜͱͯ͠ͷιʔείʔυʢ#SC140ɺMMLςΩετԻָαΫϥͳͲʣ
• ϓϩάϥϛϯάڭҭͷπʔϧͱͯ͠(EarSketch,Sonic Pi) Իָϓϩάϥϛϯάݴޠͷత 6 • ίϯϐϡʔλʔͰͳ͚ΕෆՄೳͳදݱɺ৽͍͠දݱʢmicrosoundͳͲʣ • ݱ࣮ͷָثɺڥͷγϛϡϨʔτ(VSTɺཧϞσϦϯά߹) -
• "Languages for Computer Music”,Frontiers in Digital Humanities(2018), Roger B.
Dannenberg • ԻָݴޠΛಛ͚ͮΔ6ཁૉͷఏҊɺԻָݴޠҰൠʹڞ௨͢Δ՝ͷཧ • “Computer Music Languages and Systems: The Synergy Between Technology and Creativity”,pp 1-49 in Handbook of Digital Games and Entertainment Technologies(2016),Hiroki Nishino and Ryohei Nakatsu • “The Development of Computer Music Programming Systems”, Journal of New Music research,42(1), pp97-100(2013) Victor Lazzrini • ↑2ͭओʹྺ࢙త؍ͷཧ • “Idiomatic Patterns and Aesthetic Influence in Computer Music Languages”, Organized Sound,25(1),pp53-63(2020),Andrew Mcpherson and Koray Tahlroǧlu • Իָϓϩάϥϛϯάڥ͕ͲͷΑ͏ʹͦͷݴޠݻ༗ͷදݱΛੜΈग़͢ͷ͔ΛΠϯλϏϡʔ͔Β ԻָϓϩάϥϛϯάݴޠͷαʔϕΠ 7 -
ԻָϓϩάϥϛϯάݴޠҰཡ 9 l-BOHVBHFTGPS$PNQVUFS.VTJD 3PHFS#%BOOFOCFSHz 'SPOUJFSTJO%JHJUBM)VNBOJUJFT /PW ՃචদӜ Overtone Sam Aaron
(2011?) Sonic PI Sam Aaron (2012) TidalCycles Alex Mclean (2006~) Chronic Eli Blandt (2002) Kronos Versa Norilo (2015) LC Hiroki Nishino (2013) ixi lang Thor Magnusson (2012) Gibber Charlie Roberts (2012) FoxDot Jean-François Parent (2015) Extempore Andrew Sorensen (2012) impromptu Andrew Sorensen (2010) Common Lisp Music Bill Schottstaedt (1989) SuperCollider- Clients SOUL ROLI (2018) Vult Leonardo Laguna Ruiz (2016) mimium Tomoya Matsuura (2020) Gwion Jérémie Astor (2017) ଞɺmidiϨϕϧΛϝΠϯͷରʹͨ͠ڥʹAlda(2012)Takt(2014)ɺORCΛ(2017)ͳͲ -
ྺུ࢙֓ 11 50s~80s DSPϋʔυΣΞʹର͢Δ໋ྩ 90s~ All CPUɺ൚༻OS্ͰͷϦΞϧλΠϜॲཧ(Max,Pd,SC,CSound) 00s~ ৴߸ॲཧͷJITίϯύΠϧ/τϥϯεύΠϧ(Faust,Soul,Vult) ಛఆͷදݱʹಛԽͨ͠DSL
in DSL(Sonic Pi,TidalCycles) Πϕϯτॲཧͷਖ਼֬ͳεέδϡʔϦϯά(ChucK,Extempore) -
1.ΠϕϯτεέδϡʔϦϯά 13 ΦʔσΟΦόοϑΝʢྫ:256αϯϓϧʣຖʹΠϕϯτΩϡʔΛফԽ PuredataɺSuperColliderͳͲ ಉظ(Synchronous) ཧ࣌ؒʢLogical TimeʣͰॱংΛอূ ChucK,Gwion,mimiumͳͲ w ࣮ΘΓͱ؆୯ɺಈ࡞ܰྔ
w .*%*6%1ͳͲ*0བྷΈͷ͕࣌ؒਖ਼֬Ͱͳ͍ w $PODVSSFOUͳॲཧʹ࠷దԽ͠Α͏ͱࢥ͏ͱେม w *0ؔ࿈ൺֱతਖ਼֬ʹॲཧͰ͖Δ w εϨου҆શͳ࣮ͭΒ͍ w ཁݸผ04ຖͷରԠɺΈࠐΈͱ͔ʹҠ২ͮ͠Β͍ ඇಉظ(Asynchronous) εϨου͚ͯϦΞϧλΠϜεέδϡʔϧ Max※,ExtemporeͳͲ ※ਖ਼֬ʹMaxΦʔσΟΦͱεϨουΛ͚͍ͯΔ͕ΦʔσΟΦͱผϨʔτ(ඪ४ 20msຖ)ͰΠϕϯτΩϡʔΛpoll͍ͯ͠Δɻ ExtemporeλεΫͪ࣌ؒΛܭࢉͯ͠λεΫ͕͋Δ࣌ͷΈىಈ ϋΠϒϦου Ϣʔβʔ͕໌ࣔͯ͠ಉظ/ඇಉظΛΓସ͑ LC(Nishino2013)ͳͲ ྫɿͽͬͨΓαϯϓϧຖʹมΛมߋ͍ͨ͠ʜ ͚Ͳຖαϯϓϧॲཧ͢Δͷա ྫɿͽͬͨΓαϯϓϧຖʹมΛมߋ͍ͨ͠ʜ ͚Ͳຖαϯϓϧॲཧ͢Δͷա -
• PdSCͰ༻ҙ͞ΕͨجຊϞδϡʔϧɿUnit GeneratorʢUGenɺΦγϨʔλ ϑΟϧλͷ͜ͱʣΛΈ߹ΘͤΔ͜ͱͰ৴߸ॲཧΛهड़Ͱ͖Δ • ৽͍͠جຊϞδϡʔϧΛ࡞Γͨ͘ͳͬͨΒͲ͏͢Δʁ →C or C++ͰϓϥάΠϯ࡞ͬͯͶʢͭΒ͍ʣ •
JITίϯύΠϧ͢ΕύϑΥʔϚϯεΛଛͳΘͣ৴߸ॲཧΛهड़Ͱ͖ΔͷͰʁ • DSPܥݴޠɿFaust,Soul,Vult,Kronos • JITͷόοΫΤϯυ͍͍ͩͨLLVMɺCC++ίʔυͱͯ͠τϥϯεύΠϧͰ͖Δ ͷଟ͍ɻWebAssemblyհͯ͠ϒϥβͰಈ࡞͢Δͷ • ɿDSPݴޠࣗମεέδϡʔϦϯάͷSemanticsΛ࣋ͨͳ͍ͷ͕΄ͱΜͲ 2.ϨΠϠͷ֦ுੑ 14 -
• ϦζϜύλʔϯ/Ի֊/Իͱ͍ͬͨߴ࣍ͷύϥϝʔλΛϓϩάϥϜ͢Δʹ ݴޠͷநԽೳྗʢಛʹܕ·ΘΓʣ͕Γͳ͍ • ྫ͑PdͩͱϓϦϛςΟϒͱϓϦϛςΟϒ͔ΒΔϦετ͔͠ѻ͑ͳ͍ • ϙϐϡϥʔͳղܾࡦɿSuperColliderΛωοτϫʔΫίϚϯυͰૢ࡞Ͱ͖Δ γϯηαΠβʔͱ͍ͯ͠ɺ৽͍͠DSLΛ࡞Δ • SCv3ΑΓૄ݁߹ͳαʔόʔɾΫϥΠΞϯτϞσϧΛ࠾༻ɺ৽͍͠γϯηͷఆٛ(SynthDef)Ҏ֎
΄΅ͳΜͰOSC(UDP্ͷ؆қϓϩτίϧ)Ͱૢ࡞Մೳ • Sonic Pi(Ruby+Erlang)ɺixi(Ruby)ɺFoxDot(Python)ɺTidalCycles(Haskell)ɺOvertone(Clojure)ͳͲ • ɿωοτϫʔΫίϚϯυͷਖ਼֬ͳεέδϡʔϦϯάΛ…(σδϟϰ) 3.ߴϨΠϠͷ֦ுੑ 15 DSL on DSLͷϗετͷબࢶ࣮࣭SuperColliderҰͳͷ͕ݱঢ় -
• ࣈ۟ղੳ • ݴޠ֦ு • ݴޠಛघԽ • ύΠϓϥΠϯ • ιʔεtoιʔεม
SpinellisʹΑΔDSL࣮ͷσβΠϯύλʔϯΑΓൈਮ Ͳ͏࣮ͬͯ͢Δʁ 16 Diomidis Spinellis. Notable design patterns for domain specific languages. Journal of Systems and Software, 56(1):91–99, February 2001. (doi:10.1016/S0164-1212(00)00089-3) Ұ൪ετϨʔτͳΞϓϩʔνɺࣗ༝ߴ͍͕࣮େม ԋࢉࢠΦʔόʔϩʔυϚΫϩͳͲɺࣗ༝ϗετݴޠ࣍ୈ ϘΠϥʔϓϨʔτͱΈ߹ΘͤͨΓɺҰ෦ͷػೳ͚ͩ͏ Cͷιʔεʹมͨ͠Γ͢Δ͜ͱͰόοΫΤϯυ؆ུԽ SuperColliderʹ৴߸ॲཧ෦͓ͤ -
SuperColliderʹΑΔه๏ 17 { var noise = PinkNoise.ar(0.2); noise = Mix.new(Array.fill(10,
{arg i; Resonz.ar(noise, i * 800 + 200, 0.05)})); noise = (noise * 0.2 + noise * Decay.kr(Dust.kr(0.5),10)); noise = RHPF.ar(noise, LFNoise0.kr(0.5).range(220, 880), rq:0.001); CombL.ar(noise, delaytime:0.5, decaytime:25).dup() * 0.5 }.play; (-> noise = PinkNoise.ar(0.2) noise = Mix Array.fill 10, (i)-> Resonz.ar(noise, i * 800 + 200, 0.05) noise = (noise * 0.2 + noise * Decay.kr(Dust.kr(0.5), 10)) noise = RHPF.ar(noise, LFNoise0.kr(0.5).range(220, 880), rq:0.001) CombL.ar(noise, delaytime:0.5, decaytime:25).dup() * 0.5 ).play() CoffeColliderʹΑΔه๏ CoffeeScriptͷԋࢉࢠΦʔόʔϩʔυ͚ͩͰՄೳͳݶΓه๏Λࣅ͍ͤͯΔ http://mohayonao.github.io/CoffeeCollider/#noise.coffee -
• $#ϗετݴޠͰ͋ΔHaskellʹ͓͚Δதஔԋࢉࢠ(ݴޠ֦ு) • soundgainɺeveryͳͲHaskell্ͰϥΠϒϥϦͱͯ͠ఆٛ͞Εͨؔ • “”Ͱғ·Εͨ෦Haskell্Ͱͨͩͷจࣈྻ • Parsecͱ͍͏Haskellͷࣈ۟ղੳϥΠϒϥϦͰ෦తʹύʔε͍ͯ͠Δ • ϢʔβʔHaskellͷؔఆٛܕએݴͳͲߴͳจ๏ΛΔඞཁͳ͍
ʢݴޠಛघԽʣ • TidalCyclesSuperColliderʹରͯ͠OSCΛૹΓԻΛग़͢(ύΠϓϥΠϯ) HybridͳྫɿTidalCycles 18 d1 $ sound "bd*4" # gain (every 3 (rev) $ "1 0.8 0.5 0.7") ಉ༷ͳྫͱͯ͠FoxDot(ϗετݴޠ:Python)ͳͲ -
ԻָݴޠͷΞʔΩςΫνϟ 19 ίϯύΠϥ/ ΠϯλϓϦλ ϥϯλΠϜ ιʔείʔυ (ςΩετσʔλ) தؒදݱ UGenάϥϑߏ VM໋ྩྻ
Ϛγϯίʔυ ϨΠϠʔ ߴ ϥΠϒϥϦ ҙຯ֦ு • தؒදݱͷཻʹΑͬͯදݱͷ෯ಈతมߋͷ͕͢͠͞มΘͬͯ͘Δ 50~80sɿ DSPϋʔυΣΞ 00s: UGen -
ϏδϡΞϧݴޠͷ߹ 20 ίϯύΠϥ/ ΠϯλϓϦλ ϥϯλΠϜ ιʔείʔυ (ςΩετ/όΠφϦσʔλ) தؒදݱ UGenάϥϑߏ VM໋ྩྻ
Ϛγϯίʔυ ϨΠϠʔ ߴ ϏδϡΞϥΠβ ʢIDEʣ ֮/ฤू Մೳͳදݱ ϥΠϒϥϦ ҙຯ֦ு • ͋Δҙຯී௨ͷݴޠUTF-8ͳͲܾ·ͬͨόΠφϦσʔλΛɺςΩετͱ͍͏ਓؒʹೝࣝՄ ೳͳදݱʹม͍ͯ͠ΔͷͰ͜ͷਤʹͯΊΔ͜ͱͰ͖Δ -
தؒදݱͻͱͭͱݶΒͳ͍ 21 ϥϯλΠϜ ιʔείʔυ (ςΩετ/όΠφϦσʔλ) ϏδϡΞϥΠβ ʢIDEʣ ֮/ฤू Մೳͳදݱ ίϯύΠϥ/
ΠϯλϓϦλ தؒදݱ ϥΠϒϥϦ ίϯύΠϥ/ ΠϯλϓϦλ தؒදݱ ϥΠϒϥϦ ίϯύΠϥ/ ΠϯλϓϦλ தؒදݱ ϥΠϒϥϦ -
TidalCyclesͷྫ 22 HaskellΠϯλϓϦλ(GHCI) TidalCycles BP ύʔα ύλʔϯ ϥΠϒϥϦ ιʔείʔυ (ςΩετσʔλ)
ҙຯ֦ு SC ΫϥΠΞϯτ OSC ϝοηʔδ SCSynth Pattern σʔλ • ʢ͍·͍ͪ͏·͘ਤࣔͰ͖ͳ͍ʣ -
• Syntax(౷ޠ) • Semantics(ҙຯ) • Runtime • Libraries • Programming
Environments(IDE) • Community&Resources Dannenbergʢ2018ʣʹΑΔ ԻָݴޠΛಛ͚ͮΔཁૉ 23 -
• ͜͜ͰͷExpressivenessͱ“ಡΈ͘͢ॻ͖͍͢”ɺ Generalͱ“Մೳͳදݱͷൣғ͕͍”ͱ͍͏ҙຯ Expressive vs General 24 E. Brandt, “Temporal
type constructors for computer music programming,” School of Computer Science, Carnegie Mellon University, 2002. ࣮ࡍʹ࣮ߦ࣌ύϑΥʔϚϯε͕ ѱ͘ͳΔͱ͍͏৽ͨͳτϨʔυΦ ϑ͕ൃੜ͍ͯ͠Δ -
3ͭͷہॴԽͱ3ͭͷޮੑ ཁૉ͕༩͑ΔಛͷྨʢͷҊʣ 26 6ͭΛશ෦৳͢ͷݫ͘͠ɺτϨʔυΦϑ͕͋Δ Expression Generality දݱͷہॴੑ Platform Independency ڥͷہॴੑ
Dynamic Modification ܧଓత࣮ߦͷہॴੑ Runtime Efficiency ࣮ߦ࣌ͷܭࢉίετ Learning Efficiency Ϣʔβʔͷֶशίετ Development Efficiency ։ൃίετ গͳ͘ͱɺ“͋ΒΏΔڥͰ͋ΒΏΔදݱ͕Ͱ͖ɺಈతมߋ͠·͘Εͯײతʹ͍͢ ࣮͘ߦωΠςΟϒฒΈ”ͷݴޠΛ࡞Ζ͏ͱ͢Δͱ։ൃίετ͕ͱΜͰͳ͍͜ͱʹͳΔ -
27 Syntax Semantics Runtime Libraries Programming Environment Community Resources Development
Efficiency Runtime Efficiency Learning Efficiency Expression Generality Dynamic Modification ֤ཁૉͱಛͷؔ Platform Independency …ຊʹ͜ΕΒͷཁૉ͚ͩͰݴޠΛධՁͰ͖ΔͷͩΖ͏͔ʁ -
Idiomaticity ྔతධՁͰ͖ͳ͍ಛ 28 • ཁɿݴޠʹ͓͚ΔཧతʹՄೳͳදݱͰ͖Δൣғ͕ಉͩͬͨ͡ ͱͯ͠ɺͦΕͧΕͷݴޠ͕༠ൃ͢Δදݱͷ࣭ɿIdiomacticity ҟͳΔ • ݴΘΕͯΈΔͱ͋ͨΓ·͑ l*EJPNBUJD1BUUFSOTBOE"FTUIFUJD*OqVFODFJO$PNQVUFS.VTJD-BOHVBHFTz
0SHBOJ[FE 4PVOE QQ "OESFX.DQIFSTPOBOE,PSBZ5BIMSPǧMV -
ϝλΫϦΤʔγϣϯͱͯ͠ͷݴޠઃܭ 29 զʑͷݚڀ݁Ռʢ༁ɿݴޠ͕༩͑ΔʣಛఆͷඒతӨڹͷূ໌Λҙਤͨ͠ ͷͰͳ͍͠ɺݸʑͷ࣮ફऀͷੑ͕ৗʹୈҰͰ͋Δ͜ͱʹมΘΓͳ ͍ͷͷɺσδλϧָثͷσβΠϯɺݴޠ࡞ऀͱָثσβΠφʔ࠷ऴ తʹͦͷݴޠͷϦιʔεʢͦͯͦ͠ΕͱͱʹɺӅ͞ΕͨεΫϦϓτʣΛࣗ ͷతඪʹ߹Θͤͯঌש͢Δऀͱͷɺ࣌ؒͱڑΛ͑ͨରͰ͋ Δͱݟͳ͢͜ͱ͕Ͱ͖ΔɺͱఏҊͰ͖Α͏ɻͦ͏ͯ͠ɺݴޠઃܭҰछͷϝ λΫϦΤʔγϣϯߦҝͱͳΓɺ࠷ऴతʹԿेʹΘͨͬͯඒతͳӨڹΛ ༩͑Δ͜ͱʹͳΔɻ
l*EJPNBUJD1BUUFSOTBOE"FTUIFUJD*OqVFODFJO$PNQVUFS.VTJD-BOHVBHFTz 0SHBOJ[FE 4PVOE QQ "OESFX.DQIFSTPOBOE,PSBZ5BIMSPǧMV චऀ༁ɺڧௐචऀ -
• 2000Ҏޙͷओཁͳ3՝ • ࣮ํ๏͔ΒݟΔԻָݴޠ • ཉ͍͠จ๏ͷࣗ༝ʹΑͬͯݴޠ֦ுͰରԠͨ͠Γߏจղੳͨ͠Γ • தؒදݱͷཻͱ࣮ߦ࣌ύϑΥʔϚϯεɺಈతมߋͷ͕͢͠͞มΘΔ • ԻָݴޠΛಛ͚ͮΔ6ཁૉʹରͯ͠ɺ࣮ࡍʹݱΕΔ3ͭͷہॴ
ੑɺ3ͭͷޮੑͱ͍͏ࢦඪΛఏҊ ·ͱΊ 30 ϨΠϠͷ֦ு(JIT DSP) ߴϨΠϠͷ֦ு (DSL in DSL) ਖ਼֬ͳεέδϡʔϦϯά -
• ΠϕϯτεέδϡʔϧͱJIT DSP͕1ͭͷݴޠମܥͰ݁͢Δݴޠ • ࣗݾөੑΛڧΊͨݴޠDSLΛ࡞Γ͍͢ݴޠ • ςΩετɺඇςΩετΛΈ߹Θͤ/ํධՁͰ͖Δݴޠ • ෳͷݴޠʹ·͕ͨͬͯ͑ΔLanguage Server/IDEج൫
ະདྷͷԻָϓϩάϥϛϯά 32 Language Oriented Programming(Racket)ͷΑ͏ͳੈք؍ʁ ↓↑DAWʢԻ੍ָ࡞ιϑτΣΞʣͱͷΑΓࠜຊతͳ࿈ܞʁ →mimiumͰϝΠϯͰ࣮ݱ͍ͨ͜͠ͱ ྑϓϩάϥϛϯάݴޠͷϦϙδτϦ͕ඦݸGithubʹస͕ͬͯΔΑ͏ʹɺඦݸͷԻָݴޠ͔Β͖ ͳͷΛϑϨΩγϒϧʹΈ߹ΘͤΒΕΔΑ͏ͳੈք͕དྷͯཉ͍͠ʢເʣ