Share
Embed
ラムダ計算の拡張に基づく 音楽プログラミング言語mimium とそのVMの実装
本発表では筆者の開発する音楽のためのプログラミング言語 mimium の理論的基盤について,音楽向け言語の歴史的文脈に沿って解説する.mimium は,リアルタイム信号処理を想定した音楽用の DSL だが,既存の多くの言語とは異なり,Unit Generator のような特定の音楽表現に基づくプリミティブを用意しない.代わりに,値呼びの単純型付きラムダ計算に遅延とフィードバックという 2 要素をプリミティブとして追加した中間表現を定義することで,その言語上でほとんどの信号処理アルゴリズムを関数のパイプとして表現できる.また,Lua を参考にした VM を設計したことで,内部状態を持つ信号処理関数の高階関数を用いた複製や,ホスト環境の埋めこみを容易に可能にしている.音楽というドメインに特化しながらも,汎用性を失わない言語の意義について議論する.
Tomoya Matsuura
January 10, 2025
Transcript
70 slides
-
• দӜ • 2019ະ౿ʮϓϩάϥϚϒϧͳԻָιϑτ ΣΞͷ։ൃʯʢഭPMʣ • 2019~2022ɹभେֶେֶӃ ܳज़ֶ म࢜ɾത࢜՝ఔ
• 2022͔Βɹ౦ژज़େֶ ܳज़ใηϯλ ʔ(AMC) ಛॿڭ • ݚڀྖҬɿԻֶָʢCivil Engineering of Musicʣ ࣗݾհ -
{ var snare, bdrum, hihat; var tempo = 4; tempo
= Impulse.ar(tempo); // for a drunk drummer replace Impulse with Dust !!! snare = WhiteNoise.ar(Decay2.ar(PulseDivider.ar(tempo, 4, 2), 0.005, 0.5)); bdrum = SinOsc.ar(Line.ar(120,60, 1), 0, Decay2.ar(PulseDivider.ar(tempo, 4, 0), 0.005, 0.5)); hihat = HPF.ar(WhiteNoise.ar(1), 10000) * Decay2.ar(tempo, 0.005, 0.5); Out.ar(0, (snare + bdrum + hihat) * 0.4 ! 2) }.play <CsoundSynthesizer> <CsOptions> -o dac // real-time output </CsOptions> <CsInstruments> sr = 44100 0dbfs = 1 nchnls = 2 ksmps = 64 instr 1 iAmp = p4 iFreq = p5 iAtt, iDec, iSus, iRel = 0.1, 0.4, 0.6, 0.7 kEnv = madsr:k(iAtt,iDec,iSus,iRel) iCutoff, iRes = 5000, 0.4 aVco = vco2:a(iAmp,iFreq) aLp = moogladder:a(aVco,iCutoff*kEnv,iRes) outall(aLp*kEnv) endin </CsInstruments> <CsScore> i 1 0 2 0.1 440 i 1 3 2 0.2 550 i 1 7 3 0.1 550 i 1 7 3 0.1 660 </CsScore> </CsoundSynthesizer> Cycling'74 Max CSound SuperCollider -
ຊݚڀͰରͱ͢ΔʮԻָϓϩάϥϛϯάʯ • ຊݚڀͰѻ͏ԻָϓϩάϥϛϯάͰɺ ԻܗͷྻΛܭࢉ͢Δ㲈γϯηαΠβ ʔΤϑΣΫλʔͷهड़Λओʹରʹ͢Δ • ԻఔϝϩσΟɺϦζϜϋʔϞχʔͱ͍ ͬͨཁૉΛݴޠϓϦϛςΟϒͱͯ͠Έࠐ Ή͜ͱఆ͍ͯ͠ͳ͍ •
࡞ͬͨݴޠ্ͷϥΠϒϥϦ/DSLͱ࣮ͯ͠ ͞ΕΔ͜ͱ͋Γ͏Δ (Mathews 1963)ΑΓ -
1960 1970 1980 1990 2000 2010 2020 1950 MUSIC 1
MUSIC 3 (UGen Language) IRCAM 4X Realtime- Variable DSP Pure Data SuperCollider ChucK Faust mimium MUSIC 5 ʢWritten in FORTRANʣ Max/FTS FORTRAN SAMSON BOX ϊϯϦΞϧλΠϜ ܭࢉػͰͷ Իܗੜ ςΩετϑΥʔϚοτ ͰͷϓϩάϥϜهड़ ϋʔυΣΞࢧԉͰͷ ϦΞϧλΠϜ࣮ߦ ൚༻PCͰͷ ϦΞϧλΠϜ Ի߹ ݴޠͷۀԽ ؔܕϓϩάϥϛϯάͱͷଓ -
MUSIC-NͱUnit Generator MUSIC III(1963) by Max Mathews • ৴߸ॲཧͷجૅ୯ҐʢUnitʣΛͭͳ͍͛ͯ͘ •
ΦγϨʔλʔϑΟϧλʔɺΤϯϕϩʔϓ • ϒϩοΫμΠΞάϥϜΛࢴʹॻ͘ˠςΩετܗࣜ ʹॻ͖͢ˠύϯνΧʔυʹଧͪࠐΉ • ଟ͘ͷԻָϓϩάϥϛϯάݴޠ͕͜ͷίϯηϓτ ΛҾ͖ܧ͙ • ϓϩάϥϛϯάݴޠʹݶΒͣɺWebAudio API ͳͲUGenͷߟ͑ํΛԼෑ͖ʹ͢Δ -
ؔܕͷ৴߸ॲཧ Faustʢ2002~ʣ • ϒϩοΫμΠΞάϥϜɿೖग़ྗΛ࣋ͭϒϩοΫΛ5ͭͷԋࢉࢠͰ߹ • ฒྻ(,) ྻ(:) ذ(<:)߹ྲྀ(:>) ϑΟʔυόοΫ(~) •
جຊϒϩοΫ: ఆ / جຊԋࢉ / Ԇ / ݅ذ* *Faustͷ݅ذ྆ϒϥϯνΛධՁ͔ͯ͠Β݅ʹͯ·Δ݁ՌΛऔΔ -
Faustͷྑ͍ɾѱ͍ • +1ͭͷίʔυ͔ΒෳͷόοΫΤϯυίϯύΠϧͰ͖Δ C++/Rust/LLVM IR... • طଘͷ൚༻ݴޠͱͷཧతͳޓੑɾ૬ޓӡ༻ੑʹ͚ܽΔ • - C֎෦ؔϓϦϛςΟϒ͔Βͷ७ਮͳࣸ૾͔͠औΕͳ͍ʢϙΠϯλڐ͞Εͳ͍ʣ
• +- FaustΛ༷ʑͳϓϥοτϑΥʔϜʹຒΊࠐΉ͜ͱͰ͖ͯɺFaust͔ΒϗετͷؔΛݺͳ͍ • BDAͱ߲ॻ͖͔͑ϚΫϩͱ͍͏2ͭͷҙຯ͕ಉډ͍ͯ͠Δ • +ϚΫϩͷύλʔϯϚονʹΑͬͯෳࡶͳ৴߸ॲཧάϥϑΛදݱͰ͖Δ • - ϚΫϩͷॻ͖ํΛؒҧ͑Δͱೖग़ྗͷ͕Ұக͠ͳ͍BDA͕ੜ͞ΕΔ͕ɺΤϥʔͷݪҼ͕ಛఆͮ͠Β͍ • -ίϯύΠϧ࣌ͷఆʢʣͱ৴߸ॲཧͷܕͷͱͷ۠ผ͕Θ͔Γʹ͍͘ -
ʢ༨ஊʣͰɺ൚༻ݴޠͰ෦DSLΛ࡞Δͷʁ • ϓϦΤϯϓςΟϒεέδϡʔϦϯάͳOSԼͰͷϦΞϧλΠϜॲཧͷ • ৴߸ॲཧதʹmalloc/freeݺͿͳɺmutexϩοΫ͢Δͳ • ڃݴޠ or ϩοΫϑϦʔฒߦGCͳݴޠ or
खಈͰGCͷλΠϛϯάܾΊΒΕΔݴޠ • DSLΛ࡞Γ͍͢ɺࣗݾөੑͷߴ͍ݴޠ΄ͲϦΞϧλΠϜॲཧͱ৯͍߹Θ͕ͤѱ͍ • 1ඵʹ48000~ճܭࢉ͢ΔͷͰ͋ΔఔόοϑΝʹཷΊͯ·ͱΊͯॲཧ • →ཧ࣌ؒʢॱংͷΈߟྀʣͱ࣮࣌ؒʢMIDIͳͲͷೖग़ྗ࣌ʣͷ߹ੑͷ -
mimiumʹ͓͚ΔϑΟʔυόοΫͷදݱ γϯϓϧͳੵʢϩʔύεϑΟϧλʣΛྫʹ fn onepole(x,g){ x*(1.0-g) + self*g } onepole(x,g) =
(1.0 - g) * x + g * _ ~ _; onepole(x,g) = self ~ _ with { self(y) = (1.0 - g) * x + g * y; }; mimium Faust ͘͠ (ඪ४ϥΠϒϥϦͷsi.smoothΛ୯७Խͨ͠ͷ) 1୯Ґ࣌ࠁલͷฦΓΛऔಘ -
چόʔδϣϯͷmimiumͷ • ҙຯ͕·ͱʹఆٛ͞Ε͍ͯͳ͔ͬͨ • ෦ঢ়ଶ͖ؔ: self͔delayΛίʔϧπϦʔͷͲ͔͜Ͱݺͼग़ؔ͢ ͱɺߴ֊ؔΛΈ߹ΘͤΔͱίϯύΠϧ͕௨Βͳ͘ͳΔ • = ϑΟʔυόοΫԆ༻ͷ෦ঢ়ଶͷͨΊͷϝϞϦαΠζΛ֬ఆͰ͖ͳ͍
• ৴߸ॲཧάϥϑͷύϥϝτϦοΫͳੜʹݶք͕͋Δ • →ݴޠͱίϯύΠϥͷશ໘తͳ࠶ઃܭ -
ϥϜμܭࢉϕʔεͷDSPݴޠͷઌߦྫ • Kronos[Norilo 2015] • System-FωʢܕˠܕͷϥϜμந͕Մೳͳߴ֊ϥϜμܭࢉͷόϦΤʔγϣϯʣΛ ϕʔεʹ͢Δ • ܕϨϕϧͷܭࢉ͕৴߸ॲཧάϥϑͷύϥϝτϦοΫͳੜʹରԠ •
ܗࣜԽ͞Εͨҙຯͷఏࣔͳ͠ʢιʔείʔυެ։ʣ • W-Calculus[Arias et al. 2021], CoqͰূ໌͕ຒΊࠐ·Ε͍ͯΔ • ߴ֊ؔΛڐ͞ͳ͍ / ઢܗ࣌ෆมγεςϜʢΤίʔͱ͔ʣ͔͠ॻ͚ͳ͍ W-calculusͷ੍ݶΛ؇ΊͯϝϞϦཧͱ͔ϥϯλΠϜଆͰؤுͬͯΒ͏ => λmmm -
ຊൃදͷείʔϓ fn onepole(x,g){ x*(1.0-g) + self*g } ιʔείʔυ AST(≒λmmm) ܕਪ
ˍ MIRੜ LLVM-like SSA MIR CONSTANTS:[1.0] state_size:1 fn onepole(x,g) MOVECONST 2 0 MOVE 3 1 SUBF 2 2 3 MOVE 3 0 MULF 2 2 3 GETSTATE 3 MOVE 4 1 MULF 3 3 4 ADDF 2 2 3 GETSTATE 3 SETSTATE 2 RETURN 3 1 όΠτίʔυ ੜ Ծػց όΠτίʔυ φΠʔϒͳ ΠϯλϓϦλ ʢඇޮʣ 2.γϯλοΫε 3. ҙຯ 4. VM & όΠτίʔυ ͜ͷ෦ͷܗࣜԽfuture work -
ຊൃදͷείʔϓ fn onepole(x,g){ x*(1.0-g) + self*g } ιʔείʔυ AST(≒λmmm) ܕਪ
ˍ MIRੜ LLVM-like SSA MIR CONSTANTS:[1.0] state_size:1 fn onepole(x,g) MOVECONST 2 0 MOVE 3 1 SUBF 2 2 3 MOVE 3 0 MULF 2 2 3 GETSTATE 3 MOVE 4 1 MULF 3 3 4 ADDF 2 2 3 GETSTATE 3 SETSTATE 2 RETURN 3 1 όΠτίʔυ ੜ Ծػց όΠτίʔυ φΠʔϒͳ ΠϯλϓϦλ ʢඇޮʣ 2.γϯλοΫε 3. ҙຯ 4. VM & όΠτίʔυ ͜ͷ෦ͷܗࣜԽfuture work ׂѪ -
λmmm ͷγϯλοΫε (࣮ࡍʹλϓϧͷΑ͏ͳ߹ܕ͋Δ͕ຊݚڀͰ୯७ԽͷͨΊলུʣ e ::= x x ∈ vp [value]
| λx.e [lambda] | let x = e1 in e2 [let] | fix x.e [fixpoint] | e1 e2 [app] | if (ec ) et else ee [if ] | delay n e1 e2 n ∈ ℕ [delay] | feed x.e [feed] | ... τp ::= R [real] | N [nat] τ ::= τp | τ → τ [function] ߲ vp ::= r r ∈ ℝ | n n ∈ ℕ v ::= vp | cls(λx.e, E) ܕ -
ܕ͚نଇ(ൈਮ) Γ, x : τa ⊢ e : τb Γ
⊢ λx.e : τa → τb [T-LAM] Γ ⊢ n : N Γ ⊢ e1 : τ Γ ⊢ e2 : R Γ ⊢ delay n e1 e2 : τ [T-DELAY] Γ, x : τp ⊢ e : τp Γ ⊢ feedx.e : τp [T-FEED] Γ ⊢ ec : R Γ ⊢ et : τ Γ ⊢ ee : τ Γ ⊢ if (ec ) et ee : τ [T-IF] "ؔΛؚΉ͋ΒΏΔܕ͔Βܕͷࣸ૾Λڐ͢" "Ԇ࣌ؒΛࢦఆ͢Δ߲࣮ܕ" "݅ذͷ࣮݅ܕ" "FeedؔΛؚΉܕΛऔΕͳ͍" "࠷େԆ࣌ؒࣗવͷఆ" -
ܕ͚نଇ(ൈਮ) Γ, x : τa ⊢ e : τb Γ
⊢ λx.e : τa → τb [T-LAM] Γ ⊢ n : N Γ ⊢ e1 : τ Γ ⊢ e2 : R Γ ⊢ delay n e1 e2 : τ [T-DELAY] Γ, x : τp ⊢ e : τp Γ ⊢ feedx.e : τp [T-FEED] Γ ⊢ ec : R Γ ⊢ et : τ Γ ⊢ ee : τ Γ ⊢ if (ec ) et ee : τ [T-IF] ԾʹFeed͕ؔܕΛऔΔͱ͢Δͱɺ ʮ1αϯϓϧલͷؔΛͬͯ࣍ͷ࣌ࠁͷ ؔΛ߹͢Δʯ͜ͱʹͳΔɻ →࣌ؒܦաͱͱʹ༻ϝϞϦ͕૿େ ʢ㲈FRPʹ͓͚Δspace-leakʣ -
λmmm ͷૢ࡞తҙຯ (Ϗοάεςοϓɺൈਮ) En ⊢ e1 ⇓ v1 n >
v1 En−v1 ⊢ e2 ⇓ v2 En ⊢ delay n e1 e2 ⇓ v2 [E-DELAY] En ⊢ λx.e ⇓ cls(λx.e, En) [E-LAM] En−1 ⊢ e ⇓ v1 En, x ↦ v1 ⊢ e ⇓ v2 En, x ↦ v2 ⊢ feed x e ⇓ v1 [E-FEED] En ⊢ ec ⇓ n n > 0 En ⊢ et ⇓ v En ⊢ if(ec ) et else et ⇓ v [E-IFTRUE] En ⊢ ec ⇓ n n ≦ 0 En ⊢ ee ⇓ v En ⊢ if(ec ) et else et ⇓ v [E-IFFALSE] En ⊢ e1 ⇓ cls(λxc .ec , En c )En ⊢ e2 ⇓ v2 En c , xc ↦ v2 ⊢ ec ⇓ v En ⊢ e1 e2 ⇓ v [E-APP] ࣌ࠁnʹ͓͚ΔධՁڥΛ Enͱ͢Δ n<0ͷڥ͕ࢀর͞Εͨ߹0 Λฦ͢ɻ ͜ͷҙຯͰɺ࣌ࠁnͷܭࢉ ݁ՌΛಘΔͨΊʹɺ࣌ࠁ0͔Βn ·ͰͷܭࢉΛຖճΓ͢͜ͱ ʹͳΔɻ -
λmmm Λ࣮ߦ͢ΔͨΊͷVMͱόΠτίʔυ • Lua VM 5.0Λݩʹઃܭ (ϨδελϚγϯ͕ͩɺϨδελ൪߸୯ʹίʔϧελοΫͷ૬ ରతͳҐஔΛද͢) • Ϋϩʔδϟ͕Ωϟϓνϟͨࣗ͠༝มΛ
`getupvalue`໋ྩͰ࣮ߦ࣌ʹऔಘͰ͖Δ • ͜ΕΛɺ੩తܕ͚ݴޠ༻ʹվม • ྫɿΫϩʔδϟͷݺͼग़͠ͱී௨ͷؔݺͼग़͠ͷ໋ྩΛ͚Δ • Ϋϩʔδϟ͚͕ͩώʔϓΞϩέʔτ (ݱࡏࢀরΧϯτGCͰཧ) • self ͱ delay༻ͷ෦ঢ়ଶૢ࡞໋ྩΛՃ -
MOVE A B R(A) := R(B) MOVECONST A B R(A)
:= K(B) GETUPVALUE A B R(A) := U(B) (SETUPVALUE does not exist) GETSTATE* A R(A) := SPtr[SPos] SETSTATE* A SPtr[SPos] := R(A) SHIFTSTATE* sAx SPos += sAx DELAY* A B C R(A) := update_ringbuffer(SPtr[SPos],R(B),R(C)) *(SPos,SPtr)= vm.closures[vm.statepos_stack.top()].state (if vm.statepos_stack is empty, use global state storage.) JMP sAx PC +=sAx JMPIFNEG A sBx if (R(A)<0) then PC += sBx CALL A B C R(A),...,R(A+C-2) := program.functions[R(A)](R(A+1),...,R(A+B-1)) CALLCLS A B C vm.statepos_stack.push(R(A)) R(A),...,R(A+C-2) := vm.closures[R(A)].fnproto(R(A+1),...,R(A+B-1)) vm.statepos_stack.pop() CLOSURE A Bx vm.closures.push(closure(program.functions[R(Bx)])) R(A) := vm.closures.length - 1 CLOSE A close stack variables up to R(A) RETURN A B return R(A), R(A+1)...,R(A+B-2) ADDF A B C R(A) := R(B) as float + R(C) as float SUBF A B C R(A) := R(B) as float - R(C) as float MULF A B C R(A) := R(B) as float * R(C) as float DIVF A B C R(A) := R(B) as float / R(C) as float ADDI A B C R(A) := R(B) as int + R(C) as int ...Other basic arithmetic continues for each primitive types... (࣮ࡍͷίϯύΠϥͰ߹ܕΛѻ͏ ͨΊɺଟ͘ͷ໋ྩͰϫʔυαΠζΛࣔ ͢ՃΦϖϥϯυ͕ಋೖ͞Ε͍ͯΔ) -
VMͱϓϩάϥϜͷߏͷ֓ཁ Virtual Machine Program Counter State_Ptr Stack Audio Driver Call
Stack ... State Storage Closure Storage Base Pointer State Position State for self 1 Ring Buffer for delay 1 State for self 2 Ring Buffer for delay 2 ... Program Function Prototype0 Static Variables ... ... Function Prototype1 OP A B C OP A B C OP A B C OP A B C OP A B C Upvalue List Program State Size Local(N1) Upvalue(N2) Open Closure Function Prototype State Storage Upvalues Open(Local(N1)) Open(Upvalue(N2)) State Position Escaped Closure Function Prototype State Storage Upvalues State Position Closed Upvalue 1 Closed Upvalue 2 Somewhere on the Heap Memory (Maybe Shared with other closures) -
෦ঢ়ଶ͖ؔΛ༻͠ͳ͍߹ɿ Virtual Machine Program Counter Audio Driver Call Stack ...
Closure Storage Base Pointer Program Function Prototype0 Static Variables ... ... Function Prototype1 OP A B C OP A B C OP A B C OP A B C OP A B C Upvalue List Program Local(N1) Upvalue(N2) Open Closure Function Prototype Upvalues Open(Local(N1)) Open(Upvalue(N2)) Escaped Closure Function Prototype Upvalues Closed Upvalue 1 Closed Upvalue 2 Somewhere on the Heap Memory (Maybe Shared with other closures) -
ྫɿϑΟʔυόοΫ͖σΟϨΠΛෳ༻͢Δ fn fbdelay(x,fb,dtime){ x + delay(1000,self,dtime)*fb } fn twodelay(x,dtime){ fbdelay(x,dtime,0.7)
+fbdelay(x,dtime*2,0.8) } fn dsp(x){ twodelay(x,400)+twodelay(x,800) } "fbdelay" ؔ࠷େͰ1000αϯϓϧͷ delayͱ selfΛ༻ "twodelay""fbdelay"2ճ༻ "dsp""twodelay"Λ͞Βʹ2ճ͏ -
CONSTANTS:[0.7,2,0.8,400,800,0,1] fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE
4 SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 fn twodelay(x,dtime) state_size:2008 MOVECONST 2 5 MOVE 3 0 MOVE 4 1 MOVECONST 5 0 CALL 2 3 1 SHIFTSTATE 1004 MOVECONST 3 5 MOVE 4 0 MOVECONST 5 1 //load 2 MULF 4 4 5 MOVECONST 5 0 //load 0.7 CALL 3 3 1 ADDF 3 3 4 SHIFTSTATE -1004 RETURN 3 1 fn dsp (x) state_size:4016 MOVECONST 1 6 //load twodelay MOVE 2 0 MOVECONST 3 3 //load 400 CALL 1 2 1 SHIFTSTATE 2008 MOVECONST 2 6 //load twodelay MOVE 2 3 MOVE 3 0 MOVECONST 3 4 //load 400 CALL 2 2 1 ADD 1 1 2 SHIFTSTATE -2008 RETURN 1 1 όΠτίʔυͷٙࣅίʔυදݱ -
fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE 4
SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 State for Self Ring Buffer for Delay SPos ... ... -
fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE 4
SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 State for Self Ring Buffer for Delay SPos "self"Λࢀর SPos͔Β1ϫʔυಡΈग़͠ɺ Ϩδελ4֨ೲ ... ... -
fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE 4
SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 State for Self Ring Buffer for Delay SPos ... ... SPosͷҐஔΛ1ϫʔυΦϑηοτ -
fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE 4
SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 State for Self Ring Buffer for Delay SPos ... ... SPosͷҐஔͷϦϯάόοϑΝΛߋ৽ ೖྗϨδελ4ɺԆ࣌ؒϨδελ2͔Βऔಘɺ ߋ৽ͨ͠ઌ಄ΛϨδελ4ʹॻ͖ࠐΈ -
fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE 4
SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 State for Self Ring Buffer for Delay SPos ... ... SPosͷҐஔΛݩʹ͢ ʢؔͷίϯςΩετΛൈ͚Δ࣌ʹɺ ։࢝࣌ͱಉ͡Ґஔʹ͍ͬͯͳ͚ΕͳΒͳ͍ʣ -
fn fbdelay(x,fb,dtime) state_size:1004 MOVE 3 0 //load x GETSTATE 4
SHIFTSTATE 1 DELAY 4 4 2 MOVE 5 1 MULF 4 4 5 ADDF 3 3 4 SHIFTSTATE -1 GETSTATE 4 SETSTATE 3 RETURN 4 1 State for Self Ring Buffer for Delay SPos ... ... selfʹฦΓΛॻ͖ࠐΉ -
fn twodelay(x,dtime) state_size:2008 MOVECONST 2 5 MOVE 3 0 MOVE
4 1 MOVECONST 5 0 CALL 2 3 1 SHIFTSTATE 1004 MOVECONST 3 5 MOVE 4 0 MOVECONST 5 1 //load 2 MULF 4 4 5 MOVECONST 5 0 //load 0.7 CALL 3 3 1 ADDF 3 3 4 SHIFTSTATE -1004 RETURN 3 1 State for Self Ring Buffer for Delay SPos ... ... State for Self Ring Buffer for Delay 0 1 2 1ͭͷ"fbdelay"ݺͼग़͠ -
fn twodelay(x,dtime) state_size:2008 MOVECONST 2 5 MOVE 3 0 MOVE
4 1 MOVECONST 5 0 CALL 2 3 1 SHIFTSTATE 1004 MOVECONST 3 5 MOVE 4 0 MOVECONST 5 1 //load 2 MULF 4 4 5 MOVECONST 5 0 //load 0.7 CALL 3 3 1 ADDF 3 3 4 SHIFTSTATE -1004 RETURN 3 1 State for Self Ring Buffer for Delay ... ... State for Self Ring Buffer for Delay 0 1 2 SPos 3 self༻ʹ1, delay༻ʹ1000ʴಡΈग़͠Ґஔʴॻ͖ࠐΈҐஔʴαΠζ => 1004 -
fn twodelay(x,dtime) state_size:2008 MOVECONST 2 5 MOVE 3 0 MOVE
4 1 MOVECONST 5 0 CALL 2 3 1 SHIFTSTATE 1004 MOVECONST 3 5 MOVE 4 0 MOVECONST 5 1 //load 2 MULF 4 4 5 MOVECONST 5 0 //load 0.7 CALL 3 3 1 ADDF 3 3 4 SHIFTSTATE -1004 RETURN 3 1 State for Self Ring Buffer for Delay ... ... State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 2ͭͷ "fbdelay"ͷݺͼग़͠ -
fn twodelay(x,dtime) state_size:2008 MOVECONST 2 5 MOVE 3 0 MOVE
4 1 MOVECONST 5 0 CALL 2 3 1 SHIFTSTATE 1004 MOVECONST 3 5 MOVE 4 0 MOVECONST 5 1 //load 2 MULF 4 4 5 MOVECONST 5 0 //load 0.7 CALL 3 3 1 ADDF 3 3 4 SHIFTSTATE -1004 RETURN 3 1 State for Self Ring Buffer for Delay ... ... State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 6 SPosΛݩͷҐஔʹ͢ -
fn dsp (x) state_size:4016 MOVECONST 1 6 //load twodelay MOVE
2 0 MOVECONST 3 3 //load 400 CALL 1 2 1 SHIFTSTATE 2008 MOVECONST 2 6 //load twodelay MOVE 2 3 MOVE 3 0 MOVECONST 3 4 //load 400 CALL 2 2 1 ADD 1 1 2 SHIFTSTATE -2008 RETURN 1 1 State for Self Ring Buffer for Delay State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 6 State for Self Ring Buffer for Delay State for Self 1ͭͷ"twodelay"ͷݺͼग़͠ -
fn dsp (x) state_size:4016 MOVECONST 1 6 //load twodelay MOVE
2 0 MOVECONST 3 3 //load 400 CALL 1 2 1 SHIFTSTATE 2008 MOVECONST 2 6 //load twodelay MOVE 2 3 MOVE 3 0 MOVECONST 3 4 //load 400 CALL 2 2 1 ADD 1 1 2 SHIFTSTATE -2008 RETURN 1 1 State for Self Ring Buffer for Delay State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 6 State for Self Ring Buffer for Delay State for Self 7 2ͭͷ"twodelay"ͷݺͼग़͠ -
fn dsp (x) state_size:4016 MOVECONST 1 6 //load twodelay MOVE
2 0 MOVECONST 3 3 //load 400 CALL 1 2 1 SHIFTSTATE 2008 MOVECONST 2 6 //load twodelay MOVE 2 3 MOVE 3 0 MOVECONST 3 4 //load 400 CALL 2 2 1 ADD 1 1 2 SHIFTSTATE -2008 RETURN 1 1 State for Self Ring Buffer for Delay State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 6 State for Self Ring Buffer for Delay State for Self 7 8 9 10 11 12 13 2ͭͷ"twodelay"ͷݺͼग़͠ -
fn dsp (x) state_size:4016 MOVECONST 1 6 //load twodelay MOVE
2 0 MOVECONST 3 3 //load 400 CALL 1 2 1 SHIFTSTATE 2008 MOVECONST 2 6 //load twodelay MOVE 2 3 MOVE 3 0 MOVECONST 3 4 //load 400 CALL 2 2 1 ADD 1 1 2 SHIFTSTATE -2008 RETURN 1 1 State for Self Ring Buffer for Delay State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 6 State for Self Ring Buffer for Delay State for Self 7 8 9 10 11 12 13 14 SPosΛ͢ -
fn dsp (x) state_size:4016 MOVECONST 1 6 //load twodelay MOVE
2 0 MOVECONST 3 3 //load 400 CALL 1 2 1 SHIFTSTATE 2008 MOVECONST 2 6 //load twodelay MOVE 2 3 MOVE 3 0 MOVECONST 3 4 //load 400 CALL 2 2 1 ADD 1 1 2 SHIFTSTATE -2008 RETURN 1 1 State for Self Ring Buffer for Delay State for Self Ring Buffer for Delay 0 1 2 SPos 3 4 5 6 State for Self Ring Buffer for Delay State for Self 7 8 9 10 11 12 13 14 SPosͷҠಈΛ૬ରతͳΦϑηοτͰ දݱ͢ΔͷͰɺ֤ؔఆٛݺͼग़͠ ݩʹ͍ͭͯΒͳͯ͘Α͍ -
ߴ֊ؔͱ෦ঢ়ଶ͖ؔͷΈ߹Θͤ fn bandpass(x,freq){ //... } fn filterbank(n,filter_factory){ if (n>0){ let
filter = filter_factory() let next = filterbank(n-1,filter_factory) |x,freq| filter(x,freq+n*100)ɹ+ next(x,freq) }else{ |x,freq| 0 } } let myfilter = filterbank(3,| | bandpass) fn dsp(){ myfilter(x,1000) } -
ߴ֊ؔͱ෦ঢ়ଶ͖ؔͷΈ߹Θͤ fn bandpass(x,freq){ //... } fn filterbank(n,filter_factory){ if (n>0){ let
filter = filter_factory() let next = filterbank(n-1,filter_factory) |x,freq| filter(x,freq+n*100)ɹ+ next(x,freq) }else{ |x,freq| 0 } } let myfilter = filterbank(3,| | bandpass) fn dsp(){ myfilter(x,1000) } Ҿͱͯ͠༩͑ΒΕΔ fi lter_factoryͷ෦ঢ়ଶαΠζ ίϯύΠϧ࣌ʹ֬ఆͰ͖ͳ͍ -
Virtual Machine Program Counter State_Ptr Stack Audio Driver Call Stack
... State Storage Closure Storage Base Pointer State Position State for self 1 Ring Buffer for delay 1 State for self 2 Ring Buffer for delay 2 ... Program Function Prototype0 Static Variables ... ... Function Prototype1 OP A B C OP A B C OP A B C OP A B C OP A B C Upvalue List Program State Size Local(N1) Upvalue(N2) Open Closure Function Prototype State Storage Upvalues Open(Local(N1)) Open(Upvalue(N2)) State Position Escaped Closure Function Prototype State Storage Upvalues State Position Closed Upvalue 1 Closed Upvalue 2 Somewhere on the Heap Memory (Maybe Shared with other closures) $-0463&໋ྩʹΑͬͯΫϩʔδϟ͕ΠϯελϯεԽ͞ΕΔ࣌ɺ Ϋϩʔδϟ্ʹ෦ঢ়ଶετϨʔδΛผ్֬อ͢Δ -
Virtual Machine Program Counter State_Ptr Stack Audio Driver Call Stack
... State Storage Closure Storage Base Pointer State Position State for self 1 Ring Buffer for delay 1 State for self 2 Ring Buffer for delay 2 ... Program Function Prototype0 Static Variables ... ... Function Prototype1 OP A B C OP A B C OP A B C OP A B C OP A B C Upvalue List Program State Size Local(N1) Upvalue(N2) Open Closure Function Prototype State Storage Upvalues Open(Local(N1)) Open(Upvalue(N2)) State Position Escaped Closure Function Prototype State Storage Upvalues State Position Closed Upvalue 1 Closed Upvalue 2 Somewhere on the Heap Memory (Maybe Shared with other closures) CALLCLS ໋ྩͰΫϩʔδϟΛݺͼग़͢ͱ͖ɺGET/SET/SHIFTSTATE/DELAY໋ྩͰ ༻͢Δ෦ঢ়ଶετϨʔδͷϙΠϯλΛઐ༻ͷελοΫʹੵΜͰΓସ͑Δ -
CONSTANTS[100,1,0,2] fn inner_then(x,freq) //upvalue: [local(4),local(3),local(2),local(1)] GETUPVALUE 3 2 //load filter
MOVE 4 0 MOVE 5 1 GETUPVALUE 6 1 //load n ADDD 5 5 6 MOVECONST 6 0 MULF 5 5 6 CALLCLS 3 2 1 //call filter GETUPVALUE 4 4 //load next MOVE 5 0 MOVE 6 1 CALLCLS 4 2 1 //call next ADDF 3 3 4 RETURN 3 1 fn inner_else(x,freq) MOVECONST 2 2 RETURN 2 1 fn filterbank(n,filter_factory) MOVE 2 0 //load n MOVECONST 3 2 //load 0 SUBF 2 2 3 JMPIFNEG 2 12 MOVE 2 1 //load filter_factory CALL 2 2 0 //get filter MOVECONST 3 1 //load itself MOVE 4 0 //load n MOVECONST 5 1 //load 1 SUBF 4 4 5 MOVECONST 5 2 //load inner_then CALLCLS 3 2 1 //recursive call MOVECONST 4 2 //load inner_then CLOSURE 4 4 //load inner_lambda JMP 2 MOVECONST 4 3 //load inner_else CLOSURE 4 4 CLOSE 4 RETURN 4 1 "GET/SET/SHIFTSTATE/DELAY"Ҿͱͯ͠͞ΕΔ fi lter_factoryͷதͰ ͚ͩݺΕͯɺ fi lterbankؔͰ༻͞Ε͍ͯͳ͍ -
ߴ֊ؔͱ෦ঢ়ଶ͖ؔͷΈ߹Θͤ fn bandpass(x,freq){ //... } fn filterbank(n,filter_factory:()->(float,float)->float){ if (n>0){ let
filter = filter_factory() let next = filterbank(n-1,filter_factory) |x,freq| filter(x,freq+n*100) + next(x,freq) }else{ |x,freq| 0 } } let myfilter = filterbank(3,| | bandpass) fn dsp(){ myfilter(x,1000) } ݁ہɺΦϒδΣΫτࢦϓϩάϥϛϯάʹ͓͚Δ Unit GeneratorͷίϯετϥΫλʹ૬͢Δ -
ଞݴޠͱͷൺֱ ύϥϝτϦοΫͳ ৴߸ॲཧάϥϑͷੜ ࣮ࡍͷDSP Faust ߲ॻ͖͔͑ϚΫϩ ϒϩοΫμΠΞάϥϜ Kronos ܕϨϕϧܭࢉ Ϩϕϧܭࢉ
mimium άϩʔόϧڥͷධՁ dsp ؔͷධՁ mimiumͰͲͪΒಉ͡ҙຯͰϨϕϧͷධՁɻ ͜ΕॳֶऀʹͱͬͯΘ͔Γ͍͢ͱݴ͑Δ͕ɺҰํͰ... -
ಈ͔ͳ͍ίʔυͷྫ fn filterbank(n,filter){ if (n>0){ |x,freq| filter(x,freq+n*100) + filterbank(n-1,filter)(x,freq) }else{
|x,freq| 0 } } fn dsp(){ filterbank(3,bandpass)(x,1000) } -
ಈ͔ͳ͍ίʔυͷྫ fn filterbank(n,filter){ if (n>0){ |x,freq| filter(x,freq+n*100) + filterbank(n-1,filter)(x,freq) }else{
|x,freq| 0 } } fn dsp(){ filterbank(3,bandpass)(x,1000) } ͜ͷॻ͖ํͩͱɺΫϩʔδϟ͕ຖ࣌ࠁੜ͞Εɺ ෦ঢ়ଶ͕ຖ࣌ࠁϦηοτ͞Εͯ͠·͏ -
ଟஈ֊ܭࢉΛಋೖͰ͖ͨ߹ɿ fn filterbank(n,filter:&(float,float)->float)->&(float,float)->float{ .< if (n>0){ |x,freq| ~filter(x,freq+n*100) + ~filterbank(n-1,filter)(x,freq)
}else{ |x,freq| 0 } >. } fn dsp(){ ~filterbank(3,.<bandpass>.)(x,1000) } *BER MetaOCamlͬΆ͍γϯλοΫεΛ࠾༻ͨ͠ఆͷٙࣅίʔυ -
let sampler = gen_sampler_mono("target.wav") fn counter(){ self+1.0 } fn dsp(){
sampler(counter()) } -
fn gen_sampler_mono(machine: &mut Machine) -> ReturnCode { let abspath =
{...}; let vec = load_wavfile_to_vec(abspath.to_str().unwrap()) .inspect_err(|e| { panic!("gen_sampler_mono error: {}", e); }) .unwrap(); //ಡΈࠐ·ΕͨԻྻ࣍ͷΫϩʔδϟͰΩϟϓνϟɺϜʔϒ͞ΕΔ let res = move |machine: &mut Machine| -> ReturnCode { let pos = vm::Machine::get_as::<f64>(machine.get_stack(0)); let val = interpolate_vec(&vec, pos); machine.set_stack(0, Machine::to_value(val)); 1 }; let ty = function!(vec![numeric!()], numeric!()); //mimium্ͷܕγάωνϟ let idx = machine.wrap_extern_cls(("sampler_mono".to_symbol(), ɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹRc::new(RefCell::new(res)), ty)); machine.set_stack(0, Machine::to_value(idx)); 1 } Rust্ͰLuaͰͷόΠϯσΟϯάͷΑ͏ʹɺVMͷίʔϧελοΫΛૢ࡞ -
fn gen_sampler_mono(machine: &mut Machine) -> ReturnCode { //return higher order
closure let abspath = { ... }; let vec = load_wavfile_to_vec(abspath.to_str().unwrap()) .inspect_err(|e| { panic!("gen_sampler_mono error: {}", e); }) .unwrap(); //the generated vector is moved into the closure let res = move |machine: &mut Machine| -> ReturnCode { let pos = vm::Machine::get_as::<f64>(machine.get_stack(0)); let val = interpolate_vec(&vec, pos); machine.set_stack(0, Machine::to_value(val)); 1 }; let ty = function!(vec![numeric!()], numeric!()); //mimium্ͷܕγάωνϟ let idx = machine.wrap_extern_cls(("sampler_mono".to_symbol(), Rc::new(RefCell::new(res)), ty)); machine.set_stack(0, Machine::to_value(idx)); 1 } Rust্ͰLuaͷόΠϯσΟϯάͷΑ͏ʹɺVMͷίʔϧελοΫΛૢ࡞ -
impl Plugin for SamplerPlugin { fn get_ext_functions(&self) -> Vec<vm::ExtFnInfo> {
let t = function!(vec![string_t!()], function!(vec![numeric!()], numeric!())); let sig = ( "gen_sampler_mono".to_symbol(), gen_sampler_mono as ExtFunType, t, ); vec![sig] } } PluginτϨΠτΛ௨ͯ͡mimium͔Βݺͼग़ͨ͢Ίͷ໊લͱܕใɺ࣮ࡍʹݺͼग़͞ΕΔؔΛΤΫεϙʔτ ʢࠓޙखଓ͖ϚΫϩͰόΠϯσΟϯάੜΛࣗಈԽ͍ͨ͠ʣ -
·ͱΊ • λmmm: ݺͼ୯७ܕ͖ϥϜμܭࢉσΟϨΠͱϑΟʔυόοΫΛՃͨ͠ମܥ • ͦΕΛ࣮ߦ͢ΔͨΊͷVMͱ໋ྩηοτͷઃܭ • GET/SET/SHIFTSTATE/DELAYͰσΟϨΠͱϑΟʔυόοΫΛऔΓѻ͏ • ߴ֊ؔͰ෦ঢ়ଶΛऔΓѻ͏ͨΊʹɺΫϩʔδϟͷΠϯελϯε͕෦ঢ়ଶετϨʔδΛ࣋ͭ
• ύϥϝτϦοΫͳ৴߸ॲཧੜͱɺ࣮ࡍͷॲཧͷ࣮ߦΛಉ͡ҙຯͰ࣮ߦͰ͖Δ • ҙຯΛֶश͋͘͢͠Δ͕ɺϢʔβʔίʔυ͕άϩʔόϧධՁͱDSPධՁͲͪΒͰߦΘΕ Δ͔Λҙ͠ͳ͚ΕͳΒͳ͍ • Իָͱ͍͏υϝΠϯʹಛԽ͍ͯ͠Δ͕ɺ൚༻ੑɺࣗݾ֦ுੑɺ૬ޓӡ༻ੑΛอͬͨݴޠ