Do It Yourself: Sonic VisualiserͰԻָ෼ੳͯ͠ΈΑ͏ ʙσʔληοτͷϋϯυϦϯά΋ఴ͑ͯʙ 2022/06/29 Music × Analytics meetup vol.8 ࢁຊ ༤໵ (yamatchy)

ࣗݾ঺հ • ࢁຊ ༤໵ (yamatchy) • ஜ೾େֶେֶӃ D2 • ઐ໳ɿԻָɾԻڹ৘ใॲཧ • ʮՎএɾԋ૗ͱϓϨΠϠʔɾϦεφʔͷΩϡʔϐουʯ Λ࡞Γ͍ͨ • ͦͷϚονϯάͷצॴ͸Ͳ͜ʹ͋Δͷ͔ʁΛ௥͍ଓ͚ ࣦഊͷຖ೔ • ޷͖ͳΞʔςΟετɿΰʔϧσϯϘϯόʔ 2 ࿦จࣥචதͷ ͕ͨ͢ ͢Έ͔ɿ ͭ͘͹ͷ৿

࠷ॳʹؔ܎ͳ͍ʢʁʣએ఻ • Իָ৘ใॲཧͷπʔϧΛ·ͱΊͯ·͢ • python/matlabଞͷϥΠϒϥϦɾσεΫτοϓΞϓϦ౳ • αʔϕΠࢿྉɾϨΫνϟʔࢿྉ౳ʢͨͩ͠શ෦ӳޠʣ • https://github.com/yamathcy/awesome-music- infomatics • Έͳ͞Μ΋Կ͔஌͍ͬͯͨΒPRʹͯ௥Ճ͓ئ͍ ͠·͢ʂ 3

ຊ୊ʹೖΓ·͢

ࠓ೔ͷ࿩୊ • Sonic visualiserͷ෍ڭ ঺հ 5 ఘϝϩϯ༷ͷπΠʔτΑΓ https://twitter.com/_Akira_Melon_/status/ 1538172760622776321 ͜ͷπʔϧ

Sonic visualiserͱ͸ • Queen MaryେֶͷCentre for digital music άϧʔϓ࡞ͷԻָ෼ੳͷͨΊͷιϑτ΢ΣΞ • ֶज़༻ʹ΋޿͘༻͍ΒΕΔʢओʹσʔλ ηοτΛ࡞ΔΞϊςʔγϣϯ໨తʣ • ࿦จ΋ग़ͯΔ • https://www.sonicvisualiser.org/ 6 $ISJT$BOOBN $ISJTUJBO-BOEPOF BOE.BSL4BOEMFS 4POJD7JTVBMJTFS "O0QFO4PVSDF"QQMJDBUJPOGPS7JFXJOH "OBMZTJOH BOE"OOPUBUJOH .VTJD"VEJP'JMFT JO1SPDFFEJOHTPGUIF"$..VMUJNFEJB *OUFSOBUJPOBM$POGFSFODF

wavΛಡΈࠐΜͰදࣔͯ͠৭ʑ΍Δͱ… 7 UIͷશମਤ

wavΛಡΈࠐΜͰදࣔͯ͠৭ʑ΍Δͱ… 8 UIͷશମਤ 🤔ʁ

Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍࡯ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹ൒ࣗಈͳʣΞϊςʔγϣϯ 9

Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍࡯ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹ൒ࣗಈͳʣΞϊςʔγϣϯ 10

σʔλɾϝλσʔλͷ؍࡯ 11 εϖΫτϩάϥϜ ʢ࣌ؒ͝ͱͷप೾਺ղੳ݁Ռʣ ৴߸೾ܗ εϖΫτϥϜ ʢ͋Δ࣌఺ͷ प೾਺ղੳͷ݁Ռʣ ♪ϩϏϯιϯ/εϐοπ

σʔλɾϝλσʔλͷ؍࡯ 12 όοΫίʔϥε ग़ݱ෦෼ Վͷϐον ʢ੨ۂઢʣ ՎͷԻූ ʢࠇઢʣ ίʔυਐߦ ʢλΠϛϯάɿ੺ઢʣ ♪ϩϏϯιϯ/εϐοπ

εϖΫτϩάϥϜදࣔͷόϦΤʔγϣϯ͕ͱʹ͔͍͘͢͝ 13 )[·Ͱ E#ৼ෯ ϐʔΫप೾਺ ͷΈڧௐ શप೾਺ଳҬ ઢܗৼ෯ Ґ૬ʢʂʣ

͍ΖΜͳԻָಛ௃ྔͷՄࢹԽ΋Ͱ͖Δ 14 ΫϩϚάϥϜ ʢ֤Իͷ੒෼ͷڧ͞ʣ εϖΫτϧಛ௃ྔ ʢԻͷ໌Δ͞ɾ ͟Β͖ͭ౳ʣ $POTUBOU2εϖΫτϩάϥϜ ʢ௿Իͷ෼ղೳΛ্͛ͨεϖΫτϩάϥϜʣ .'$$ ʢԻ৭ʹؔ͢Δಛ௃ྔʣ

Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍࡯ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹ൒ࣗಈͳʣΞϊςʔγϣϯ 15

Իָʹ͸͞·͟·ͳཁૉؚ͕·ΕΔ͕… 16 Sonic visualiserʹΑΔԻָ෼ੳ • Ϗʔτɼςϯϙ • Իָߏ଄ʢAϝϩɼαϏ౳ʣ • ϐονɾԻߴʢָේʣ • ίʔυਐߦ • Ի৭ʢ෼ੳ্Ͱ͸Իڹಛ௃ྔͱ͠ ͯهड़ʣ

Sonic visualiserͷϓϥάΠϯΛ࢖͑͹ࣗಈͰղੳͰ͖·͢ʂ 17 Sonic visualiserʹΑΔԻָ෼ੳ Ϗʔτʢᒵઢʣͱςϯϙʢࠨ্ʣ by Tempo and Beat tracker ίʔυਐߦ by Chordino ϝϩσΟݕग़ by Melodia ଞʹ΋Իූͷ࠾ේ΍Ωʔͷࣝผ౳৭ʑ

۠ؒΛબΜͰ෼ੳ͔͚Δ͚ͩ 18 Sonic visualiserʹΑΔԻָ෼ੳ ख๏ͷ νϡʔχϯά΋Մೳ

Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍࡯ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹ൒ࣗಈͳʣΞϊςʔγϣϯ 19

Իָσʔλʹରͯ͠ϥϕϧΛ͚ͭΔ͜ͱ 20 Ξϊςʔγϣϯ EXɿίʔυਐߦਪఆ C C C G Am Am Em ϥϕϧ σʔληοτ࡞੒ʹෆՄܽɽ Իָͷ৔߹ɼϥϕϧ͕ۂશମͷ৔߹ ʢՎख໊ɼδϟϯϧ౳ʣͱɼ ۂதͷҰࠁҰࠁͷ৔߹ʢίʔυਐߦɼ Ϗʔτ౳ʣ͕ଘࡏ →஌͕ࣝͳ͍ͱ೉͍͠͠ΊͪΌେม

ʮݟͯʯʮௌ͍ͯʯʮ(࣌ʹ͸) ΍ͬͯ΋Β͏ʯΞϊςʔγϣϯ͕Մೳʂ 21 • ݟΔɿεϖΫτϩάϥϜ΍͍ΖΜͳಛ௃ྔΛՄࢹԽͰ͖Δ • ௌ͘ɿ΋ͪΖΜϓϨΠόοΫػೳ΋͋Δ • ΍ͬͯ΋Β͏ɿࣗಈղੳػೳ -> ޡࣝผΛमਖ਼ͯ࣌ؒ͠୹ॖ Sonic visualiserʹΑΔΞϊςʔγϣϯ BmͰ͸ͳ͘Bm7 8ΫϦοΫ ϥϕϧΛฤू ͯ͠௚͢

Իָͷ֤ཁૉʹ߹ΘͤͨϥϕϧʹରԠՄೳʂ 22 ଟछଟ༷ͳੑ࣭ͷϥϕϧΛαϙʔτ Time instance labelɿϥϕϧ+࣌ࠁɽ ϏʔτɼυϥϜͷԻූ౳ Time value labelɿ࿈ଓ஋+࣌ࠁɽϐον౳ NotesɿԻߴ+։࢝࣌ࠁ+ऴྃ࣌ࠁɽ MIDI౳ͷָේσʔλ Region labelɿϥϕϧ+։࢝࣌ࠁ+ऴྃ࣌ࠁɽ ίʔυਐߦɼηΫγϣϯɼ ΠϕϯτʢόοΫίʔϥεग़ݱ෦ʣ౳

ػցֶश౳ͷ෼ੳʹ͔͚Δͷ΋ϥΫϥΫ • ϥϕϧ͸CSVͰΠϯϙʔτ/ΤΫεϙʔτՄೳ • [࣌ؒ, ϥϕϧ]ͱ͍͏ྻܗࣜͰΤΫεϙʔτͰ͖Δ • ෼ੳࡁΈͷϥϕϧͷՄࢹԽ΋Մೳ 23 ϝϩσΟͷϐονΛ ΤΫεϙʔτ ֤ྻ͕ͲΜͳ஋͔ࢦఆ ͯ͠Πϯϙʔτ

Sonic visualiserΛ༻͍ͯߦΘΕͨ෼ੳ/࡞ΒΕͨσʔληοτ 24 • ϝλϧԻָͷεΫϦʔϜͷ෼ੳ • δϟζͷε΢Οϯά౓ • ༗໊ϰΝΠΦϦχετͷԋ૗෼ੳɾࣝผ • ՎএͷϐονͷͣΕͷ෼ੳ • ೆΠϯυ (Cartanic music) ͷଧָثԻָͷ෼ੳ • ҟͳΔ࢒ڹ؀ڥ͕ϐΞϊԋ૗ͷςϯϙʹٴ΅͢Өڹ • Վ੠ͱ࿩੠ͷൃԻͷҧ͍ͷ෼ੳ • etc… ݚڀऀͨͪ΋ޚ༻ୡ • AVP: ϘΠεύʔΧογϣϯ • SAMBASET: αϯόԋ૗ • EMOPIA: ϐΞϊԋ૗ͱײ৘෼ੳ • Dagstuhl ChoirSet: ߹এ • CBF dataset: தࠃͷԣథͷԋ૗ςΫχοΫ • etc… ෼ੳ σʔληοτ ʢจݙ৘ใ͸ޙ΄Ͳܝࡌ͠·͢m(_ _)mʣ

͓ΘΓʹɿSonic visualiserͰͰ͖Δ͜ͱ 25 • 1ɽσʔλ/ϝλσʔλͷ؍࡯ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹ൒ࣗಈͳʣΞϊςʔγϣϯ Իָͷ෼ੳͰ͖Δ෯͕޿͕Γ·͢ʂ ͥͻSonic VisualiserΛ࢖ͬͯΈ͍ͯͩ͘͞ʂʂ https://www.sonicvisualiser.org/

End

ܑఋʢʁʣ෼ • Tonyʀࣖίϐπʔϧ • ୯Իԋ૗ͷ࠾ේʹಛԽͨ͠ɼεϖΫτϩάϥϜΛݟͳ͕Β࠾ේͷͰ͖Δ ศརͳπʔϧ • https://www.sonicvisualiser.org/tony/ 27

ܑఋʢʁʣ෼ • Sonic annotator • Sonic visualiserͷԻָ෼ੳΛίϚϯυϥΠϯͰ΍ͬͯ͘ΕΔ΋ͷ • https://vamp-plugins.org/sonic-annotator/ 28

qiitaͷهࣄ΋ॻ͍ͯ·ͨ͠ • https://qiita.com/yamathcy/items/db0626d01bb2c1f40107 • ޙฤΛ࡞͍ͬͯͳ͍ 29