Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Do It Yourself: Sonic Visualiserで音楽分析してみよう
Search
Yuya Yamamoto
June 29, 2022
Research
0
1k
Do It Yourself: Sonic Visualiserで音楽分析してみよう
2022年6月29日に行われたMusic×Analytics Meetup Vol.8 のLT発表資料です.
(一部修正予定)
Yuya Yamamoto
June 29, 2022
Tweet
Share
More Decks by Yuya Yamamoto
See All by Yuya Yamamoto
GMI44@Music and Language研究のサーベイ報告
yamathcy
1
130
APSIPA 2023 Toward Leveraging Pre-Trained Self-Supervised Frontends for Automatic Singing Voice Understanding Tasks: Three Case Studies
yamathcy
0
59
muana vol.11 音楽識別の事前学習モデル
yamathcy
1
640
国際会議ISMIR2022報告(山本分)
yamathcy
0
140
2022年度情報学学位プログラム説明会 学生体験談
yamathcy
0
130
LSPC博士前期チュートリアル
yamathcy
0
160
MULTIMODAL METRIC LEARNING FOR TAG-BASED MUSIC RETRIEVAL@ICASSP2021読み会
yamathcy
0
1.8k
SIGMUS130-yamamoto
yamathcy
0
52
#muana IRM
yamathcy
0
2.3k
Other Decks in Research
See All in Research
20240719_第2回熊本の交通を語る会
trafficbrain
0
460
marukotenant01/tenant-20240916
marketing2024
0
230
「確率的なオウム」にできること、またそれがなぜできるのかについて
eumesy
PRO
7
2.9k
研究の進め方 ランダムネスとの付き合い方について
joisino
PRO
49
17k
第60回名古屋CV・PRMU勉強会:CVPR2024論文紹介(Vision Transformer)
waka_90b
1
180
ヘルプデスクの事例で学ぶAIエージェント
masatoto
14
7.9k
MIRU2024_招待講演_RALF_in_CVPR2024
udonda
1
320
Weekly AI Agents News! 8月号 論文のアーカイブ
masatoto
1
120
Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences
sgk
1
280
工学としてのSRE再訪 / Revisiting SRE as Engineering
yuukit
18
10k
多様かつ継続的に変化する環境に適応する情報システム/thesis-defense-presentation
monochromegane
1
400
Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve
eumesy
PRO
6
1.1k
Featured
See All Featured
Fontdeck: Realign not Redesign
paulrobertlloyd
81
5.2k
The Invisible Customer
myddelton
119
13k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
246
1.3M
Building a Modern Day E-commerce SEO Strategy
aleyda
38
6.8k
Designing for humans not robots
tammielis
249
25k
Visualization
eitanlees
143
15k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
Rebuilding a faster, lazier Slack
samanthasiow
79
8.6k
Automating Front-end Workflow
addyosmani
1365
200k
Typedesign – Prime Four
hannesfritz
39
2.3k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
46
2k
Building Adaptive Systems
keathley
38
2.2k
Transcript
Do It Yourself: Sonic VisualiserͰԻָੳͯ͠ΈΑ͏ ʙσʔληοτͷϋϯυϦϯάఴ͑ͯʙ 2022/06/29 Music × Analytics
meetup vol.8 ࢁຊ ༤ (yamatchy)
ࣗݾհ • ࢁຊ ༤ (yamatchy) • ஜେֶେֶӃ D2 • ઐɿԻָɾԻڹใॲཧ
• ʮՎএɾԋͱϓϨΠϠʔɾϦεφʔͷΩϡʔϐουʯ Λ࡞Γ͍ͨ • ͦͷϚονϯάͷצॴͲ͜ʹ͋Δͷ͔ʁΛ͍ଓ͚ ࣦഊͷຖ • ͖ͳΞʔςΟετɿΰʔϧσϯϘϯόʔ 2 จࣥචதͷ ͕ͨ͢ ͢Έ͔ɿ ͭ͘ͷ
࠷ॳʹؔͳ͍ʢʁʣએ • ԻָใॲཧͷπʔϧΛ·ͱΊͯ·͢ • python/matlabଞͷϥΠϒϥϦɾσεΫτοϓΞϓϦ • αʔϕΠࢿྉɾϨΫνϟʔࢿྉʢͨͩ͠શ෦ӳޠʣ • https://github.com/yamathcy/awesome-music- infomatics
• Έͳ͞ΜԿ͔͍ͬͯͨΒPRʹͯՃ͓ئ͍ ͠·͢ʂ 3
ຊʹೖΓ·͢
ࠓͷ • Sonic visualiserͷڭ հ 5 ఘϝϩϯ༷ͷπΠʔτΑΓ https://twitter.com/_Akira_Melon_/status/ 1538172760622776321 ͜ͷπʔϧ
Sonic visualiserͱ • Queen MaryେֶͷCentre for digital music άϧʔϓ࡞ͷԻָੳͷͨΊͷιϑτΣΞ •
ֶज़༻ʹ͘༻͍ΒΕΔʢओʹσʔλ ηοτΛ࡞ΔΞϊςʔγϣϯతʣ • จग़ͯΔ • https://www.sonicvisualiser.org/ 6 $ISJT$BOOBN $ISJTUJBO-BOEPOF BOE.BSL4BOEMFS 4POJD7JTVBMJTFS "O0QFO4PVSDF"QQMJDBUJPOGPS7JFXJOH "OBMZTJOH BOE"OOPUBUJOH .VTJD"VEJP'JMFT JO1SPDFFEJOHTPGUIF"$..VMUJNFEJB *OUFSOBUJPOBM$POGFSFODF
wavΛಡΈࠐΜͰදࣔͯ͠৭ʑΔͱ… 7 UIͷશମਤ
wavΛಡΈࠐΜͰදࣔͯ͠৭ʑΔͱ… 8 UIͷશମਤ 🤔ʁ
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 9
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 10
σʔλɾϝλσʔλͷ؍ 11 εϖΫτϩάϥϜ ʢ࣌ؒ͝ͱͷपղੳ݁Ռʣ ৴߸ܗ εϖΫτϥϜ ʢ͋Δ࣌ͷ पղੳͷ݁Ռʣ ♪ϩϏϯιϯ/εϐοπ
σʔλɾϝλσʔλͷ؍ 12 όοΫίʔϥε ग़ݱ෦ Վͷϐον ʢ੨ۂઢʣ ՎͷԻූ ʢࠇઢʣ ίʔυਐߦ ʢλΠϛϯάɿઢʣ
♪ϩϏϯιϯ/εϐοπ
εϖΫτϩάϥϜදࣔͷόϦΤʔγϣϯ͕ͱʹ͔͍͘͢͝ 13 )[·Ͱ E#ৼ෯ ϐʔΫप ͷΈڧௐ શपଳҬ ઢܗৼ෯ Ґ૬ʢʂʣ
͍ΖΜͳԻָಛྔͷՄࢹԽͰ͖Δ 14 ΫϩϚάϥϜ ʢ֤Իͷͷڧ͞ʣ εϖΫτϧಛྔ ʢԻͷ໌Δ͞ɾ ͟Β͖ͭʣ $POTUBOU2εϖΫτϩάϥϜ ʢԻͷղೳΛ্͛ͨεϖΫτϩάϥϜʣ .'$$
ʢԻ৭ʹؔ͢Δಛྔʣ
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 15
Իָʹ͞·͟·ͳཁૉؚ͕·ΕΔ͕… 16 Sonic visualiserʹΑΔԻָੳ • Ϗʔτɼςϯϙ • ԻָߏʢAϝϩɼαϏʣ • ϐονɾԻߴʢָේʣ
• ίʔυਐߦ • Ի৭ʢੳ্ͰԻڹಛྔͱ͠ ͯهड़ʣ
Sonic visualiserͷϓϥάΠϯΛ͑ࣗಈͰղੳͰ͖·͢ʂ 17 Sonic visualiserʹΑΔԻָੳ Ϗʔτʢᒵઢʣͱςϯϙʢࠨ্ʣ by Tempo and Beat
tracker ίʔυਐߦ by Chordino ϝϩσΟݕग़ by Melodia ଞʹԻූͷ࠾ේΩʔͷࣝผ৭ʑ
۠ؒΛબΜͰੳ͔͚Δ͚ͩ 18 Sonic visualiserʹΑΔԻָੳ ख๏ͷ νϡʔχϯάՄೳ
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 19
Իָσʔλʹରͯ͠ϥϕϧΛ͚ͭΔ͜ͱ 20 Ξϊςʔγϣϯ EXɿίʔυਐߦਪఆ C C C G Am Am
Em ϥϕϧ σʔληοτ࡞ʹෆՄܽɽ Իָͷ߹ɼϥϕϧ͕ۂશମͷ߹ ʢՎख໊ɼδϟϯϧʣͱɼ ۂதͷҰࠁҰࠁͷ߹ʢίʔυਐߦɼ Ϗʔτʣ͕ଘࡏ →͕ࣝͳ͍ͱ͍͠͠ΊͪΌେม
ʮݟͯʯʮௌ͍ͯʯʮ(࣌ʹ) ͬͯΒ͏ʯΞϊςʔγϣϯ͕Մೳʂ 21 • ݟΔɿεϖΫτϩάϥϜ͍ΖΜͳಛྔΛՄࢹԽͰ͖Δ • ௌ͘ɿͪΖΜϓϨΠόοΫػೳ͋Δ • ͬͯΒ͏ɿࣗಈղੳػೳ ->
ޡࣝผΛमਖ਼ͯ࣌ؒ͠ॖ Sonic visualiserʹΑΔΞϊςʔγϣϯ BmͰͳ͘Bm7 8ΫϦοΫ ϥϕϧΛฤू ͯ͢͠
Իָͷ֤ཁૉʹ߹ΘͤͨϥϕϧʹରԠՄೳʂ 22 ଟछଟ༷ͳੑ࣭ͷϥϕϧΛαϙʔτ Time instance labelɿϥϕϧ+࣌ࠁɽ ϏʔτɼυϥϜͷԻූ Time value labelɿ࿈ଓ+࣌ࠁɽϐον
NotesɿԻߴ+։࢝࣌ࠁ+ऴྃ࣌ࠁɽ MIDIͷָේσʔλ Region labelɿϥϕϧ+։࢝࣌ࠁ+ऴྃ࣌ࠁɽ ίʔυਐߦɼηΫγϣϯɼ ΠϕϯτʢόοΫίʔϥεग़ݱ෦ʣ
ػցֶशͷੳʹ͔͚ΔͷϥΫϥΫ • ϥϕϧCSVͰΠϯϙʔτ/ΤΫεϙʔτՄೳ • [࣌ؒ, ϥϕϧ]ͱ͍͏ྻܗࣜͰΤΫεϙʔτͰ͖Δ • ੳࡁΈͷϥϕϧͷՄࢹԽՄೳ 23 ϝϩσΟͷϐονΛ
ΤΫεϙʔτ ֤ྻ͕ͲΜͳ͔ࢦఆ ͯ͠Πϯϙʔτ
Sonic visualiserΛ༻͍ͯߦΘΕͨੳ/࡞ΒΕͨσʔληοτ 24 • ϝλϧԻָͷεΫϦʔϜͷੳ • δϟζͷεΟϯά • ༗໊ϰΝΠΦϦχετͷԋੳɾࣝผ •
ՎএͷϐονͷͣΕͷੳ • ೆΠϯυ (Cartanic music) ͷଧָثԻָͷੳ • ҟͳΔڹڥ͕ϐΞϊԋͷςϯϙʹٴ΅͢Өڹ • ՎͱͷൃԻͷҧ͍ͷੳ • etc… ݚڀऀͨͪޚ༻ୡ • AVP: ϘΠεύʔΧογϣϯ • SAMBASET: αϯόԋ • EMOPIA: ϐΞϊԋͱײੳ • Dagstuhl ChoirSet: ߹এ • CBF dataset: தࠃͷԣథͷԋςΫχοΫ • etc… ੳ σʔληοτ ʢจݙใޙ΄Ͳܝࡌ͠·͢m(_ _)mʣ
͓ΘΓʹɿSonic visualiserͰͰ͖Δ͜ͱ 25 • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ ԻָͷੳͰ͖Δ෯͕͕Γ·͢ʂ
ͥͻSonic VisualiserΛͬͯΈ͍ͯͩ͘͞ʂʂ https://www.sonicvisualiser.org/
End
ܑఋʢʁʣ • Tonyʀࣖίϐπʔϧ • ୯Իԋͷ࠾ේʹಛԽͨ͠ɼεϖΫτϩάϥϜΛݟͳ͕Β࠾ේͷͰ͖Δ ศརͳπʔϧ • https://www.sonicvisualiser.org/tony/ 27
ܑఋʢʁʣ • Sonic annotator • Sonic visualiserͷԻָੳΛίϚϯυϥΠϯͰͬͯ͘ΕΔͷ • https://vamp-plugins.org/sonic-annotator/ 28
qiitaͷهࣄॻ͍ͯ·ͨ͠ • https://qiita.com/yamathcy/items/db0626d01bb2c1f40107 • ޙฤΛ࡞͍ͬͯͳ͍ 29