Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Do It Yourself: Sonic Visualiserで音楽分析してみよう
Search
Yuya Yamamoto
June 29, 2022
Research
0
1.6k
Do It Yourself: Sonic Visualiserで音楽分析してみよう
2022年6月29日に行われたMusic×Analytics Meetup Vol.8 のLT発表資料です.
(一部修正予定)
Yuya Yamamoto
June 29, 2022
Tweet
Share
More Decks by Yuya Yamamoto
See All by Yuya Yamamoto
GMI44@Music and Language研究のサーベイ報告
yamathcy
1
130
APSIPA 2023 Toward Leveraging Pre-Trained Self-Supervised Frontends for Automatic Singing Voice Understanding Tasks: Three Case Studies
yamathcy
0
87
muana vol.11 音楽識別の事前学習モデル
yamathcy
1
730
国際会議ISMIR2022報告(山本分)
yamathcy
0
170
2022年度情報学学位プログラム説明会 学生体験談
yamathcy
0
160
LSPC博士前期チュートリアル
yamathcy
0
180
MULTIMODAL METRIC LEARNING FOR TAG-BASED MUSIC RETRIEVAL@ICASSP2021読み会
yamathcy
0
1.8k
SIGMUS130-yamamoto
yamathcy
0
62
#muana IRM
yamathcy
0
2.4k
Other Decks in Research
See All in Research
GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization
satai
3
240
SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagery
satai
3
210
Google Agent Development Kit (ADK) 入門 🚀
mickey_kubo
2
1k
時系列データに対する解釈可能な 決定木クラスタリング
mickey_kubo
2
710
20250605_新交通システム推進議連_熊本都市圏「車1割削減、渋滞半減、公共交通2倍」から考える地方都市交通政策
trafficbrain
0
430
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
satai
3
110
RHO-1: Not All Tokens Are What You Need
sansan_randd
1
110
研究テーマのデザインと研究遂行の方法論
hisashiishihara
5
1.4k
Mechanistic Interpretability:解釈可能性研究の新たな潮流
koshiro_aoki
1
290
実行環境に中立なWebAssemblyライブマイグレーション機構/techtalk-2025spring
chikuwait
0
220
Ad-DS Paper Circle #1
ykaneko1992
0
5.5k
SSII2025 [TS2] リモートセンシング画像処理の最前線
ssii
PRO
7
2.8k
Featured
See All Featured
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
10
930
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.3k
Fireside Chat
paigeccino
37
3.5k
Docker and Python
trallard
44
3.4k
Git: the NoSQL Database
bkeepers
PRO
430
65k
Product Roadmaps are Hard
iamctodd
PRO
54
11k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.2k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
2.9k
We Have a Design System, Now What?
morganepeng
53
7.7k
Intergalactic Javascript Robots from Outer Space
tanoku
271
27k
Faster Mobile Websites
deanohume
307
31k
Transcript
Do It Yourself: Sonic VisualiserͰԻָੳͯ͠ΈΑ͏ ʙσʔληοτͷϋϯυϦϯάఴ͑ͯʙ 2022/06/29 Music × Analytics
meetup vol.8 ࢁຊ ༤ (yamatchy)
ࣗݾհ • ࢁຊ ༤ (yamatchy) • ஜେֶେֶӃ D2 • ઐɿԻָɾԻڹใॲཧ
• ʮՎএɾԋͱϓϨΠϠʔɾϦεφʔͷΩϡʔϐουʯ Λ࡞Γ͍ͨ • ͦͷϚονϯάͷצॴͲ͜ʹ͋Δͷ͔ʁΛ͍ଓ͚ ࣦഊͷຖ • ͖ͳΞʔςΟετɿΰʔϧσϯϘϯόʔ 2 จࣥචதͷ ͕ͨ͢ ͢Έ͔ɿ ͭ͘ͷ
࠷ॳʹؔͳ͍ʢʁʣએ • ԻָใॲཧͷπʔϧΛ·ͱΊͯ·͢ • python/matlabଞͷϥΠϒϥϦɾσεΫτοϓΞϓϦ • αʔϕΠࢿྉɾϨΫνϟʔࢿྉʢͨͩ͠શ෦ӳޠʣ • https://github.com/yamathcy/awesome-music- infomatics
• Έͳ͞ΜԿ͔͍ͬͯͨΒPRʹͯՃ͓ئ͍ ͠·͢ʂ 3
ຊʹೖΓ·͢
ࠓͷ • Sonic visualiserͷڭ հ 5 ఘϝϩϯ༷ͷπΠʔτΑΓ https://twitter.com/_Akira_Melon_/status/ 1538172760622776321 ͜ͷπʔϧ
Sonic visualiserͱ • Queen MaryେֶͷCentre for digital music άϧʔϓ࡞ͷԻָੳͷͨΊͷιϑτΣΞ •
ֶज़༻ʹ͘༻͍ΒΕΔʢओʹσʔλ ηοτΛ࡞ΔΞϊςʔγϣϯతʣ • จग़ͯΔ • https://www.sonicvisualiser.org/ 6 $ISJT$BOOBN $ISJTUJBO-BOEPOF BOE.BSL4BOEMFS 4POJD7JTVBMJTFS "O0QFO4PVSDF"QQMJDBUJPOGPS7JFXJOH "OBMZTJOH BOE"OOPUBUJOH .VTJD"VEJP'JMFT JO1SPDFFEJOHTPGUIF"$..VMUJNFEJB *OUFSOBUJPOBM$POGFSFODF
wavΛಡΈࠐΜͰදࣔͯ͠৭ʑΔͱ… 7 UIͷશମਤ
wavΛಡΈࠐΜͰදࣔͯ͠৭ʑΔͱ… 8 UIͷશମਤ 🤔ʁ
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 9
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 10
σʔλɾϝλσʔλͷ؍ 11 εϖΫτϩάϥϜ ʢ࣌ؒ͝ͱͷपղੳ݁Ռʣ ৴߸ܗ εϖΫτϥϜ ʢ͋Δ࣌ͷ पղੳͷ݁Ռʣ ♪ϩϏϯιϯ/εϐοπ
σʔλɾϝλσʔλͷ؍ 12 όοΫίʔϥε ग़ݱ෦ Վͷϐον ʢ੨ۂઢʣ ՎͷԻූ ʢࠇઢʣ ίʔυਐߦ ʢλΠϛϯάɿઢʣ
♪ϩϏϯιϯ/εϐοπ
εϖΫτϩάϥϜදࣔͷόϦΤʔγϣϯ͕ͱʹ͔͍͘͢͝ 13 )[·Ͱ E#ৼ෯ ϐʔΫप ͷΈڧௐ શपଳҬ ઢܗৼ෯ Ґ૬ʢʂʣ
͍ΖΜͳԻָಛྔͷՄࢹԽͰ͖Δ 14 ΫϩϚάϥϜ ʢ֤Իͷͷڧ͞ʣ εϖΫτϧಛྔ ʢԻͷ໌Δ͞ɾ ͟Β͖ͭʣ $POTUBOU2εϖΫτϩάϥϜ ʢԻͷղೳΛ্͛ͨεϖΫτϩάϥϜʣ .'$$
ʢԻ৭ʹؔ͢Δಛྔʣ
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 15
Իָʹ͞·͟·ͳཁૉؚ͕·ΕΔ͕… 16 Sonic visualiserʹΑΔԻָੳ • Ϗʔτɼςϯϙ • ԻָߏʢAϝϩɼαϏʣ • ϐονɾԻߴʢָේʣ
• ίʔυਐߦ • Ի৭ʢੳ্ͰԻڹಛྔͱ͠ ͯهड़ʣ
Sonic visualiserͷϓϥάΠϯΛ͑ࣗಈͰղੳͰ͖·͢ʂ 17 Sonic visualiserʹΑΔԻָੳ Ϗʔτʢᒵઢʣͱςϯϙʢࠨ্ʣ by Tempo and Beat
tracker ίʔυਐߦ by Chordino ϝϩσΟݕग़ by Melodia ଞʹԻූͷ࠾ේΩʔͷࣝผ৭ʑ
۠ؒΛબΜͰੳ͔͚Δ͚ͩ 18 Sonic visualiserʹΑΔԻָੳ ख๏ͷ νϡʔχϯάՄೳ
Sonic visualiserͰͰ͖Δ͜ͱ • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ 19
Իָσʔλʹରͯ͠ϥϕϧΛ͚ͭΔ͜ͱ 20 Ξϊςʔγϣϯ EXɿίʔυਐߦਪఆ C C C G Am Am
Em ϥϕϧ σʔληοτ࡞ʹෆՄܽɽ Իָͷ߹ɼϥϕϧ͕ۂશମͷ߹ ʢՎख໊ɼδϟϯϧʣͱɼ ۂதͷҰࠁҰࠁͷ߹ʢίʔυਐߦɼ Ϗʔτʣ͕ଘࡏ →͕ࣝͳ͍ͱ͍͠͠ΊͪΌେม
ʮݟͯʯʮௌ͍ͯʯʮ(࣌ʹ) ͬͯΒ͏ʯΞϊςʔγϣϯ͕Մೳʂ 21 • ݟΔɿεϖΫτϩάϥϜ͍ΖΜͳಛྔΛՄࢹԽͰ͖Δ • ௌ͘ɿͪΖΜϓϨΠόοΫػೳ͋Δ • ͬͯΒ͏ɿࣗಈղੳػೳ ->
ޡࣝผΛमਖ਼ͯ࣌ؒ͠ॖ Sonic visualiserʹΑΔΞϊςʔγϣϯ BmͰͳ͘Bm7 8ΫϦοΫ ϥϕϧΛฤू ͯ͢͠
Իָͷ֤ཁૉʹ߹ΘͤͨϥϕϧʹରԠՄೳʂ 22 ଟछଟ༷ͳੑ࣭ͷϥϕϧΛαϙʔτ Time instance labelɿϥϕϧ+࣌ࠁɽ ϏʔτɼυϥϜͷԻූ Time value labelɿ࿈ଓ+࣌ࠁɽϐον
NotesɿԻߴ+։࢝࣌ࠁ+ऴྃ࣌ࠁɽ MIDIͷָේσʔλ Region labelɿϥϕϧ+։࢝࣌ࠁ+ऴྃ࣌ࠁɽ ίʔυਐߦɼηΫγϣϯɼ ΠϕϯτʢόοΫίʔϥεग़ݱ෦ʣ
ػցֶशͷੳʹ͔͚ΔͷϥΫϥΫ • ϥϕϧCSVͰΠϯϙʔτ/ΤΫεϙʔτՄೳ • [࣌ؒ, ϥϕϧ]ͱ͍͏ྻܗࣜͰΤΫεϙʔτͰ͖Δ • ੳࡁΈͷϥϕϧͷՄࢹԽՄೳ 23 ϝϩσΟͷϐονΛ
ΤΫεϙʔτ ֤ྻ͕ͲΜͳ͔ࢦఆ ͯ͠Πϯϙʔτ
Sonic visualiserΛ༻͍ͯߦΘΕͨੳ/࡞ΒΕͨσʔληοτ 24 • ϝλϧԻָͷεΫϦʔϜͷੳ • δϟζͷεΟϯά • ༗໊ϰΝΠΦϦχετͷԋੳɾࣝผ •
ՎএͷϐονͷͣΕͷੳ • ೆΠϯυ (Cartanic music) ͷଧָثԻָͷੳ • ҟͳΔڹڥ͕ϐΞϊԋͷςϯϙʹٴ΅͢Өڹ • ՎͱͷൃԻͷҧ͍ͷੳ • etc… ݚڀऀͨͪޚ༻ୡ • AVP: ϘΠεύʔΧογϣϯ • SAMBASET: αϯόԋ • EMOPIA: ϐΞϊԋͱײੳ • Dagstuhl ChoirSet: ߹এ • CBF dataset: தࠃͷԣథͷԋςΫχοΫ • etc… ੳ σʔληοτ ʢจݙใޙ΄Ͳܝࡌ͠·͢m(_ _)mʣ
͓ΘΓʹɿSonic visualiserͰͰ͖Δ͜ͱ 25 • 1ɽσʔλ/ϝλσʔλͷ؍ • 2ɽԻָཁૉͷࣗಈղੳ • 3ɽʢ࣌ʹࣗಈͳʣΞϊςʔγϣϯ ԻָͷੳͰ͖Δ෯͕͕Γ·͢ʂ
ͥͻSonic VisualiserΛͬͯΈ͍ͯͩ͘͞ʂʂ https://www.sonicvisualiser.org/
End
ܑఋʢʁʣ • Tonyʀࣖίϐπʔϧ • ୯Իԋͷ࠾ේʹಛԽͨ͠ɼεϖΫτϩάϥϜΛݟͳ͕Β࠾ේͷͰ͖Δ ศརͳπʔϧ • https://www.sonicvisualiser.org/tony/ 27
ܑఋʢʁʣ • Sonic annotator • Sonic visualiserͷԻָੳΛίϚϯυϥΠϯͰͬͯ͘ΕΔͷ • https://vamp-plugins.org/sonic-annotator/ 28
qiitaͷهࣄॻ͍ͯ·ͨ͠ • https://qiita.com/yamathcy/items/db0626d01bb2c1f40107 • ޙฤΛ࡞͍ͬͯͳ͍ 29