Slide 1

Slide 1 text

Ի੠৘ใॲཧ΍Ի੠ม׵ʹ ศརͳ (Python) ύοέʔδ΍ ιϑτ΢ΣΞͨͪ 1 ࢖༻ײͳͲࢲݟΛؚΈ·͢

Slide 2

Slide 2 text

TPYQZTPY • ίϚϯυϥΠϯ͔ΒϑΥʔϚοτม׵ͳͲΛ͓खܰʹ • ϑΥʔϚοτม׵ʢwav to mp3 ͳͲʣ • ݁߹΍ϛοΫεɺτϦϛϯά ΋Մೳ • όονॲཧ΋ָʢγΣϧεΫϦϓτͳͲʣ • Pythonϥούʔ pysox΋͋Δ • Πϯετʔϧ • brew install sox ͳͲ • pip install sox ← pysox ͷΠϯετʔϧ͸͜Ε 2

Slide 3

Slide 3 text

MJCSPTBʢ͜Ε͸ຊ౰ʹΦεεϝʣ • Ի੠/Իָͷ෼ੳʹศརͳϞδϡʔϧ͕ଗͬͨύοέʔδ • ެࣜϚχϡΞϧɾνϡʔτϦΞϧͷॆ࣮΋ॿ͔Δ • ݸਓతʹΑ͘࢖͏ػೳ • ೾ܗදࣔɺεϖΫτϩάϥϜදࣔ • Ի੠ಛ௃ྔநग़ʢର਺ϝϧεϖΫτϩάϥϜʣ • Πϯετʔϧ pip install librosa • ެࣜϖʔδ https://librosa.org/librosa/index.html 3

Slide 4

Slide 4 text

1Z8PSME • Ի੠ͷ෼ੳ࠶߹੒Λߦ͏Ϙίʔμʔͷύοέʔδ • Ի੠Λʮ੠৭ɾ੠ͷߴ͞ɾ੠ͷ͔͢Εʯͷ֤੒෼ʹ෼ղ͠࠶߹੒ • C++൛ͷPythonϥούʔ • Ի੠ͷಛ௃ྔநग़ʹ΋࢖͑ͯศར ⇒ PySPTKʢޙड़ʣΑΓ΋඼࣭ͷΑ͍εϖΫτϧแབྷ • Πϯετʔϧ pip install pyworld • ެࣜϖʔδ https://github.com/JeremyCCHsu/Python-Wrapper-for-World-Vocoder 4

Slide 5

Slide 5 text

1Z"VEJP • ετϦʔϜ࿥Ի / ࠶ੜʹศརͳύοέʔδ • ϦΞϧλΠϜͷԻ੠ೖྗɾԻ੠ग़ྗʹ࢖͑Δ • ϦΞϧλΠϜԻ੠ม׵ with PythonͳͲ΋Մೳ • Πϯετʔϧ • pip install pyaudio ※ཁportaudio (e.g., brew install portaudio) 5

Slide 6

Slide 6 text

1Z"VEJPͱ1Z8PSMEͷ૊Έ߹Θͤ • ؆қ൛ͷϘΠενΣϯδϟʔ • ؆қϘΠενΣϯδϟʔͷεΫϦϓτΛվྑɿPyQt5ͷεϥΠμʔʹΑΓ ϐονͱϑΥϧϚϯτΛϦΞϧλΠϜௐ੔͢ΔػೳΛ௥Ճʢฐϒϩάʣ • banibiku • Zoom഑৴޲͚ʹ̎࣍ݩΩϟϥʹͳΓ͖Δ͜ͱΛ໨ࢦͨ͠ϓϩδΣΫτ • scripts/voice_converter.py ͕ྑ͍ײ͡ͷϘΠενΣϯδϟʔ → ฐϒϩάͷαϯϓϧεΫϦϓτͷόάϑΟοΫεؚ͕·ΕΔ 6 https://tam5917.hatenablog.com/entry/2019/04/30/213321 https://github.com/peisuke/babiniku

Slide 7

Slide 7 text

1Z415, • Ի੠৘ใॲཧπʔϧΩοτSPTKͷPythonϥούʔ • SPTKࣗମ͸LinuxίϚϯυ܈ • Իڹಛ௃ྔநग़ʹ࢖͏ͷ͕ศར • Ի੠෼ੳ߹੒΋Ͱ͖Δ͕ɺ඼࣭ࣗମ͸WORLDͷ΄͏্͕ • Πϯετʔϧ pip install pysptk • ެࣜϖʔδ https://pysptk.readthedocs.io/en/latest/ 7

Slide 8

Slide 8 text

OONOLXJJ • DNNԻ੠߹੒ʹ໾ཱͭϞδϡʔϧΛूΊͨύοέʔδ • ͲͪΒ͔ͱ͍͏ͱݚڀ༻్ • લॲཧ΍Իڹಛ௃ྔநग़ͷΫϥε͕Ұ௨Γଗ͍ͬͯΔ • ࿦จͷ࠶ݱ࣮૷Λ͢Δͱ͖ͳͲʹେ͍ʹ໾ཱͭ • Πϯετʔϧ pip install nnmnkwii • ެࣜϖʔδ https://r9y9.github.io/nnmnkwii/stable/index.html 8

Slide 9

Slide 9 text

1ZEVC • Pydub • ೾ܗฤूʹศརͳϞδϡʔϧΛूΊͨύοέʔδ • αϙʔτ͢ΔϑΝΠϧܗࣜ΋๛෋ʢwav, mp3, mp4, wma, aac, ...ʣ • ػೳ ੾Γग़͠ɺ෼ׂɺϛοΫεɺϑΣʔυΠϯΞ΢τɺແԻૠೖɺͳͲͳͲ • Ұ෦ͷػೳ͸ pysoxͷ΄͏͕ߴ଎ͱ͍͏ӟ?ʢະ֬ೝʣ • Πϯετʔϧ pip install pydub • ެࣜϖʔδ http://pydub.com/ 9

Slide 10

Slide 10 text

TQSPDLFU • ౷ܭత੠࣭ม׵ͷͨΊͷπʔϧΩοτ (not ύοέʔδ) • ͲͪΒ͔ͱ͍͏ͱݚڀ༻ ʢMITϥΠηϯεʣ • ݚڀͷʮϕʔεϥΠϯʯߏஙʹ࠷ద • ެࣜϖʔδ https://github.com/k2kobayashi/sprocket • ղઆ࿦จ ʰ౷ܭత੠࣭ม׵ιϑτ΢ΣΞೖ໳ʱ https://www.jstage.jst.go.jp/article/isciesci/62/2/62_69/_article/-char/ja/ • νϡʔτϦΞϧ (εϥΠυ & notebook) https://github.com/kan-bayashi/INTERSPEECH19_TUTORIAL 10

Slide 11

Slide 11 text

"VEBDJUZ ೖΕ͓ͯ͘ͱ҆৺ • ϑϦʔͷ೾ܗฤूιϑτɺϚϧνϓϥοτϑΥʔϜ • ๛෋ͳα΢ϯυΤϑΣΫτՃ޻ػೳ • ެࣜϖʔδ https://www.audacityteam.org/ 11

Slide 12

Slide 12 text

(16্ͰԻ੠ॲཧ͍ͨ͠Ϛϯʹ ͓͢͢Ίͷύοέʔδ 12 ͓·͚

Slide 13

Slide 13 text

UPSDIBVEJP • Pytorchެ͕ࣜαϙʔτ͍ͯ͠ΔԻ੠ॲཧܥϥΠϒϥϦ • Pytorchܥͷਂ૚ֶशϞσϧͱͷ૬ੑ͕ྑ͍ʢͦΕ͸ͦ͏ʣ • ެࣜϖʔδ https://pytorch.org/audio/stable/index.html 13

Slide 14

Slide 14 text

UGTJHOBM • TensorFlowެ͕ࣜαϙʔτ͍ͯ͠ΔԻ੠ॲཧܥͷؔ਺܈ • TFܥͷਂ૚ֶशϞσϧͱͷ૬ੑ͕ྑ͍ʢͦΕ͸ͦ͏ʣ • FFT/iFFT, DCT, MDCT, STFTͳͲ • ެࣜϖʔδ https://www.tensorflow.org/api_docs/python/tf/signal 14

Slide 15

Slide 15 text

UPSDIMJCSPTB • PytorchΛόοΫΤϯυʹͯ͠librosaΛGPU্Ͱಈ͔͢ • Πϯετʔϧ pip install torchlibrosa • ެࣜϖʔδ https://github.com/qiuqiangkong/torchlibrosa 15

Slide 16

Slide 16 text

LBQSF • Kerasʢͱ͍͏͔TFʣΛόοΫΤϯυʹͯ͠Ի੠ॲཧ͢Δ • STFT΍iSTFTɺϝϧεϖΫτϩάϥϜͳͲ • CQTͳͲ͸ͳ͍ • ެࣜϖʔδ https://github.com/keunwoochoi/kapre • Πϯετʔϧ pip install kapre 16

Slide 17

Slide 17 text

OO"VEJP • PytorchΛόοΫΤϯυʹͯ͠STFTͳͲΛGPU্Ͱಈ͔͢ • STFTɺٯSTFTɺCQTͳͲΑ͘࢖͏ಛ௃நग़ܥ͕ଗ͏ • ެࣜϖʔδ https://github.com/KinWaiCheuk/nnAudio 17

Slide 18

Slide 18 text

OO"VEJPʢ͖ͭͮʣ • ൺֱද 18