wavenet

Transcript

1. Wavenet 2017/04/27 @soymsk
2. Wavenet • 2016೥ʹDeepMind͕ൃදͨ͠Ի੠߹੒ΞϧΰϦζϜ • Text to Speech(TTS)ͷ෼໺Ͱߴ͍Ի੠߹੒ͷਫ਼౓Λୡ੒͠ ͨɻ • ࣮૷͕ެ։͞Ε͓ͯΒͣɺ·ͨ਺ࣜ΋গͳ͘ɺ࣮ࡍʹͲͷΑ ͏ʹͳ͍ͬͯΔ͔ෆ໌ͳॴ΋ଟ͍ • Concatenate Text to Speech • parametric TTS parametric TTS • PixelRNN • PixelCNN 8BWFOFU +
3. ैདྷͷख๏ • Concatenate Text to Speech • ୹͍Ի੠σʔλΛେྔʹσʔλϕʔεʹ֨ೲ͠ɺͦΕΛͭͳ͗߹ΘͤΔख๏ • طଘͷσʔλΛͭͳ͗߹ΘͤΔ͚ͩͳͷͰɺڧௐɾ੠৭มߋͳͲ͕ۤखɻ· ͨɺ߹੒ޙͷԻ੠ͷͭͳ͕Γ΋ෆࣗવʹͳΓ͕ͪ • parametric TTS • ੜ੒ϞσϧʹΑͬͯԻ੠߹੒͢Δख๏ • ൃ࿩಺༰΍ൃ࿩ऀͷಛ௃ΛϞσϧͷೖྗͱͯ͠ίϯτϩʔϧͤ͞Δ͜ͱ͕Ͱ ͖ΔΑ͏ʹͳͬͨɻ • ͨͩ͠ɺࣗવͳൃ࿩ɺͱ͸ݴ͍೉͍
4. ैདྷख๏
5. Wavenet
6. Wavenet • Wavenet͸աڈͷೖྗσʔλ͔Β࣍ͷԻ੠ σʔλͷ֬཰෼෍Λ༧ଌ͢Δ t: ࣌ࠁ x: ೖྗԻ੠
7. ೖྗԻ੠σʔλ • Ի੠σʔλܗࣜ • ྔࢠԽ: 16bit • αϯϓϦϯάप೾਺: 44.1 kHz (Ի੠CD)
8. Wavenetग़ྗσʔλܗࣜ • Ի੠৴߸͸Ұൠతʹ͸16bitͰྔࢠԽ͞Ε͓ͯΓɺͦ ͷ··Ͱ͸65,536ͷ1 of N ग़ྗϊʔυ͕ඞཁ • ԼهͷΑ͏ʹೖྗ஋Λม׵ͯ͠ѹॖ • Ի੠෼໺Ͱ͸Ұൠతͳѹॖܗࣜ: μ-law 256ϊʔυ·Ͱѹॖ
9. 8BWFOFU ЖMBX෮߸ t-1 0 ࣌ࠁtʹ͓͚Δग़ྗ஋: 1 of 256
10. Dilated causal convolution
11. Dilated causal convolution • ࣌ܥྻͷԻ੠σʔλʹରͯ͠ɺRNNͰ͸ͳ͘ConvolutionͰֶशΛߦ͏ɻ • ৞ΈࠐΈ૚ͷϑΟϧλ਺Λ2ͱ͢ΔͱɺҎԼͷΑ͏ʹ4૚Ͱ͸5͔ͭ͠ΈΒΕͳ͍ɻʢ௨ৗͷ৞ ࠐΈ) • 44.1kHz (Ի੠CD)ͷೖྗΛѻ͏৔߹ɺ1ඵؒͷԻ੠ೖྗ͚ͩͰɺ44100ͷೖྗϊʔυ͕ඞཁ receptive field(ड༰໺) = 5
12. Dilated causal convolution • Dilated causal convolutionͰ͸ೖྗΛNݸඈ͹͠Ͱ࣍ͷ૚ʹೖྗ͢Δɻ • ૚͕ਂ͘ͳΔͨͼʹDilationͷ஋Λഒʹ͢Δ • DilationʹΑͬͯग़ྗϊʔυͷड༰໺Λ૿΍͢͜ͱ͕Ͱ͖Δ
13. Dilated causal convolution • 44100ͷೖྗ΋16૚ͷDilated causal convolution ͰΈΔ͜ͱ͕Մೳ • WavenetͰ͸ɺ࠷େDilation=512·Ͱ૚ΛॏͶ( 1- block )ɺblockΛෳ਺ੵΈॏͶΔߏ଄Λऔ͍ͬͯ Δɻ • ૚Λਂͯ͘͠΋ֶशͰ͖ΔΑ͏ʹResidualNetΛར ༻
15. • http://musyoku.github.io/images/post/ 2016-09-17/dilated_conv.gif
16. RNNͱWavenetͷֶशͷҧ͍ • RNN͸ֶश࣌ɺ࣌ܥྻॱʹσʔλΛೖྗ͍ͯ͘͠ඞཁ͕͋ΔͨΊɺ࣌ؒ ͕͔͔Δɻ • Wavenet͸CNNͷΑ͏ʹɺೖྗσʔλΛ࣌ܥྻʹॲཧ͢Δඞཁ͕ͳ͘ɺ ̍౓ʹωοτϫʔΫʹೖྗ͢ΔͨΊɺֶश͕ૣ͍ • αϯϓϧʹ͍ͭͯɺ࣌ܥྻॱʹֶश͢Δඞཁ͕ͳ͍ Wavenet RNN
17. Wavenetͷߏ଄ filter gate x: input k: layer
18. Conditional Wavenet • Conditional Pixel CNN ͱಉ༷ɺWavenetʹ೚ҙͷύϥϝʔλhಋೖ͢Δ ͜ͱͰɺWavenetΛύϥϝʔλͰૢ࡞ • Global conditions: Wavenetʹൃ࿩ऀͷಛ௃Λֶशͤ͞Δ ύϥϝʔλhʹΑͬͯൃ࿩શମͷதͰͷൃ࿩ऀͷಛ௃Λ࠶ݱͰ͖Δ ex: ฼ࠃޠ͕ҟͳΔൃ࿩ऀͷಛ௃ શͯͷ࣌ؒεςοϓͰ࡞༻͢Δ߲
19. Conditional Wavenet • Local conditions: Wavenetʹݴ༿ͷಛ௃Λֶशͤ͞Δ ݸʑͷ࣌ؒεςοϓͰ࡞༻͢Δ߲ ൃ࿩಺ͷݴޠతಛ௃Λύϥϝʔλͱͯ͠ೖྗͰ͖Δ ex: ୯ޠͷͭͳ͕ΓʹΑͬͯൃ࿩͞Εͳ͍จࣈͳͲʁ
20. ੜ੒݁ՌσϞ https://deepmind.com/blog/wavenet-generative- model-raw-audio/
21. ࣮ݧ݁Ռ • GoogleͷTTSσʔληοτΛར༻ֶͯ͠श • ैདྷख๏ʹൺ΂ͯߴ͍ਫ਼౓Λୡ੒
22. ·ͱΊ • Wavenet͸Ի੠߹੒ͷ෼໺ʹCNNͷख๏Λಋ ೖ͠ɺߴ͍߹੒ਫ਼౓Λୡ੒ͨ͠ • Dilated convolutionʹΑͬͯɺRNNͷΑ͏ʹ࣌ ܥྻσʔλʹ΋ద༻Ͱ͖ΔՄೳੑΛࣔͨ͠ɻ • Ի੠͚ͩͰͳ͘ɺԻָͷ߹੒ͳͲԠ༻ൣғ΋޿ ͍
23. ࢀߟ • https://arxiv.org/abs/1609.03499 • ݪஶPDF • https://deepmind.com/blog/wavenet-generative-model-raw-audio/ • σϞ݁ՌͳͲ • http://musyoku.github.io/2016/09/18/wavenet-a-generative-model-for-raw- audio/ • Chainer࣮૷΍Dilationͷ෦෼͕Θ͔Γ΍͍͢ • https://www.slideshare.net/DeepLearningJP2016/dlwavenet-a-generative- model-for-raw-audio