4FMG$POEJUJPOFE$5$ͱͦͷൃల 5BUTVZB,PNBUTV 4FOJPS3FTFBSDI4DJFOUJTU -*/&$PSQPSBUJPO

ຊ೔ͷ಺༰ɿ4FMG$POEJUJPOFE$5$ • 4FMGDPOEJUJPOFE$5$ • $5$ʹجͮ͘ඇࣗݾճؼܕԻ੠ೝࣝํࣜ • ߴ଎ʹਪ࿦͕ՄೳɺࣗݾճؼܕԻ੠ೝࣝʹඖఢ͢Δਪ࿦ਫ਼౓ • جຊख๏ͱͦͷൃలܗʹ͍ͭͯ঺հ &ODPEFS O &ODPEFS O &ODPEFS -JOFBS4PGUNBY -JOFBS $5$ $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP 0VUQVUUPLFO 4FMGDPOEJUJPOJOH

$5$ʹجͮ͘ඇࣗݾճؼܕԻ੠ೝࣝ ࠓ࠷΋ߴ͍֬཰Λ࣋ͭจࣈΛฒ΂ͯ ͗Ύͬͱ·ͱΊΔͱਖ਼ղʹͳΔΑ͏ʹֶश͢Δ ܁Γฦ͠ χϡʔϥϧωοτ ͜ Μ Μ ʹ ͪ ͸ ͸ ͜Μʹͪ͸ 1. p(こ) = 0.7 2. p(＿) = 0.2 3. p(藤) = 0.0001 $POOFDUJPOJTU5FNQPSBM$MBTTJGJDBUJPO<(SBWFT> ͜ ࣗݾճؼܕํࣜ ʹਫ਼౓͸ߴ͍͕͋·Γ଎͘ͳ͍ "UUFOUJPO&OD%FD<$IPSPXTLJ> 3//5SBOTEVDFS<(SBWFT> ֤จࣈ͸ಠཱʹਪఆʢ৚݅෇͖ಠཱͷԾఆʣ ʹߴ଎͕ͩਫ਼౓͸ͦ͜·Ͱߴ͘ͳ͍ • ߴ଎ʹਪ࿦͕Ͱ͖Δೝࣝํࣜ

$5$ʹجͮ͘ඇࣗݾճؼܕԻ੠ೝࣝ &ODPEFS O &ODPEFS O &ODPEFS $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP • ԻڹΤϯίʔμͱ$5$σίʔμͰߏ੒ ʢ5SBOTGPSNFS$POGPSNFSʣ • จࣈؒͷ৚݅෇͖ಠཱੑΛԾఆ • ߴ଎͕ͩਫ਼౓͸ͦ͜·Ͱߴ͘ͳ͍ 0VUQVUUPLFO ߴ଎͞Λอͪͭͭ ਫ਼౓Λߴ͍ͨ͘͠

ઌߦݚڀɿ*OUFSNFEJBUF$5$<-FF > &ODPEFS O &ODPEFS O &ODPEFS -JOFBS4PGUNBY $5$ $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP 0VUQVUUPLFO தؒ૚Ͱ$5$ϩεΛܭࢉ͠ਖ਼ଇԽ γϯϓϧ͕ͩͱͯ΋ޮՌత

ઌߦݚڀɿ*OUFSNFEJBUF$5$<-FF > &ODPEFS O &ODPEFS O &ODPEFS -JOFBS4PGUNBY $5$ $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP 0VUQVUUPLFO தؒ૚Ͱ$5$ϩεΛܭࢉ͠ਖ਼ଇԽ γϯϓϧ͕ͩͱͯ΋ޮՌత தؒ૚Ͱͷೝࣝ݁ՌΛ ΋ͬͱ༗ޮར༻Ͱ͖ΔͷͰ͸ʁ

4FMGDPOEJUJPOFE$5$ &ODPEFS O &ODPEFS O &ODPEFS -JOFBS4PGUNBY -JOFBS $5$ $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP 0VUQVUUPLFO 4FMGDPOEJUJPOJOH தؒ૚ͷೝࣝ݁ՌΛޙஈʹϑΟʔυόοΫ ʹೝࣝ݁ՌΛߟྀ͠ͳ͕ΒͷΤϯίʔυΛՄೳʹ ʹจࣈؒͷؔ܎ੑΛֶ΂Δʂʂ

࣮ݧ݁Ռɿࣗݾճؼܕͱඖఢ͢ΔੑೳΛୡ੒ ࣗݾճؼܕʹൺ΂ͯʜ ഒߴ଎ ಉ౳ͷ8&3

ग़ྗ݁Ռͷྫ • ૚ΛܦΔ͝ͱʹೝࣝ݁Ռ͕վળ͞ΕͯΏ͘

ଞͷඇࣗݾճؼܕํࣜͱͷൺֱ • ࠷৽ख๏ͷதͰτοϓੑೳ <)JHVDIJ "436> ଎౓ɺਫ਼౓ͱ΋ʹ τοϓͷੑೳ

ଞͷඇࣗݾճؼܕํࣜͱͷൺֱ • ࠷৽ख๏ͷதͰτοϓੑೳ <)JHVDIJ "436> தؒ૚ʹ͓͚Δ༧ଌͱޙஈ΁ͷϑΟʔυόοΫ͢Δ 4FMG$POEJUJPOJOH͸ۃΊͯ༗ޮʹ࡞༻͍ͯ͠Δ

ଞͷඇࣗݾճؼܕํࣜͱͷൺֱ • ࠷৽ख๏ͷதͰτοϓੑೳ <)JHVDIJ "436> ଞͷඇࣗݾճؼํࣜͱͷؔ࿈͸ʁ

ଞͷඇࣗݾճؼܕԻ੠ೝࣝͱͷؔ࿈ • $5$ग़ྗʹର͢ΔඇࣗݾճؼσίʔμΛ༻͍ͨ܁Γฦ͠վળ &"$IJFUBM "MJHO3FGJOF/PO"VUPSFHSFTTJWF4QFFDI3FDPHOJUJPOWJB*UFSBUJWF3FBMJHONFOU :)JHVDIJ FUBM .BTL$5$/PO"VUPSFHSFTTJWF&OEUP&OE"43XJUI$5$BOE.BTL1SFEJDU .BTL$5$ "MJHO3FGJOF ʢ܁Γฦ͠ʣ ྑ͘͢Δ ݁ՌΛʜ ྑ͘͢Δ ݁ՌΛʜ ྑ͘͢Δ ݁ՌΛʜ

Self-conditioned CTCΛ΋͏Ұ౓ݟͯΈΔ CTC Input Target label Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ CTC CTC Output Output Output (intermediate) (intermediate) Linear!→# + Softmax Linear!→# + Softmax Linear#→! Linear!→# + Softmax Linear#→! ܁Γฦ͠ํࣜͱಉ౳ͷॲཧΛ ಺෦Ͱߦ͍ͬͯΔʁ ʢதؒʣ݁ՌΛʜ ྑ͘͢Δ ʢதؒʣ݁ՌΛʜ ྑ͘͢Δ

ൃలܗ΁ͷ͍͔ͭ͘ͷΞΠσΞ CTC Input Target label Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ CTC CTC Output Output Output (intermediate) (intermediate) Linear!→# + Softmax Linear!→# + Softmax Linear#→! Linear!→# + Softmax Linear#→! ʢதؒʣ݁ՌΛʜ ྑ͘͢Δ ʢதؒʣ݁ՌΛʜ ྑ͘͢Δ ᶃ தؒೝࣝ݁ՌʹΘ͟ͱޡΓΛ෇༩ ʮ܁Γฦͯ͠ྑ͘͢ΔʯΛΑΓ͏·ֶ͘श ˠ *OUFS"VH ᶄ தؒ૚͝ͱʹ׽ࣈͱಡΈΛަޓʹֶश ׽ࣈͱಡΈͷ૬ޓؔ܎Λֶश ˠ "MUFSOBUF$POEJUJPOJOH<'VKJUB 4-5> ᶅ ܁Γฦ͠ߏ଄ʹண໨ ಉҰͷ໾ׂΛ࣋ͭ෦෼Λ·ͱΊͯܰྔԽ ˠ 'PMEFE &ODPEFS<,PNBUTV *$"441>

ᶃ*OUFS"VH CTC Input Target label Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ CTC CTC Output Output Output (intermediate) (intermediate) Linear!→# + Softmax Linear!→# + Softmax Linear#→! Linear!→# + Softmax Linear#→! தؒ૚༧ଌʹରͯ͠Θ͟ͱޡΓΛ෇༩ தؒ૚$5$ͷ܁Γฦ͠ʹΑΓվળ ԿΛʮྑ͘͢Δʯ͔Λ໌ࣔతʹֶश 𝐈𝐧𝐭𝐞𝐫𝐀𝐮𝐠 𝐈𝐧𝐭𝐞𝐫𝐀𝐮𝐠

ᶃ*OUFS"VH • 4FMGDPOEJUJPOFE$5$Λ্ճΔೝࣝਫ਼౓Λୡ੒ • ॴ๬ͷޡΓʹର͢Δؤ݈ੑΛ֫ಘ

ᶄ "MUFSOBUF$POEJUJPOJOH<'VKJUB 4-5> • ಉԻҟࣈ΍׽ࣈ͕࣋ͭෳ਺ͷൃԻ͸೔ຊޠԻ੠ೝࣝͷ՝୊ • දهͱൃԻͷ૬ޓ࡞༻Λߟྀͨ͠ϚϧνλεΫֶश :'VKJUBFUBM "MUFSOBUF*OUFSNFEJBUF$POEJUJPOJOHXJUI4ZMMBCMFMFWFMBOE$IBSBDUFSMFWFM5BSHFUTGPS+BQBOFTF"43 දه΁ Իઅ͔Β දه΁ Իઅ͔Β Իઅ΁ දه͔Β

ᶄ "MUFSOBUF$POEJUJPOJOH<'VKJUB 4-5> • $4+ͰධՁɺදهͱൃԻͷਫ਼౓͕ಉ࣌ʹ޲্͢Δ͜ͱΛ֬ೝ

ᶅ 'PMEFE&ODPEFS<,PNBUTV *$"441> CTC Input Target label Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ CTC CTC Output Output Output (intermediate) (intermediate) ֤ઢܗ૚͸ڞ௨ͷύϥϝʔλ ೖग़ྗ͸ಉҰͷ্ۭؒʹࣹӨ Linear!→# + Softmax Linear!→# + Softmax Linear#→! Linear!→# + Softmax Linear#→! JOQVU ྨࣅͷೖग़ྗؔ܎ PVUQVU JOQVU PVUQVU

Linear!→# + Softmax Linear!→# + Softmax Linear#→! CTC Input Target label Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ Encoder Layer Encoder Layer ⋮ Linear!→# + Softmax Linear#→! CTC CTC Output Output Output (intermediate) (intermediate) 4IBSFE 1BSBNFUFST ಉҰͷ໾ׂΛ࣋ͭΤϯίʔμϒϩοΫΛ ύϥϝʔλڞ௨ԽʹܰྔԽ ܁Γฦ͠ར༻ 'PMEFE &ODPEFS #BTF &ODPEFS ᶅ 'PMEFE&ODPEFS<,PNBUTV *$"441>

ᶅ 'PMEFE&ODPEFS<,PNBUTV *$"441> • 4FMGDPOEJUJPOFE$5$ͷੑೳΛอͪͳ͕Βύϥϝʔλ࡟ݮ

ͦͷଞͷൃలܗ • ͳͥੑೳ޲্͢Δ͔ΛఆࣜԽɺ ਪ࿦࣌ʹΑΓΑ͍தؒ༧ଌͰ$POEJUJPOJOH • #FUUFSJOUFSNFEJBUFT<,PNBUTV *OUFSTQFFDI> • ֶश࣌ʹ௥Ճͷதؒ૚ਖ਼ଇԽ • *OUFS%FDPEFS <,PNBUTV 4-5> • ࿩ऀμΠΞϥΠθʔγϣϯ΁ͷԠ༻ • 4FMG$POEJUJPOFE/PO"VUPSFHSFTTJWF"UUSBDUPS<'VKJUB *$"441>

#FUUFS*OUFSNFEJBUFT <,PNBUTV *OUFSTQFFDI> 4FBSDIFEJOUFSNFEJBUFDPOEJUJPOJOH &ODPEFS O &ODPEFS O &ODPEFS -JOFBS4PGUNBY &NCFEEJOH "MJHONFOU 7JUFSCJ #FBN TFBSDI $5$ $5$ &YUFSOFM -. -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP 0VUQVUUPLFO $POGPSNFS$5$ 4FMGDPOEJUJPOJOH ᶃ 'SBNFXJTF UPLFOQSPCBCJMJUZ ᶄ&TUJNBUF UPLFOTFRVFODF ᶅ "MJHOFTUJNBUFEUPLFOT UPGSBNFXJTFQSPCBCJMJUZ *NQSPWFJOUFSNFEJBUFQSFEJDUJPOCZ BOFYUFSOBM-.BOECFBNTFBSDI (𝑇×𝑉) (𝑇×𝐷) (𝑇×𝐷) (𝑇×1) (𝐿×1)

#FUUFS*OUFSNFEJBUFT <,PNBUTV *OUFSTQFFDI> .VMUJQBTTDPOEJUJPOJOH &ODPEFS O &ODPEFS O &ODPEFS -JOFBS4PGUNBY &NCFEEJOH "MJHONFOU 7JUFSCJ $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP OE QBTTPVUQVU $POGPSNFS$5$ 4FMGDPOEJUJPOJOH &ODPEFS O &ODPEFS O &ODPEFS $5$ -JOFBS4PGUNBY &ODPEFS / *OQVUBVEJP TU QBTTPVUQVU $POGPSNFS$5$ 4FMG $POEJUJPOJOH &ODP &ODPE &ODP $5 -JOFBS &ODP *OQVU SE QBTT $POGPSNFS$5$ ᶄ "MJHOPVUQVUTPG QSFWJPVTJOGFSFODF ᶃ 'SBNFXJTF UPLFOQSPCBCJMJUZ (𝑇×𝑉) (𝑇×𝐷) (𝑇×𝐷) (𝐿×1)

*OUFS%FDPEFS <,PNBUTV 4-5> • ࣗݾճؼσίʔμΛʢֶश࣌ͷΈʣதؒ૚ͷਖ਼ଇԽͱͯ͠ར༻ )ZCSJE$5$"UUFOUJPOͷߏ଄Λதؒ૚΁ ˠதؒ૚ͷਫ਼౓޲্ TFMGDPOEJUJPOJOHͱ߹Θͤͯ૬৐ޮՌ

࿩ऀμΠΞϥΠθʔγϣϯ΁ͷԠ༻ • /FVSBM%JBSJ[BUJPO XJUI/POBVUPSFHSFTTJWF*OUFSNFEJBUF"UUSBDUPST <'VKJUB *$"441> 𝑋 TransEnc! 𝐴 𝐸" Sigmoid(𝐴#𝐸" ) 𝑌 TransEnc" … Audio sequence Attractors Embeddings Speaker labels LSTM$%& LSTM'$& Autoregressive 𝑋 TransEnc( Audio sequence BEFORE Autoregressive attractor 𝐸( 𝑊𝐴( 𝐸( TransEnc()! + 𝐴( = Attn(𝑄, 𝐸( , 𝐸( ) Sigmoid(𝐴( #𝐸( ) 𝑌( AFTER Non-autoregressive intermediate attractors intermediate prediction conditioning Speaker-wise

·ͱΊ • 4FMG$POEJUJPOFE$5$ʹ͍ͭͯ঺հ • தؒ૚ʹ͓͚Δ༧ଌͱޙஈ΁ͷϑΟʔυόοΫߏ଄͸ۃΊͯ༗ޮ • छʑͷൃలܗʹ͍ͭͯ঺հ • *OUFS"VHɿதؒ૚ʹର͠ޡΓΛ෇༩ֶ͠श • "MUFSOBUF$POEJUJPOJOHɿදهԻૉؒͷؔ܎ੑΛֶश • 'PMEFE&ODPEFSɿ܁Γฦ͠ߏ଄Λ௿ύϥϝʔλԽ • #FUUFS*OUFSNFEJBUFɿΑΓΑ͍தؒ༧ଌʹΑΓ$POEJUJPOJOH • *OUFS%FDPEFSɿதؒ૚ʹର͢Δ௥Ճਖ਼ଇԽ • 4FMG$POEJUJPOFE%JBSJ[BUJPOɿ࿩ऀμΠΞϥΠͥʔγϣϯ΁ͷԠ༻ • ࠓճ঺հͰ͖ͳ͔ͬͨൃలܗ΋ • )JFSBSDIJDBM$POEJUJPOJOH<)JHVDIJ *$"441>ɿཻ౓Λม͑֊૚తʹ$POEJUJPOJOH • (BUFE*OUFSMBZFS$PMMBCPSBUJPO<*$"441>ɿ(BUFߏ଄ΛՃ͑ͨ$POEJUJPOJOH