LINEヤフーの音声AIがもたらす未来：ASR/TTSと対話技術の新たな可能性 / LY Corporation's Speech AI Vision: Towards Realtime Spoken Dialogue through Advanced ASR and TTS

-:$PSQPSBUJPOT4QFFDI"*7JTJPO 5PXBSET3FBMUJNF4QFFDIUP4QFFDI UISPVHI"EWBODFE"43BOE554 4QFFDIBOE"DPVTUJD"*%FQU %BUB4DJFODF(SPVQ +VNQFJ .JZBLF 5BJLJ,JOPTIJUB -*/&ϠϑʔͷԻ੠"*͕΋ͨΒ͢ະདྷɿ"43554ͱର࿩ٕज़ͷ৽ͨͳՄೳੑ

"HFOEB -:$PSQPSBUJPO`T4QFFDI"* -*/&ϠϑʔͷԻ੠"*ʹ͍ͭͯ -:$PSQPSBUJPO`T"43554 -*/&ϠϑʔͷԻ੠ೝࣝɾԻ੠߹੒ͷ঺հ 3FBMUJNF4QFFDIUP4QFFDI ϦΞϧλΠϜ4QFFDIUP4QFFDIٕज़։ൃͷऔΓ૊Έʹ͍ͭͯ
'VUVSF8PSLT ࠓޙͷల๬

-:$PSQPSBUJPO`T4QFFDI"* -*/&ϠϑʔͷԻ੠"*ʹ͍ͭͯ 7JEFPBOE"VEJP $POUFOU"OBMZTJT 4QFFDI 3FDPHOJUJPO 4QFFDI (FOFSBUJPO 7JEFP"VEJP$POUFOUT $BMM$FOUFS
.FFUJOH 7PJDF6TFS*OUFSGBDF 7JEFP"VEJP$POUFOUBOE$BMM"OBMZTJT ࣸਅૉࡐఏڙΞϑϩ

-*/&ϠϑʔͷԻ੠ೝࣝͱԻ੠߹੒ͷ঺հ *OUSPEVDUJPOPG -:$PSQPSBUJPO`T"43554 "43"VUPNBUJD4QFFDI3FDPHOJUJPO 5545FYU5P4QFFDI

:+70*$&4USFBNJOH"43 :+70*$&ετϦʔϛϯάԻ੠ೝࣝ &GGJDJFOUMZBEBQUTUPUBSHFUEPNBJOT • "TUSBUFHZCBTFEPODPNQBDUNPEFMTXJUIPVU FYUFSOBMMBOHVBHFNPEFMT • %PNBJOBEBQUBUJPOXJUIPVUUBSHFUBVEJPEBUB 1BJSFETQFFDIUFYUEBUB 6OQBJSFEUFYUEBUB
#BTF.PEFM "EBQUBUJPO .PEFM 4QFFDI 5FYU 5FYU #PPTUTQISBTFXJUIVTFSEJDUJPOBSJFT 4QFFDI 3FDPHOJUJPO 8PVMEZPV MJLFUPTUBSU UIFOBWJHBUJPO WJBUIJTSPVUF 4FSWJDF4QFDJGJD %JDUJPOBSZ :FT /P 1SJPSJUJ[FFYQSFTTXBZT 1SJPSJUJ[FHFOFSBMSPBET ʷ :FBTU ˠ ˓ :FT ʷ ,OPX ˠ ˓ /P ʷ 1SJPSJUJ[FHFOFSBMMPBET ˣ ˓ 1SJPSJUJ[FHFOFSBM SPBET 3FTPMWFTIPNPOZNT ೔ ຊ ڮ χ ϗ ϯ ό γ · Ͱ Ϛ σ ͷ ϊʜ 4VSGBDF 3FBE 4VSGBDF 3FBE &OEUP&OE "43 4QFFDI • JF ɾ೔ຊڮ χϗϯόγ JTBMPDBUJPOJO5PLZP ɾ೔ຊڮ χοϙϯόγ JTBMPDBUJPOJO0TBLB • +PJOUQSFEJDUJPOPGCPUITVSGBDFBOESFBEJOH ಉදهҟԻޠ ޮ཰తͳυϝΠϯదԠ ಈతϢʔβࣙॻʹΑΔϑϨʔζೝࣝڧԽ ˞"CPVU'FBUVSF 'FBUVSF)JHIBDDVSBDZGPSXFCTFBSDIBOE-:$PSQPSBUJPOEPNBJO 'FBUVSF 3FTPMWFTIPNPOZNTBOEDVTUPNJ[FTFBTJMZ 'FBUVSF1SPWJEFT8FC"1*BOEPOEFWJDFNPEVMFT

"DIPSJT&YQSFTTJWF554 "DIPSJT දݱྗ͕๛͔ͳԻ੠߹੒ 'FBUVSF$POUSPMFNPUJPOJOUFOTJUZXJUIFYQSFTTJPOTUZMFT 'FBUVSF QSFTFUTQFBLFSPQUJPOTXJUIIVNBOMJLFRVBMJUZ 'FBUVSF1SPWJEFT8FC"1* POEFWJDFNPEVMFTBOEFEJUJOHXFCUPPMT "DIPSJT &EJUPS5FYUUPTQFFDIFEJUJOHUPPM
"DIPSJT &YQSFTTJWFUFYUUPTQFFDI $POUSPM0WFS4QFBLFS &NPUJPO BOE*OUFOTJUZ

Ի੠ೝࣝͷαʔϏε׆༻ࣄྫ • :BIPP +"1"/"QQ`T7PJDF4FBSDI • 7PJDF4FBSDIJTJNQMFNFOUFEJONPTU:BIPP+"1"/4FSWJDFT JFTFSWJDFTJODMVEJOH.BQT 5SBOTJU BOETIPQQJOH :BIPP+"1"/"QQ
J04"OESPJE &YBNQMFTPG"QQMJDBUJPO

Ի੠߹੒ͷαʔϏε׆༻ࣄྫ • /BWJHBUJPOWPJDFJO:BIPP+"1"/$BS/BWJHBUJPO"QQ • 0O%FWJDF/FVSBM5FYU5P4QFFDI&OHJOF DBMMFEl"DIPSJT -JUFz • (FOFSBUFBTFDPOEBVEJPXBWFGPSNJO
TFDPOET ˎ 3FBM5JNF'BDUPS 35' JTJOJ1IPOF • 5PNJOJNJ[FBQQTJ[F XFWFJNQMFNFOUFE WBSJPVTPQUJNJ[BUJPOTJOCPUIJOGFSFODFMJCSBSJFTBOENPEFMTJ[F :BIPP+"1"/$BS/BWJHBUJPO"QQ &YBNQMFTPG"QQMJDBUJPO

"MBCBQQGPSSFBMUJNFTQPLFOEJBMPHVF CBTFEPOB--. VOEFSEFWFMPQJOH IUUQTXXXMZDPSQDPKQKBUFDIOPMPHZEFTJHOMBCT &YBNQMFTPG"QQMJDBUJPO ϦΞϧλΠϜԻ੠ର࿩ͷ࣮ݧΞϓϦ ։ൃத

ϦΞϧλΠϜ4QFFDIUP4QFFDIٕज़։ൃͷऔΓ૊Έ 3FBMUJNF4QFFDIUP4QFFDI

3FBMUJNF4QFFDIUP4QFFDI5SFOE ϦΞϧλΠϜ4QFFDIUP4QFFDIͷٕज़ಈ޲ IUUQTPQFOBJDPNKB+1DIBUHQUPWFSWJFX IUUQTHFNJOJHPPHMFPWFSWJFXHFNJOJMJWF IUUQTNPTIJDIBU IUUQTOVEJBMPHVFHJUIVCJPKNPTIJ
0QFO"* $IBU(15 "EWBODFE7PJDF.PEF ,ZVUBJ .PTIJ /BHPZBVOJW +.PTIJ (PPHMF (FNJOJ-JWF

4QFFDIUP4QFFDI"SDIJUFDUVSF 4QFFDIUP4QFFDIͷϞσϧߏ଄ -BSHF-BOHVBHF.PEFM 5FYU(VJEFE4QFFDI (FOFSBUJPO Low-latency speech generation using audio
tokens or a streaming TTS module "VEJP"EBQUFS 4QFFDI &ODPEFS .PEBMJUZBMJHONFOU CFUXFFOUFYUBOEBVEJP 1SPNQU 4QFFDI 4JOHMF4USFBN 6TFSTTQFFDIPOMZ .VMUJ4USFBN 6TFSTTQFFDI --.HFOFSBUFETQFFDI

1SPTPG*OUFHSBUJOH4QFFDI&ODPEFS XJUI--.T Ի੠ͱ--.Tͷ౷߹ʹΑΔར఺ -FWFSBHF--. $BQBCJMJUJFT 1SPNQU%SJWFO 'MFYJCJMJUZ #ZQBTT "43&SSPST --.ͷߴ౓ͳج൫ೳྗͷ׆༻
ϓϩϯϓτʹΑΔߴ͍ΧελϚΠζੑ Ի੠ೝࣝޡΓͷӨڹΛճආ

&WBMVBUJPOPG5BTL1FSGPSNBODF 4QFFDI--.ͷλεΫੑೳͷධՁ JOQVU +42V"% 2VFTUJPO"OTXFS DIBS@G "-5 5SBOTMBUJPOGSPNKQ UPFO
#FSU4DPSF (SPVOEUSVUIUFYU UFYUUPUFYU 5SBOTDSJCFEUFYU UFYUUPUFYU 4QFFDI TQFFDIUPUFYU --.HFNNBCJU "43NPEFMXIJTQFSTNBMM 4QFFDI&ODPEFSXIJTQFSTNBMM 5SBJOJOH5PPMLJU4-".--. &WBMVBUJPO5PPMLJUMMNKQFWBM 4-".--.IUUQTHJUIVCDPN9-"/$&4-".--. MMNKQFWBMIUUQTHJUIVCDPNMMNKQMMNKQFWBM $PNQBSBCMF QFSGPSNBODFPO USBOTMBUJPO UBTL #FUUFS QFSGPSNBODFPO 2"UBTL

&WBMVBUJPOPG*OGFSFODF4QFFE ਪ࿦଎౓ͷධՁ 0 10 20 30 40 50
60 vllm slam-llm (transformers) Generated Characters per Second W--.,XPO 8PPTVL FUBM&GGJDJFOUNFNPSZNBOBHFNFOUGPSMBSHFMBOHVBHFNPEFMTFSWJOHXJUIQBHFEBUUFOUJPO1SPDFFEJOHTPGUIFUI4ZNQPTJVNPO0QFSBUJOH4ZTUFNT1SJODJQMFT 'BTUFS YGBTUFS (FOFSBUFT)PXDBO*IFMQZPVUPEBZ JOTFDPOET /VNCFSPG5PLFOT

'VUVSF8PSLT ࠓޙͷల๬ 8FBSFEFWFMPQJOH • 3FBMUJNF4QFFDIUP4QFFDI JOUFHSBUJPOXJUI--. • .VMUJMJOHVBM4QFFDI5P5FYU5FYU5P4QFFDI 7PJDF$POUSPMJOB$BS )VNBOMJLFBOE/BUVSBM
$POWFSTBUJPOBM4FBSDI 4QPLFO%JBMPHVFWJB$BMM "*"HFOU 03 4FBSDI 8FBUIFS 1PEDBTU "*"HFOU "*"HFOU "*"HFOU

LINEヤフーの音声AIがもたらす未来：ASR/TTSと対話技術の新たな可能性 / LY Co...

LINEヤフーの音声AIがもたらす未来：ASR/TTSと対話技術の新たな可能性 / LY Corporation's Speech AI Vision: Towards Realtime Spoken Dialogue through Advanced ASR and TTS

LINEヤフーTech (LY Corporation Tech) PRO

More Decks by LINEヤフーTech (LY Corporation Tech)

Other Decks in Technology

Featured

Transcript

-:$PSQPSBUJPOT4QFFDI"7JTJPO 5PXBSET3FBMUJNF4QFFDIUP4QFFDI UISPVHI"EWBODFE"43BOE554 4QFFDIBOE"DPVTUJD"%FQU %BUB4DJFODF(SPVQ +VNQFJ .JZBLF 5BJLJ,JOPTIJUB -/&ϠϑʔͷԻ੠"͕΋ͨΒ͢ະདྷɿ"43554ͱର࿩ٕज़ͷ৽ͨͳՄೳੑ

"HFOEB -:$PSQPSBUJPO`T4QFFDI"* -/&ϠϑʔͷԻ੠"ʹ͍ͭͯ -:$PSQPSBUJPO`T"43554 -*/&ϠϑʔͷԻ੠ೝࣝɾԻ੠߹੒ͷ঺հ 3FBMUJNF4QFFDIUP4QFFDI ϦΞϧλΠϜ4QFFDIUP4QFFDIٕज़։ൃͷऔΓ૊Έʹ͍ͭͯ

-:$PSQPSBUJPO`T4QFFDI"* -/&ϠϑʔͷԻ੠"ʹ͍ͭͯ 7JEFPBOE"VEJP $POUFOU"OBMZTJT 4QFFDI 3FDPHOJUJPO 4QFFDI (FOFSBUJPO 7JEFP"VEJP$POUFOUT $BMM$FOUFS

-/&ϠϑʔͷԻ੠ೝࣝͱԻ੠߹੒ͷ঺հ OUSPEVDUJPOPG -:$PSQPSBUJPO`T"43554 "43"VUPNBUJD4QFFDI3FDPHOJUJPO 5545FYU5P4QFFDI

:+70$&4USFBNJOH"43 :+70$&ετϦʔϛϯάԻ੠ೝࣝ &GGJDJFOUMZBEBQUTUPUBSHFUEPNBJOT • "TUSBUFHZCBTFEPODPNQBDUNPEFMTXJUIPVU FYUFSOBMMBOHVBHFNPEFMT • %PNBJOBEBQUBUJPOXJUIPVUUBSHFUBVEJPEBUB 1BJSFETQFFDIUFYUEBUB 6OQBJSFEUFYUEBUB

"DIPSJT&YQSFTTJWF554 "DIPSJT දݱྗ͕๛͔ͳԻ੠߹੒ 'FBUVSF$POUSPMFNPUJPOJOUFOTJUZXJUIFYQSFTTJPOTUZMFT 'FBUVSF QSFTFUTQFBLFSPQUJPOTXJUIIVNBOMJLFRVBMJUZ 'FBUVSF1SPWJEFT8FC"1* POEFWJDFNPEVMFTBOEFEJUJOHXFCUPPMT "DIPSJT &EJUPS5FYUUPTQFFDIFEJUJOHUPPM

Ի੠ೝࣝͷαʔϏε׆༻ࣄྫ • :BIPP +"1"/"QQ`T7PJDF4FBSDI • 7PJDF4FBSDIJTJNQMFNFOUFEJONPTU:BIPP+"1"/4FSWJDFT JFTFSWJDFTJODMVEJOH.BQT 5SBOTJU BOETIPQQJOH :BIPP+"1"/"QQ

Ի੠߹੒ͷαʔϏε׆༻ࣄྫ • /BWJHBUJPOWPJDFJO:BIPP+"1"/$BS/BWJHBUJPO"QQ • 0O%FWJDF/FVSBM5FYU5P4QFFDI&OHJOF DBMMFEl"DIPSJT -JUFz • (FOFSBUFBTFDPOEBVEJPXBWFGPSNJO

"MBCBQQGPSSFBMUJNFTQPLFOEJBMPHVF CBTFEPOB--. VOEFSEFWFMPQJOH IUUQTXXXMZDPSQDPKQKBUFDIOPMPHZEFTJHOMBCT &YBNQMFTPG"QQMJDBUJPO ϦΞϧλΠϜԻ੠ର࿩ͷ࣮ݧΞϓϦ ։ൃத

ϦΞϧλΠϜ4QFFDIUP4QFFDIٕज़։ൃͷऔΓ૊Έ 3FBMUJNF4QFFDIUP4QFFDI

3FBMUJNF4QFFDIUP4QFFDI5SFOE ϦΞϧλΠϜ4QFFDIUP4QFFDIͷٕज़ಈ޲ IUUQTPQFOBJDPNKB+1DIBUHQUPWFSWJFX IUUQTHFNJOJHPPHMFPWFSWJFXHFNJOJMJWF IUUQTNPTIJDIBU IUUQTOVEJBMPHVFHJUIVCJPKNPTIJ

4QFFDIUP4QFFDI"SDIJUFDUVSF 4QFFDIUP4QFFDIͷϞσϧߏ଄ -BSHF-BOHVBHF.PEFM 5FYU(VJEFE4QFFDI (FOFSBUJPO Low-latency speech generation using audio

1SPTPG*OUFHSBUJOH4QFFDI&ODPEFS XJUI--.T Ի੠ͱ--.Tͷ౷߹ʹΑΔར఺ -FWFSBHF--. $BQBCJMJUJFT 1SPNQU%SJWFO 'MFYJCJMJUZ #ZQBTT "43&SSPST --.ͷߴ౓ͳج൫ೳྗͷ׆༻

&WBMVBUJPOPG5BTL1FSGPSNBODF 4QFFDI--.ͷλεΫੑೳͷධՁ JOQVU +42V"% 2VFTUJPO"OTXFS DIBS@G "-5 5SBOTMBUJPOGSPNKQ UPFO

&WBMVBUJPOPG*OGFSFODF4QFFE ਪ࿦଎౓ͷධՁ 0 10 20 30 40 50

'VUVSF8PSLT ࠓޙͷల๬ 8FBSFEFWFMPQJOH • 3FBMUJNF4QFFDIUP4QFFDI JOUFHSBUJPOXJUI--. • .VMUJMJOHVBM4QFFDI5P5FYU5FYU5P4QFFDI 7PJDF$POUSPMJOB$BS )VNBOMJLFBOE/BUVSBM

EOP