企業での研究開発の楽しさと苦労/WAP-Tech-Talk

Transcript

1. View Slide

2. ೥݄
   ೥݄
   ژ౎େֶࠇڮݚڀࣨ഑ଐ
   ΫοΫύουೖࣾ
   ത࢜ʢ৘ใֶʣऔಘ
   ΤϯδχΞʢ3VCZPO3BJMTʣ
   ೥݄
   ֶੜʢࣗવݴޠॲཧ৘ใݕࡧʣ
   ݪౡ७
   ೥݄
   Ϛωʔδϟʔʢਓࣄ޿ใʜʣ
   ݚڀ։ൃ෦໳ઃཱ
   

   View Slide

3. ΫοΫύου
   Πϯλʔωοτ্ͰϨγϐͷ౤ߘɾݕࡧ౳͕Ͱ͖Δ
   ੈք࠷େͷྉཧϨγϐαʔϏε
   ݄ؒར༻ऀ਺ԯਓ௒ʢΧࠃݴޠʣ
   ϓϨϛΞϜձһ਺໿ສਓ
   

   View Slide

4. ΫοΫύουϚʔτ
   

   View Slide

5. ܙൺणԣ඿ʢΈͳͱΈΒ͍ʣ
   

   View Slide

6. View Slide

7. ΫοΫύουͰݚڀ։ൃʁ
   

   View Slide

8. Ԋֵ
   ೥݄ ༗ݶձࣾίΠϯʢݱΫοΫύουגࣜձࣾʣઃཱ
   ೥݄
   ೥݄
   ೥݄
   ೥݄
   ೥݄ Ϩγϐͷ౤ߘɾݕࡧαʔϏεLJUDIFO!DPJO։࢝
   ΫοΫύουʹαʔϏε໊มߋ
   ೥݄ ϓϨϛΞϜαʔϏε։࢝
   Ϛβʔζ্৔
   ౦ূҰ෦ʹࢢ৔มߋ
   ϓϨϛΞϜαʔϏεձһ਺ສਓಥഁ
   ೥݄ ւ֎ల։Λຊ֨Խ
   ೥݄ ݚڀ։ൃ෦໳ઃཱ
   

   View Slide

9. ݚڀ෼໺
   ࣗવݴޠॲཧ
   εϚʔτΩονϯ
   ը૾ॲཧ
   ৯จԽ
   

   View Slide

10. SFTFBSDIDPPLQBEDPN
    

    View Slide

11. ࿦จ΋গͣͭ͠ʢ·ͩTIPSUQBQFS΍XPSLTIPQ͕ଟΊʣ
    
    $PPLQBE1BSTFE$PSQVT-JOHVJTUJD"OOPUBUJPOTPG+BQBOFTF3FDJQFT -"8
    
    /POJOHSFEJFOU%FUFDUJPOJO6TFSHFOFSBUFE3FDJQFTVTJOHUIF4FRVFODF5BHHJOH"QQSPBDI 8/65
    
    5PXBSET.VMUJ-BOHVBHF3FDJQF1FSTPOBMJTBUJPOBOE3FDPNNFOEBUJPO 3FD4ZT
    
    7JTVBM(SPVOEJOH"OOPUBUJPOPG3FDJQF'MPX(SBQI -3&$
    
    $BMPSJF&TUJNBUJPOJOB3FBM8PSME3FDJQF4FSWJDF *""*
    
    
    3FBM8PSME7PJDF"TTJTUBOU4ZTUFNGPS$PPLJOH */-(
    
    /BNFE&OUJUZ3FDPHOJUJPOCZ$IBSBDUFSCBTFE8PSE$MBTTJpDBUJPOVTJOHB%PNBJO4QFDJpD%JDUJPOBSZ $*$-JOH
    
    
    4UFQPS/PU%JTDSJNJOBUPSGPS5IF3FBM*OTUSVDUJPOTJO6TFSHFOFSBUFE3FDJQFT 8/65
    
    5XP4UFQ7BMJEBUJPOJO$IBSBDUFSCBTFE*OHSFEJFOU/PSNBMJ[BUJPO $&"
    
    
    $PPLQBE*NBHF%BUBTFU"O*NBHF$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI 4*(*3
    
    "QQSPBDIFTUP'PPE/POGPPE*NBHF$MBTTJpDBUJPO6TJOH%FFQ-FBSOJOHJO$PPLQBE $&"
    
    -FBSOJOH'PPE"QQFBSBODFCZB4VQFSWJTJPOXJUI3FDJQF5FYU $&"
    
    
    +BQBOFTF&OHMJTI.BDIJOF5SBOTMBUJPOPG3FDJQF5FYUT 8"5
    
    %FTJHOJO&WFSZEBZ$PPLJOH$IBMMFOHFTGPS"TTJTUJOHXJUI.FOV1MBOOJOHBOE'PPE1SFQBSBUJPO $$%
    
    "-BSHF4DBMF3FDJQFBOE.FBM%BUB$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI -3&$
    
    

    View Slide

12. ΫοΫύουͰ/-1ʁ
    

    View Slide

13. ɾλΠτϧ
    ɾ֓ཁ
    ɾࡐྉ
    ɾखॱ
    ɾίπɾϙΠϯτ
    ɾ͜ͷϨγϐͷੜཱ͍ͪ
    ɾͭ͘ΕΆ
    ɾʜ
    ϨγϐʹςΩετʢʴը૾ʣ
    

    View Slide

14. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ
    ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF
    

    View Slide

15. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ
    ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF
    /-1͕ෆՄܽ
    

    View Slide

16. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ
    ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF
    ͨͱ͑͹ɺͲ͏͍͏՝୊͕͋Δʁ
    

    View Slide

17. Ϩγϐͷ෼ྨ
    ՝୊
    Ϩγϐݕࡧͷ݁ՌΛʮྉཧͷछྨʢFH ओ৯ɺ͓͔ͣɺεʔϓɺʜʣʯͰߜΓࠐΈ͍ͨ
    ͚ͲɺϨγϐʹͦ͏͍ͬͨλά͸෇͍͍ͯͳ͍
    ΫοΫύουͷऔΓ૊Έ
    ϨγϐͷλΠτϧ͔ΒྉཧͷछྨΛ༧ଌ͢Δ47.Λֶश
    શϨγϐʢ໿ສ඼ʣʹλάΛ෇༩
    

    View Slide

18. y1
    yJ
    y2
    …
    canonical form of the ingredient
    decoder
    original string of an ingredient
    encoder
    x1
    x2
    xI
    …
    softmax softmax softmax
    …
    ΧϩϦʔͷܭࢉʢ)BSBTIJNB)BSBTIJNBʣ
    ՝୊
    Ϩγϐݕࡧͷ݁ՌΛʮҰਓ෼ͷΧϩϦʔʯͰߜΓࠐΈ͍ͨ
    ͚Ͳɺ֤Ϩγϐͷࡐྉ΍෼ྔͷදه͸όϥόϥɺͦͷ··Ͱ͸ΧϩϦʔ͕ܭࢉͰ͖ͳ͍
    ΫοΫύουͷऔΓ૊Έ
    ࡐྉΛਖ਼نԽ͢Δ//ͱ෼ྔΛਓ਺෼ʹ׵ࢉ͢Δ//Λֶश
    ໿ ϨγϐͷΧϩϦʔΛऔಘ
    ਖ਼نԽલ ਖ਼نԽޙ
    දه༳Ε ਓࢀ ʹΜ͡Μ
    ུه ৽ͨ· ৽ͨ·Ͷ͗
    εϖϧϛε ͋΅͕Ͳ ΞϘΧυ
    ͦͷଞ അླḕ ͡Ό͕͍΋
    dense
    amount
    encoder
    xa1
    xa2
    xaJ
    …
    title
    encoder
    xt1
    xt2
    xtI
    …
    softmax
    y
    serving
    λΠτϧ ׵ࢉલ ׵ࢉޙʢਓ਺෼ʣ
    ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ ࡼ෼
    ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ ߹෼
    άϥϊʔϥΫοΩʔ ຕ
    ύϯϓΩϯλϧτ DNλϧτܕ
    

    View Slide

19. ՝୊
    εϚʔτϑΥϯ͔ΒͷϨγϐ౤ߘ͕૿͍͑ͯΔ
    ͚ͲɺεϚʔτϑΥϯͷখ͍͞ը໘ͰςΩετΛೖྗ͢Δͷ͸େม
    ΫοΫύουͷऔΓ૊Έ
    ϨγϐͷλΠτϧ͔ΒࡐྉΛ༧ଌ͢Δ//Λֶश
    Ϣʔβʔ͕λΠτϧΛೖྗͨ͠ΒɺͦͷϨγϐͰ࢖ΘΕ͍ͯͦ͏ͳࡐྉΛਪન
    ࡐྉͷਪનʢਂᖒʣ
    

    View Slide

20. ՝୊
    εϚʔτεϐʔΧʔͰखॱΛಡΈ্͍͛ͨ
    ͚ͲɺϨγϐʹΑͬͯ͸ௐཧͱؔ܎ͳ͍खॱʢಡΈ্͛Δඞཁ͕ͳ͍खॱʣؚ͕·ΕΔ
    ΫοΫύουͷऔΓ૊Έ
    ඇखॱΛݕग़͢Δ-45.Λֶश
    ಡΈ্͛ͷࡍɺݕग़͞Εͨඇखॱ͸εΩοϓ
    ඇखॱͷݕग़ʢ*OV[VLB*UPʣ
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    ඇखॱ
    -45.
    ਫࡊ͸ʜ
    ✕
    

    View Slide

21. ՝୊
    छʑͷऔΓ૊ΈΛվળ͍ͨ͠
    ͚Ͳɺͦ΋ͦ΋ɺͦΕΒͷ౔୆Ͱ͋ΔϨγϐղੳͷੑೳ͕௿͍
    ΫοΫύουͷऔΓ૊Έ
    Ϩγϐʹܗଶૉղੳɾݻ༗දݱೝࣝɾߏจղੳͷਖ਼ղΛ෇༩
    ղੳޡΓͷ෼ੳ΍Ϟσϧͷ࠶ֶशͳͲʹར༻ɺछʑͷऔΓ૊ΈΛվળʢ༧ఆʣ
    ղੳࡁΈίʔύεͷߏஙʢ)BSBTIJNBฏদʣ
    # Step-ID:1
    # Sentence-ID:1-1
    * 0 4D 1/2 .7
    1 3:,,?,35,*,*,*,*,1,,,B-Fi
    + ?,,<,*,*,*,*,+, , ,I-Fi
    0,,$0,,*,*,*,*,,,,O
    * 1 2D 1/2 =4'
    ( ?,,<,*,*,*,*,(,,,B-Sf
    6 ?,,<,*,*,*,*,6, , ,I-Sf
    0,, 0,,<,*,*,*,,,,O
    * 2 4P 0/0 /'
    2 ;,,-A,*,*,&8),B@%,2,,,B-Ap
    * 3 4D 0/1 =4'
    ?,,<,*,*,*,*,,
    ,
    ,B-Fi
    0,, 0,,<,*,*,*,,,,O
    * 4 -1O 0/0 /'
    ;,,-A,*,*,&8),!>%,,,,B-Ap
    "*,#9,*,*,*,*,,,,O
    EOS
    ࠶ֶश ద߹཰ ࠶ݱ཰ '஋
    ୯ޠ෼ׂͷΈ
    ͳ͠
    ͋Γ
    ୯ޠ෼ׂʴ
    ඼ࢺλά෇͚
    ͳ͠
    ͋Γ
    ਖ਼ղ཰ ద߹཰ ࠶ݱ཰ '஋
    4BTBEB
    -BNQMF
    ܗଶૉղੳثʢ.F$BCʣͷੑೳ
    ݻ༗දݱೝࣝثͷੑೳ
    ࠶ֶश
    ਖ਼ղ཰
    จઅ୯Ґ จ୯Ґ
    ͳ͠
    ͋Γ
    ߏจղੳثʢ$BCP$IBʣͷੑೳ
    ΞϊςʔγϣϯͷҰྫ
    

    View Slide

22. View Slide

23. اۀͰͷݚڀ։ൃͷָ͠͞ʁ
    ΫοΫύου
    

    View Slide

24. །ҰແೋͷςʔϚʹऔΓ૊ΊΔ
    ࣮αʔϏεͷ՝୊͔ΒςʔϚ͕ੜ·ΕΔ
    ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺʜ
    اۀʹ͔͠ͳ͍σʔλ͕࢖͑Δ
    ɾϨγϐʢੜίʔύεɺղੳࡁΈίʔύεɺର༁ίʔύεʣ
    ɾϢʔβʔଐੑʢੑผɺ೥ྸʣɺݕࡧΫΤϦɺӾཡཤྺ

    ɾΫοΫύουϚʔτͷ঎඼৘ใɺ஫จཤྺʢ/FXʣ

    ɾʜ
    ˠϒϧʔɾΦʔγϟϯʹඈͼࠐΊΔ
    ɾ࿦จ΋ॻ͚Δʢ௨Δͱ͸ݴͬͯͳ͍ʣ
    

    View Slide

25. ๛෋ͳϦιʔε͕࢖͑Δ
    ܭࢉػ
    ɾ"NB[PO&$ʢ(16ΠϯελϯεؚΉʣɺ4ɺ3FETIJGUɺʜ
    ɾΠϯελϯε͸TMBDL͔ΒؾܰʹTUBSUTUPQUFSNJOBUFͰ͖Δ
    ͓ۚ
    ɾΞϊςʔγϣϯʢඦສԁʙʣɺւ֎ग़ுʢ਺ेສԁʣɺӳจߍਖ਼ʢ਺ສԁʣɺʜ
    ɾ͋·ΓࠔͬͨهԱ͕ͳ͍
    ਓ
    ɾ/-1ʹݶΒͣɺ༷ʑͳ෼໺ʢFH $7ɺ*P5ʣͷεϖγϟϦετ͕ࣾ಺ʹ͍Δ
    ɾΞϊςʔγϣϯ΋جຊతʹ͸ࣾ಺ͷΞϊςʔλʔʹґཔʢࣾ֎ͩͱ༨ܭͳख͕͔͔ؒΔʣ
    ࣮αʔϏε
    ɾධՁʹ࢖͑ΔʢFH "#ςετʣ
    ɾاۀͳΒͰ͸ͷϦιʔε
    

    View Slide

26. /-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    /-1Λ࢓ࣄʹ͍ͨ͠ਓ͸ɺ/-1Ҏ֎ͷεΩϧʹ΋໨Λ޲͚Δ΂͖ʢࢲݟʣ
    ɾ͜͜਺೥Ͱ/-1FS͸ٸ૿ɺπʔϧ΋ίϞσΟςΟԽ
    ɾ/-1͔͠Ͱ͖ͳ͍ਓͷࢢ৔Ձ஋͸ٸݮ
    ΫοΫύουͰ͸ݚڀ։ൃͷ੒ՌΛαʔϏεʹಋೖ͢Δͷ΋ݚڀ։ൃ෦໳ͷ໾ׂͷ͏ͪ
    ɾʮ/PUFCPPLʹ·ͱΊͱ͍ͨɻ͋ͱ͸ΑΖ͘͠ʯͱ͔Ͱ͸ͳ͍
    ˠ໾ׂΛՌͨ͢͏ͪʹɺ͓څྉΛ΋Β͍ͭͭɺ/-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    ɾݴޠɿ3VCZɺ(Pɺ+BWBɺ3VTUɺ+BWB4DSJQUɺ5ZQF4DSJQUɺʜ
    ɾϑϨʔϜϫʔΫɿ3VCZPO3BJMTɺ3FBDUɺʜ
    ɾσʔλϕʔεɿ.Z42-ɺ1PTUHSFT2-ɺ3FEJTɺ%ZOBNP%#ɺ3FETIJGUɺʜ
    ɾͦͷଞɿ"84ɺ%PDLFSɺH31$ɺ(SBQI2-ɺʜ
    

    View Slide

27. ༷ʑͳධՁ͕࣠͋Δ
    ΞΧσϛοΫͷੈք͸QVCMJTIPSQFSJTI
    ɾ࿦จΛॻ͔ͳ͍ͱϙετʹब͚ͳ͍
    اۀͷݚڀ։ൃ෦໳͸PVUQVUPSQFSJTI
    ɾPVUQVU͸࿦จͰͳͯ͘΋Α͍ʢFH 044ɺಛڐɺٕज़ϒϩάɺߨԋʣ
    ݸਓ͕ձࣾʹߩݙ͢Δํ๏͸༷ʑˠձ͕ࣾݸਓΛධՁ͢Δ࣠΋༷ʑ
    ɾͳ͓ɺPVUQVU͕ͳ͍ͱධՁෆೳʹͳΔͷͰɺPVUQVU͸ͪΌΜͱ͢Δ
    

    View Slide

28. اۀͰͷݚڀ։ൃͷۤ࿑ʁ
    ΫοΫύου
    

    View Slide

29. αʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍
    αʔϏε։ൃ͸଎͍
    ݚڀ։ൃ͸஗͍
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    िؒ िؒ िؒ िؒ
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    αʔϕΠ
    िؒ िؒ िؒ िؒ
    Ξϊςʔγϣϯ

    ࣮૷
    ֶशɾվળ
    ධՁʢखݩʣ
    σϓϩΠ
    ධՁʢຊ൪ʣ
    FH αΠΫϧिؒ
    FH αΠΫϧϲ݄
    िؒޙ
    α ݚ
    /-1Ͱ

    YYYͰ͖Δʁ
    ଟ෼Ͱ͖ΔΑ
    ʢϲ݄͋Ε͹ʣ
    α ݚ
    Ͱ͖ͨʁ ͑ͬʂ
    ʜ
    ʜ
    

    View Slide

30. ͲΕ͘Β͍Ͱ͖Δ͔Λલ΋ͬͯ஌Δͷ͸೉͍͠
    ɾҰԠɺਓؒͷਫ਼౓ʢ㱢γεςϜͷਫ਼౓ʣΛଌΕ͹ɺ͓͓·͔ͳਫ਼౓ͷ্ݶ͸෼͔Δ
    ʮ΍ͬͯΈͨʯˠʮͰ͖ͳ͔ͬͨʯ͸Α͋͘Δ
    ɾʮͰ͖ͳ͔ͬͨʯͷ൑அ΋೉͍͠ʢʮ΋͏গ͠ؤுΕ͹ʜʯˠ/ϲ݄͕ແବʹʣ
    ϲ݄ޙ
    α ݚ
    /-1Ͱ

    YYYͰ͖Δʁ
    ϲ݄͋Ε͹
    ଟ෼Ͱ͖ΔΑ
    ݚ α
    ਫ਼౓͕

    ݶքͩͬͨʜ
    ͑ͬʜ
    ͔ʜ
    ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍
    

    View Slide

31. 405"͕ྑ͍ͱ͸ݶΒͳ͍
    ʮ405"Ͱߴਫ਼౓Λୡ੒ʯˠʮͰ͖ͨʂʯͱ͸ͳΒͳ͍
    ɾӡ༻·Ͱߟ͑ΔͱɺރΕٕͨज़ʢFH 47.ɺਖ਼نදݱʣͷํ͕ྑ͍έʔε͕ଟ͍
    ͚Ͳɺ405"΋࢖͍ͨͯ͘͏ͣ͏ͣ͢Δʜ
    ɾ΋ͪΖΜɺ405"ͷํ͕ྑ͍έʔεʢਫ਼౓͕΋ͬͱ΋ॏཁͳέʔεʣ΋͋Δ
    ਫ਼౓ ࣮૷ σϓϩΠ ଐਓੑ ଎౓ අ༻
    405" ߴ ೉ ೉ ߴ ஗ ߴ
    ރΕٕͨज़ ී қ қ ௿ ଎ ҆
    

    View Slide

32. ͦͷଞ
    σʔλ͕࢖͍ʹ͍͘ʜʁ
    ɾେ͖͍اۀͩͱσʔλ͕ࢄΒ͹͍ͬͯͨΓɺ࢖͏ͷʹਃ੥͕ඞཁͩͬͨΓ
    ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢσʔλ͕%8)ʹ·ͱ·͍ͬͯΔʣ
    ੒Ռ͕ൃද͠ʹ͍͘ʜʁ
    ɾηϯγςΟϒͳσʔλΛѻ͏اۀͩͱϋʔυϧ͕ߴ͍ʢΒ͍͠ʣ
    ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢηϯγςΟϒͳσʔλ͕গͳ͍ʣ
    

    View Slide

33. ·ͱΊ
    

    View Slide

34. ·ͱΊ
    ΫοΫύουͱ/-1
    ɾϨγϐ΍ΫΤϦΛॲཧ͢Δͷʹ/-1͕ෆՄܽ
    /-1͕ؔ܎͢Δ՝୊
    ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺղੳࡁΈίʔύεͷߏங
    اۀͰͷݚڀ։ൃͷָ͠͞
    ɾ།ҰແೋͷςʔϚʹऔΓ૊ΊΔ
    ɾ๛෋ͳϦιʔε͕࢖͑Δ
    ɾ/-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    ɾ༷ʑͳධՁ͕࣠͋Δ
    اۀͰͷݚڀ։ൃͷۤ࿑
    ɾαʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍
    ɾ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍
    ɾ405"͕ྑ͍ͱ͸ݶΒͳ͍
    ΫοΫύου
    ΫοΫύου
    

    View Slide

35. ྉཧY/-1ʹऔΓ૊Ή஥ؒΛ୳͍ͯ͠·͢
    IUUQTJOGPDPPLQBEDPNDBSFFST
    ಇ͔ͳͯ͘΋
    ৯΂͍͚ͯΔະདྷʹɺ
    ԿΛ૑Γग़ͦ͏ɻ
    

    View Slide