Upgrade to Pro — share decks privately, control downloads, hide ads and more …

企業での研究開発の楽しさと苦労/WAP-Tech-Talk

j.harashima
February 03, 2021
8.4k

 企業での研究開発の楽しさと苦労/WAP-Tech-Talk

j.harashima

February 03, 2021
Tweet

Transcript

  1. ೥݄
    ೥݄
    ژ౎େֶࠇڮݚڀࣨ഑ଐ
    ΫοΫύουೖࣾ
    ത࢜ʢ৘ใֶʣऔಘ
    ΤϯδχΞʢ3VCZPO3BJMTʣ
    ೥݄
    ֶੜʢࣗવݴޠॲཧ৘ใݕࡧʣ
    ݪౡ७
    ೥݄
    Ϛωʔδϟʔʢਓࣄ޿ใʜʣ
    ݚڀ։ൃ෦໳ઃཱ

    View full-size slide

  2. ΫοΫύου
    Πϯλʔωοτ্ͰϨγϐͷ౤ߘɾݕࡧ౳͕Ͱ͖Δ
    ੈք࠷େͷྉཧϨγϐαʔϏε
    ݄ؒར༻ऀ਺ԯਓ௒ʢΧࠃݴޠʣ
    ϓϨϛΞϜձһ਺໿ສਓ

    View full-size slide

  3. ΫοΫύουϚʔτ

    View full-size slide

  4. ܙൺणԣ඿ʢΈͳͱΈΒ͍ʣ

    View full-size slide

  5. ΫοΫύουͰݚڀ։ൃʁ

    View full-size slide

  6. Ԋֵ
    ೥݄ ༗ݶձࣾίΠϯʢݱΫοΫύουגࣜձࣾʣઃཱ
    ೥݄
    ೥݄
    ೥݄
    ೥݄
    ೥݄ Ϩγϐͷ౤ߘɾݕࡧαʔϏεLJUDIFO!DPJO։࢝
    ΫοΫύουʹαʔϏε໊มߋ
    ೥݄ ϓϨϛΞϜαʔϏε։࢝
    Ϛβʔζ্৔
    ౦ূҰ෦ʹࢢ৔มߋ
    ϓϨϛΞϜαʔϏεձһ਺ສਓಥഁ
    ೥݄ ւ֎ల։Λຊ֨Խ
    ೥݄ ݚڀ։ൃ෦໳ઃཱ

    View full-size slide

  7. ݚڀ෼໺
    ࣗવݴޠॲཧ
    εϚʔτΩονϯ
    ը૾ॲཧ
    ৯จԽ

    View full-size slide

  8. SFTFBSDIDPPLQBEDPN

    View full-size slide

  9. ࿦จ΋গͣͭ͠ʢ·ͩTIPSUQBQFS΍XPSLTIPQ͕ଟΊʣ

    $PPLQBE1BSTFE$PSQVT-JOHVJTUJD"OOPUBUJPOTPG+BQBOFTF3FDJQFT -"8

    /POJOHSFEJFOU%FUFDUJPOJO6TFSHFOFSBUFE3FDJQFTVTJOHUIF4FRVFODF5BHHJOH"QQSPBDI 8/65

    5PXBSET.VMUJ-BOHVBHF3FDJQF1FSTPOBMJTBUJPOBOE3FDPNNFOEBUJPO 3FD4ZT

    7JTVBM(SPVOEJOH"OOPUBUJPOPG3FDJQF'MPX(SBQI -3&$

    $BMPSJF&TUJNBUJPOJOB3FBM8PSME3FDJQF4FSWJDF *""*


    3FBM8PSME7PJDF"TTJTUBOU4ZTUFNGPS$PPLJOH */-(

    /BNFE&OUJUZ3FDPHOJUJPOCZ$IBSBDUFSCBTFE8PSE$MBTTJpDBUJPOVTJOHB%PNBJO4QFDJpD%JDUJPOBSZ $*$-JOH


    4UFQPS/PU%JTDSJNJOBUPSGPS5IF3FBM*OTUSVDUJPOTJO6TFSHFOFSBUFE3FDJQFT 8/65

    5XP4UFQ7BMJEBUJPOJO$IBSBDUFSCBTFE*OHSFEJFOU/PSNBMJ[BUJPO $&"


    $PPLQBE*NBHF%BUBTFU"O*NBHF$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI 4*(*3

    "QQSPBDIFTUP'PPE/POGPPE*NBHF$MBTTJpDBUJPO6TJOH%FFQ-FBSOJOHJO$PPLQBE $&"

    -FBSOJOH'PPE"QQFBSBODFCZB4VQFSWJTJPOXJUI3FDJQF5FYU $&"


    +BQBOFTF&OHMJTI.BDIJOF5SBOTMBUJPOPG3FDJQF5FYUT 8"5

    %FTJHOJO&WFSZEBZ$PPLJOH$IBMMFOHFTGPS"TTJTUJOHXJUI.FOV1MBOOJOHBOE'PPE1SFQBSBUJPO $$%

    "-BSHF4DBMF3FDJQFBOE.FBM%BUB$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI -3&$

    View full-size slide

  10. ΫοΫύουͰ/-1ʁ

    View full-size slide

  11. ɾλΠτϧ
    ɾ֓ཁ
    ɾࡐྉ
    ɾखॱ
    ɾίπɾϙΠϯτ
    ɾ͜ͷϨγϐͷੜཱ͍ͪ
    ɾͭ͘ΕΆ
    ɾʜ
    ϨγϐʹςΩετʢʴը૾ʣ

    View full-size slide

  12. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ
    ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF

    View full-size slide

  13. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ
    ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF
    /-1͕ෆՄܽ

    View full-size slide

  14. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ
    ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF
    ͨͱ͑͹ɺͲ͏͍͏՝୊͕͋Δʁ

    View full-size slide

  15. Ϩγϐͷ෼ྨ
    ՝୊
    Ϩγϐݕࡧͷ݁ՌΛʮྉཧͷछྨʢFH ओ৯ɺ͓͔ͣɺεʔϓɺʜʣʯͰߜΓࠐΈ͍ͨ
    ͚ͲɺϨγϐʹͦ͏͍ͬͨλά͸෇͍͍ͯͳ͍
    ΫοΫύουͷऔΓ૊Έ
    ϨγϐͷλΠτϧ͔ΒྉཧͷछྨΛ༧ଌ͢Δ47.Λֶश
    શϨγϐʢ໿ສ඼ʣʹλάΛ෇༩

    View full-size slide

  16. y1
    yJ
    y2

    canonical form of the ingredient
    decoder
    original string of an ingredient
    encoder
    x1
    x2
    xI

    softmax softmax softmax

    ΧϩϦʔͷܭࢉʢ)BSBTIJNB)BSBTIJNBʣ
    ՝୊
    Ϩγϐݕࡧͷ݁ՌΛʮҰਓ෼ͷΧϩϦʔʯͰߜΓࠐΈ͍ͨ
    ͚Ͳɺ֤Ϩγϐͷࡐྉ΍෼ྔͷදه͸όϥόϥɺͦͷ··Ͱ͸ΧϩϦʔ͕ܭࢉͰ͖ͳ͍
    ΫοΫύουͷऔΓ૊Έ
    ࡐྉΛਖ਼نԽ͢Δ//ͱ෼ྔΛਓ਺෼ʹ׵ࢉ͢Δ//Λֶश
    ໿ ϨγϐͷΧϩϦʔΛऔಘ
    ਖ਼نԽલ ਖ਼نԽޙ
    දه༳Ε ਓࢀ ʹΜ͡Μ
    ུه ৽ͨ· ৽ͨ·Ͷ͗
    εϖϧϛε ͋΅͕Ͳ ΞϘΧυ
    ͦͷଞ അླḕ ͡Ό͕͍΋
    dense
    amount
    encoder
    xa1
    xa2
    xaJ

    title
    encoder
    xt1
    xt2
    xtI

    softmax
    y
    serving
    λΠτϧ ׵ࢉલ ׵ࢉޙʢਓ਺෼ʣ
    ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ ࡼ෼
    ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ ߹෼
    άϥϊʔϥΫοΩʔ ຕ
    ύϯϓΩϯλϧτ DNλϧτܕ

    View full-size slide

  17. ՝୊
    εϚʔτϑΥϯ͔ΒͷϨγϐ౤ߘ͕૿͍͑ͯΔ
    ͚ͲɺεϚʔτϑΥϯͷখ͍͞ը໘ͰςΩετΛೖྗ͢Δͷ͸େม
    ΫοΫύουͷऔΓ૊Έ
    ϨγϐͷλΠτϧ͔ΒࡐྉΛ༧ଌ͢Δ//Λֶश
    Ϣʔβʔ͕λΠτϧΛೖྗͨ͠ΒɺͦͷϨγϐͰ࢖ΘΕ͍ͯͦ͏ͳࡐྉΛਪન
    ࡐྉͷਪનʢਂᖒʣ

    View full-size slide

  18. ՝୊
    εϚʔτεϐʔΧʔͰखॱΛಡΈ্͍͛ͨ
    ͚ͲɺϨγϐʹΑͬͯ͸ௐཧͱؔ܎ͳ͍खॱʢಡΈ্͛Δඞཁ͕ͳ͍खॱʣؚ͕·ΕΔ
    ΫοΫύουͷऔΓ૊Έ
    ඇखॱΛݕग़͢Δ-45.Λֶश
    ಡΈ্͛ͷࡍɺݕग़͞Εͨඇखॱ͸εΩοϓ
    ඇखॱͷݕग़ʢ*OV[VLB*UPʣ
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    खॱ
    -45.
    ඇखॱ
    -45.
    ਫࡊ͸ʜ

    View full-size slide

  19. ՝୊
    छʑͷऔΓ૊ΈΛվળ͍ͨ͠
    ͚Ͳɺͦ΋ͦ΋ɺͦΕΒͷ౔୆Ͱ͋ΔϨγϐղੳͷੑೳ͕௿͍
    ΫοΫύουͷऔΓ૊Έ
    Ϩγϐʹܗଶૉղੳɾݻ༗දݱೝࣝɾߏจղੳͷਖ਼ղΛ෇༩
    ղੳޡΓͷ෼ੳ΍Ϟσϧͷ࠶ֶशͳͲʹར༻ɺछʑͷऔΓ૊ΈΛվળʢ༧ఆʣ
    ղੳࡁΈίʔύεͷߏஙʢ)BSBTIJNBฏদʣ
    # Step-ID:1
    # Sentence-ID:1-1
    * 0 4D 1/2 .7
    1 3:,,?,35,*,*,*,*,1,,,B-Fi
    + ?,,<,*,*,*,*,+, , ,I-Fi
    0,,$0,,*,*,*,*,,,,O
    * 1 2D 1/2 =4'
    ( ?,,<,*,*,*,*,(,,,B-Sf
    6 ?,,<,*,*,*,*,6, , ,I-Sf
    0,, 0,,<,*,*,*,,,,O
    * 2 4P 0/0 /'
    2 ;,,-A,*,*,&8),B@%,2,,,B-Ap
    * 3 4D 0/1 =4'
    ?,,<,*,*,*,*,,
    ,
    ,B-Fi
    0,, 0,,<,*,*,*,,,,O
    * 4 -1O 0/0 /'
    ;,,-A,*,*,&8),!>%,,,,B-Ap
    "*,#9,*,*,*,*,,,,O
    EOS
    ࠶ֶश ద߹཰ ࠶ݱ཰ '஋
    ୯ޠ෼ׂͷΈ
    ͳ͠
    ͋Γ
    ୯ޠ෼ׂʴ
    ඼ࢺλά෇͚
    ͳ͠
    ͋Γ
    ਖ਼ղ཰ ద߹཰ ࠶ݱ཰ '஋
    4BTBEB
    -BNQMF
    ܗଶૉղੳثʢ.F$BCʣͷੑೳ
    ݻ༗දݱೝࣝثͷੑೳ
    ࠶ֶश
    ਖ਼ղ཰
    จઅ୯Ґ จ୯Ґ
    ͳ͠
    ͋Γ
    ߏจղੳثʢ$BCP$IBʣͷੑೳ
    ΞϊςʔγϣϯͷҰྫ

    View full-size slide

  20. اۀͰͷݚڀ։ൃͷָ͠͞ʁ
    ΫοΫύου

    View full-size slide

  21. །ҰແೋͷςʔϚʹऔΓ૊ΊΔ
    ࣮αʔϏεͷ՝୊͔ΒςʔϚ͕ੜ·ΕΔ
    ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺʜ
    اۀʹ͔͠ͳ͍σʔλ͕࢖͑Δ
    ɾϨγϐʢੜίʔύεɺղੳࡁΈίʔύεɺର༁ίʔύεʣ
    ɾϢʔβʔଐੑʢੑผɺ೥ྸʣɺݕࡧΫΤϦɺӾཡཤྺ

    ɾΫοΫύουϚʔτͷ঎඼৘ใɺ஫จཤྺʢ/FXʣ

    ɾʜ
    ˠϒϧʔɾΦʔγϟϯʹඈͼࠐΊΔ
    ɾ࿦จ΋ॻ͚Δʢ௨Δͱ͸ݴͬͯͳ͍ʣ

    View full-size slide

  22. ๛෋ͳϦιʔε͕࢖͑Δ
    ܭࢉػ
    ɾ"NB[PO&$ʢ(16ΠϯελϯεؚΉʣɺ4ɺ3FETIJGUɺʜ
    ɾΠϯελϯε͸TMBDL͔ΒؾܰʹTUBSUTUPQUFSNJOBUFͰ͖Δ
    ͓ۚ
    ɾΞϊςʔγϣϯʢඦສԁʙʣɺւ֎ग़ுʢ਺ेສԁʣɺӳจߍਖ਼ʢ਺ສԁʣɺʜ
    ɾ͋·ΓࠔͬͨهԱ͕ͳ͍

    ɾ/-1ʹݶΒͣɺ༷ʑͳ෼໺ʢFH $7ɺ*P5ʣͷεϖγϟϦετ͕ࣾ಺ʹ͍Δ
    ɾΞϊςʔγϣϯ΋جຊతʹ͸ࣾ಺ͷΞϊςʔλʔʹґཔʢࣾ֎ͩͱ༨ܭͳख͕͔͔ؒΔʣ
    ࣮αʔϏε
    ɾධՁʹ࢖͑ΔʢFH "#ςετʣ
    ɾاۀͳΒͰ͸ͷϦιʔε

    View full-size slide

  23. /-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    /-1Λ࢓ࣄʹ͍ͨ͠ਓ͸ɺ/-1Ҏ֎ͷεΩϧʹ΋໨Λ޲͚Δ΂͖ʢࢲݟʣ
    ɾ͜͜਺೥Ͱ/-1FS͸ٸ૿ɺπʔϧ΋ίϞσΟςΟԽ
    ɾ/-1͔͠Ͱ͖ͳ͍ਓͷࢢ৔Ձ஋͸ٸݮ
    ΫοΫύουͰ͸ݚڀ։ൃͷ੒ՌΛαʔϏεʹಋೖ͢Δͷ΋ݚڀ։ൃ෦໳ͷ໾ׂͷ͏ͪ
    ɾʮ/PUFCPPLʹ·ͱΊͱ͍ͨɻ͋ͱ͸ΑΖ͘͠ʯͱ͔Ͱ͸ͳ͍
    ˠ໾ׂΛՌͨ͢͏ͪʹɺ͓څྉΛ΋Β͍ͭͭɺ/-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    ɾݴޠɿ3VCZɺ(Pɺ+BWBɺ3VTUɺ+BWB4DSJQUɺ5ZQF4DSJQUɺʜ
    ɾϑϨʔϜϫʔΫɿ3VCZPO3BJMTɺ3FBDUɺʜ
    ɾσʔλϕʔεɿ.Z42-ɺ1PTUHSFT2-ɺ3FEJTɺ%ZOBNP%#ɺ3FETIJGUɺʜ
    ɾͦͷଞɿ"84ɺ%PDLFSɺH31$ɺ(SBQI2-ɺʜ

    View full-size slide

  24. ༷ʑͳධՁ͕࣠͋Δ
    ΞΧσϛοΫͷੈք͸QVCMJTIPSQFSJTI
    ɾ࿦จΛॻ͔ͳ͍ͱϙετʹब͚ͳ͍
    اۀͷݚڀ։ൃ෦໳͸PVUQVUPSQFSJTI
    ɾPVUQVU͸࿦จͰͳͯ͘΋Α͍ʢFH 044ɺಛڐɺٕज़ϒϩάɺߨԋʣ
    ݸਓ͕ձࣾʹߩݙ͢Δํ๏͸༷ʑˠձ͕ࣾݸਓΛධՁ͢Δ࣠΋༷ʑ
    ɾͳ͓ɺPVUQVU͕ͳ͍ͱධՁෆೳʹͳΔͷͰɺPVUQVU͸ͪΌΜͱ͢Δ

    View full-size slide

  25. اۀͰͷݚڀ։ൃͷۤ࿑ʁ
    ΫοΫύου

    View full-size slide

  26. αʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍
    αʔϏε։ൃ͸଎͍
    ݚڀ։ൃ͸஗͍
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    िؒ िؒ िؒ िؒ
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    ࣮૷ɾσϓϩΠ

    ධՁɾվળ
    αʔϕΠ
    िؒ िؒ िؒ िؒ
    Ξϊςʔγϣϯ

    ࣮૷
    ֶशɾվળ
    ධՁʢखݩʣ
    σϓϩΠ
    ධՁʢຊ൪ʣ
    FH αΠΫϧिؒ
    FH αΠΫϧϲ݄
    िؒޙ
    α ݚ
    /-1Ͱ

    YYYͰ͖Δʁ
    ଟ෼Ͱ͖ΔΑ
    ʢϲ݄͋Ε͹ʣ
    α ݚ
    Ͱ͖ͨʁ ͑ͬʂ
    ʜ
    ʜ

    View full-size slide

  27. ͲΕ͘Β͍Ͱ͖Δ͔Λલ΋ͬͯ஌Δͷ͸೉͍͠
    ɾҰԠɺਓؒͷਫ਼౓ʢ㱢γεςϜͷਫ਼౓ʣΛଌΕ͹ɺ͓͓·͔ͳਫ਼౓ͷ্ݶ͸෼͔Δ
    ʮ΍ͬͯΈͨʯˠʮͰ͖ͳ͔ͬͨʯ͸Α͋͘Δ
    ɾʮͰ͖ͳ͔ͬͨʯͷ൑அ΋೉͍͠ʢʮ΋͏গ͠ؤுΕ͹ʜʯˠ/ϲ݄͕ແବʹʣ
    ϲ݄ޙ
    α ݚ
    /-1Ͱ

    YYYͰ͖Δʁ
    ϲ݄͋Ε͹
    ଟ෼Ͱ͖ΔΑ
    ݚ α
    ਫ਼౓͕

    ݶքͩͬͨʜ
    ͑ͬʜ
    ͔ʜ
    ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍

    View full-size slide

  28. 405"͕ྑ͍ͱ͸ݶΒͳ͍
    ʮ405"Ͱߴਫ਼౓Λୡ੒ʯˠʮͰ͖ͨʂʯͱ͸ͳΒͳ͍
    ɾӡ༻·Ͱߟ͑ΔͱɺރΕٕͨज़ʢFH 47.ɺਖ਼نදݱʣͷํ͕ྑ͍έʔε͕ଟ͍
    ͚Ͳɺ405"΋࢖͍ͨͯ͘͏ͣ͏ͣ͢Δʜ
    ɾ΋ͪΖΜɺ405"ͷํ͕ྑ͍έʔεʢਫ਼౓͕΋ͬͱ΋ॏཁͳέʔεʣ΋͋Δ
    ਫ਼౓ ࣮૷ σϓϩΠ ଐਓੑ ଎౓ අ༻
    405" ߴ ೉ ೉ ߴ ஗ ߴ
    ރΕٕͨज़ ී қ қ ௿ ଎ ҆

    View full-size slide

  29. ͦͷଞ
    σʔλ͕࢖͍ʹ͍͘ʜʁ
    ɾେ͖͍اۀͩͱσʔλ͕ࢄΒ͹͍ͬͯͨΓɺ࢖͏ͷʹਃ੥͕ඞཁͩͬͨΓ
    ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢσʔλ͕%8)ʹ·ͱ·͍ͬͯΔʣ
    ੒Ռ͕ൃද͠ʹ͍͘ʜʁ
    ɾηϯγςΟϒͳσʔλΛѻ͏اۀͩͱϋʔυϧ͕ߴ͍ʢΒ͍͠ʣ
    ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢηϯγςΟϒͳσʔλ͕গͳ͍ʣ

    View full-size slide

  30. ·ͱΊ
    ΫοΫύουͱ/-1
    ɾϨγϐ΍ΫΤϦΛॲཧ͢Δͷʹ/-1͕ෆՄܽ
    /-1͕ؔ܎͢Δ՝୊
    ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺղੳࡁΈίʔύεͷߏங
    اۀͰͷݚڀ։ൃͷָ͠͞
    ɾ།ҰແೋͷςʔϚʹऔΓ૊ΊΔ
    ɾ๛෋ͳϦιʔε͕࢖͑Δ
    ɾ/-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    ɾ༷ʑͳධՁ͕࣠͋Δ
    اۀͰͷݚڀ։ൃͷۤ࿑
    ɾαʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍
    ɾ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍
    ɾ405"͕ྑ͍ͱ͸ݶΒͳ͍
    ΫοΫύου
    ΫοΫύου

    View full-size slide

  31. ྉཧY/-1ʹऔΓ૊Ή஥ؒΛ୳͍ͯ͠·͢
    IUUQTJOGPDPPLQBEDPNDBSFFST
    ಇ͔ͳͯ͘΋
    ৯΂͍͚ͯΔະདྷʹɺ
    ԿΛ૑Γग़ͦ͏ɻ

    View full-size slide