Upgrade to Pro — share decks privately, control downloads, hide ads and more …

企業での研究開発の楽しさと苦労/WAP-Tech-Talk

558ffd4e5cf6c95e60c91333677b93c4?s=47 j.harashima
February 03, 2021
1.1k

 企業での研究開発の楽しさと苦労/WAP-Tech-Talk

558ffd4e5cf6c95e60c91333677b93c4?s=128

j.harashima

February 03, 2021
Tweet

Transcript

  1. None
  2. ೥݄ ೥݄ ژ౎େֶࠇڮݚڀࣨ഑ଐ ΫοΫύουೖࣾ ത࢜ʢ৘ใֶʣऔಘ ΤϯδχΞʢ3VCZPO3BJMTʣ ೥݄ ֶੜʢࣗવݴޠॲཧ৘ใݕࡧʣ ݪౡ७ ೥݄

    Ϛωʔδϟʔʢਓࣄ޿ใʜʣ ݚڀ։ൃ෦໳ઃཱ
  3. ΫοΫύου Πϯλʔωοτ্ͰϨγϐͷ౤ߘɾݕࡧ౳͕Ͱ͖Δ ੈք࠷େͷྉཧϨγϐαʔϏε ݄ؒར༻ऀ਺ԯਓ௒ʢΧࠃݴޠʣ ϓϨϛΞϜձһ਺໿ສਓ

  4. ΫοΫύουϚʔτ

  5. ܙൺणԣ඿ʢΈͳͱΈΒ͍ʣ

  6. None
  7. ΫοΫύουͰݚڀ։ൃʁ

  8. Ԋֵ ೥݄ ༗ݶձࣾίΠϯʢݱΫοΫύουגࣜձࣾʣઃཱ ೥݄ ೥݄ ೥݄ ೥݄ ೥݄ Ϩγϐͷ౤ߘɾݕࡧαʔϏεLJUDIFO!DPJO։࢝ ΫοΫύουʹαʔϏε໊มߋ

    ೥݄ ϓϨϛΞϜαʔϏε։࢝ Ϛβʔζ্৔ ౦ূҰ෦ʹࢢ৔มߋ ϓϨϛΞϜαʔϏεձһ਺ສਓಥഁ ೥݄ ւ֎ల։Λຊ֨Խ ೥݄ ݚڀ։ൃ෦໳ઃཱ
  9. ݚڀ෼໺ ࣗવݴޠॲཧ εϚʔτΩονϯ ը૾ॲཧ ৯จԽ

  10. SFTFBSDIDPPLQBEDPN

  11. ࿦จ΋গͣͭ͠ʢ·ͩTIPSUQBQFS΍XPSLTIPQ͕ଟΊʣ  $PPLQBE1BSTFE$PSQVT-JOHVJTUJD"OOPUBUJPOTPG+BQBOFTF3FDJQFT -"8  /POJOHSFEJFOU%FUFDUJPOJO6TFSHFOFSBUFE3FDJQFTVTJOHUIF4FRVFODF5BHHJOH"QQSPBDI 8/65  5PXBSET.VMUJ-BOHVBHF3FDJQF1FSTPOBMJTBUJPOBOE3FDPNNFOEBUJPO 3FD4ZT

     7JTVBM(SPVOEJOH"OOPUBUJPOPG3FDJQF'MPX(SBQI -3&$  $BMPSJF&TUJNBUJPOJOB3FBM8PSME3FDJQF4FSWJDF *""*   3FBM8PSME7PJDF"TTJTUBOU4ZTUFNGPS$PPLJOH */-(  /BNFE&OUJUZ3FDPHOJUJPOCZ$IBSBDUFSCBTFE8PSE$MBTTJpDBUJPOVTJOHB%PNBJO4QFDJpD%JDUJPOBSZ $*$-JOH   4UFQPS/PU%JTDSJNJOBUPSGPS5IF3FBM*OTUSVDUJPOTJO6TFSHFOFSBUFE3FDJQFT 8/65  5XP4UFQ7BMJEBUJPOJO$IBSBDUFSCBTFE*OHSFEJFOU/PSNBMJ[BUJPO $&"   $PPLQBE*NBHF%BUBTFU"O*NBHF$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI 4*(*3  "QQSPBDIFTUP'PPE/POGPPE*NBHF$MBTTJpDBUJPO6TJOH%FFQ-FBSOJOHJO$PPLQBE $&"  -FBSOJOH'PPE"QQFBSBODFCZB4VQFSWJTJPOXJUI3FDJQF5FYU $&"   +BQBOFTF&OHMJTI.BDIJOF5SBOTMBUJPOPG3FDJQF5FYUT 8"5  %FTJHOJO&WFSZEBZ$PPLJOH$IBMMFOHFTGPS"TTJTUJOHXJUI.FOV1MBOOJOHBOE'PPE1SFQBSBUJPO $$%  "-BSHF4DBMF3FDJQFBOE.FBM%BUB$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI -3&$
  12. ΫοΫύουͰ/-1ʁ

  13. ɾλΠτϧ ɾ֓ཁ ɾࡐྉ ɾखॱ ɾίπɾϙΠϯτ ɾ͜ͷϨγϐͷੜཱ͍ͪ ɾͭ͘ΕΆ ɾʜ ϨγϐʹςΩετʢʴը૾ʣ

  14. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ IUUQTDPPLQBEDPNSFDJQF

  15. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ IUUQTDPPLQBEDPNSFDJQF /-1͕ෆՄܽ

  16. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZͩΜͲΓ௾͞Μ IUUQTDPPLQBEDPNSFDJQF ͨͱ͑͹ɺͲ͏͍͏՝୊͕͋Δʁ

  17. Ϩγϐͷ෼ྨ ՝୊ Ϩγϐݕࡧͷ݁ՌΛʮྉཧͷछྨʢFH ओ৯ɺ͓͔ͣɺεʔϓɺʜʣʯͰߜΓࠐΈ͍ͨ ͚ͲɺϨγϐʹͦ͏͍ͬͨλά͸෇͍͍ͯͳ͍ ΫοΫύουͷऔΓ૊Έ ϨγϐͷλΠτϧ͔ΒྉཧͷछྨΛ༧ଌ͢Δ47.Λֶश શϨγϐʢ໿ສ඼ʣʹλάΛ෇༩

  18. y1 yJ y2 … canonical form of the ingredient decoder

    original string of an ingredient encoder x1 x2 xI … softmax softmax softmax … ΧϩϦʔͷܭࢉʢ)BSBTIJNB)BSBTIJNBʣ ՝୊ Ϩγϐݕࡧͷ݁ՌΛʮҰਓ෼ͷΧϩϦʔʯͰߜΓࠐΈ͍ͨ ͚Ͳɺ֤Ϩγϐͷࡐྉ΍෼ྔͷදه͸όϥόϥɺͦͷ··Ͱ͸ΧϩϦʔ͕ܭࢉͰ͖ͳ͍ ΫοΫύουͷऔΓ૊Έ ࡐྉΛਖ਼نԽ͢Δ//ͱ෼ྔΛਓ਺෼ʹ׵ࢉ͢Δ//Λֶश ໿ ϨγϐͷΧϩϦʔΛऔಘ ਖ਼نԽલ ਖ਼نԽޙ දه༳Ε ਓࢀ ʹΜ͡Μ ུه ৽ͨ· ৽ͨ·Ͷ͗ εϖϧϛε ͋΅͕Ͳ ΞϘΧυ ͦͷଞ അླḕ ͡Ό͕͍΋ dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving λΠτϧ ׵ࢉલ ׵ࢉޙʢਓ਺෼ʣ ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ ࡼ෼  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ ߹෼  άϥϊʔϥΫοΩʔ ຕ  ύϯϓΩϯλϧτ DNλϧτܕ 
  19. ՝୊ εϚʔτϑΥϯ͔ΒͷϨγϐ౤ߘ͕૿͍͑ͯΔ ͚ͲɺεϚʔτϑΥϯͷখ͍͞ը໘ͰςΩετΛೖྗ͢Δͷ͸େม ΫοΫύουͷऔΓ૊Έ ϨγϐͷλΠτϧ͔ΒࡐྉΛ༧ଌ͢Δ//Λֶश Ϣʔβʔ͕λΠτϧΛೖྗͨ͠ΒɺͦͷϨγϐͰ࢖ΘΕ͍ͯͦ͏ͳࡐྉΛਪન ࡐྉͷਪનʢਂᖒʣ

  20. ՝୊ εϚʔτεϐʔΧʔͰखॱΛಡΈ্͍͛ͨ ͚ͲɺϨγϐʹΑͬͯ͸ௐཧͱؔ܎ͳ͍खॱʢಡΈ্͛Δඞཁ͕ͳ͍खॱʣؚ͕·ΕΔ ΫοΫύουͷऔΓ૊Έ ඇखॱΛݕग़͢Δ-45.Λֶश ಡΈ্͛ͷࡍɺݕग़͞Εͨඇखॱ͸εΩοϓ ඇखॱͷݕग़ʢ*OV[VLB*UPʣ खॱ -45. खॱ

    -45. खॱ -45. खॱ -45. खॱ -45. खॱ -45. खॱ -45. ඇखॱ -45. ਫࡊ͸ʜ ✕
  21. ՝୊ छʑͷऔΓ૊ΈΛվળ͍ͨ͠ ͚Ͳɺͦ΋ͦ΋ɺͦΕΒͷ౔୆Ͱ͋ΔϨγϐղੳͷੑೳ͕௿͍ ΫοΫύουͷऔΓ૊Έ Ϩγϐʹܗଶૉղੳɾݻ༗දݱೝࣝɾߏจղੳͷਖ਼ղΛ෇༩ ղੳޡΓͷ෼ੳ΍Ϟσϧͷ࠶ֶशͳͲʹར༻ɺछʑͷऔΓ૊ΈΛվળʢ༧ఆʣ ղੳࡁΈίʔύεͷߏஙʢ)BSBTIJNBฏদʣ # Step-ID:1 #

    Sentence-ID:1-1 * 0 4D 1/2 .7 1 3:,,?,35,*,*,*,*,1,,,B-Fi + ?,,<,*,*,*,*,+, , ,I-Fi  0,,$0,,*,*,*,*,,,,O * 1 2D 1/2 =4' ( ?,,<,*,*,*,*,(, , ,B-Sf 6 ?,,<,*,*,*,*,6, , ,I-Sf  0,, 0,,<,*,*,*,,,,O * 2 4P 0/0 /' 2 ;,,-A,*,*,&8),B@%,2, , ,B-Ap * 3 4D 0/1 =4'  ?,,<,*,*,*,*,, , ,B-Fi  0,, 0,,<,*,*,*,,,,O * 4 -1O 0/0 /'  ;,,-A,*,*,&8),!>%,,,,B-Ap  "*,#9,*,*,*,*,,,,O EOS ࠶ֶश ద߹཰ ࠶ݱ཰ '஋ ୯ޠ෼ׂͷΈ ͳ͠    ͋Γ    ୯ޠ෼ׂʴ ඼ࢺλά෇͚ ͳ͠    ͋Γ    ਖ਼ղ཰ ద߹཰ ࠶ݱ཰ '஋ 4BTBEB     -BNQMF     ܗଶૉղੳثʢ.F$BCʣͷੑೳ ݻ༗දݱೝࣝثͷੑೳ ࠶ֶश ਖ਼ղ཰ จઅ୯Ґ จ୯Ґ ͳ͠   ͋Γ   ߏจղੳثʢ$BCP$IBʣͷੑೳ ΞϊςʔγϣϯͷҰྫ
  22. None
  23. اۀͰͷݚڀ։ൃͷָ͠͞ʁ ΫοΫύου

  24. །ҰແೋͷςʔϚʹऔΓ૊ΊΔ ࣮αʔϏεͷ՝୊͔ΒςʔϚ͕ੜ·ΕΔ ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺʜ اۀʹ͔͠ͳ͍σʔλ͕࢖͑Δ ɾϨγϐʢੜίʔύεɺղੳࡁΈίʔύεɺର༁ίʔύεʣ ɾϢʔβʔଐੑʢੑผɺ೥ྸʣɺݕࡧΫΤϦɺӾཡཤྺ
 ɾΫοΫύουϚʔτͷ঎඼৘ใɺ஫จཤྺʢ/FXʣ
 ɾʜ ˠϒϧʔɾΦʔγϟϯʹඈͼࠐΊΔ ɾ࿦จ΋ॻ͚Δʢ௨Δͱ͸ݴͬͯͳ͍ʣ

  25. ๛෋ͳϦιʔε͕࢖͑Δ ܭࢉػ ɾ"NB[PO&$ʢ(16ΠϯελϯεؚΉʣɺ4ɺ3FETIJGUɺʜ ɾΠϯελϯε͸TMBDL͔ΒؾܰʹTUBSUTUPQUFSNJOBUFͰ͖Δ ͓ۚ ɾΞϊςʔγϣϯʢඦສԁʙʣɺւ֎ग़ுʢ਺ेສԁʣɺӳจߍਖ਼ʢ਺ສԁʣɺʜ ɾ͋·ΓࠔͬͨهԱ͕ͳ͍ ਓ ɾ/-1ʹݶΒͣɺ༷ʑͳ෼໺ʢFH $7ɺ*P5ʣͷεϖγϟϦετ͕ࣾ಺ʹ͍Δ

    ɾΞϊςʔγϣϯ΋جຊతʹ͸ࣾ಺ͷΞϊςʔλʔʹґཔʢࣾ֎ͩͱ༨ܭͳख͕͔͔ؒΔʣ ࣮αʔϏε ɾධՁʹ࢖͑ΔʢFH "#ςετʣ ɾاۀͳΒͰ͸ͷϦιʔε
  26. /-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘ /-1Λ࢓ࣄʹ͍ͨ͠ਓ͸ɺ/-1Ҏ֎ͷεΩϧʹ΋໨Λ޲͚Δ΂͖ʢࢲݟʣ ɾ͜͜਺೥Ͱ/-1FS͸ٸ૿ɺπʔϧ΋ίϞσΟςΟԽ ɾ/-1͔͠Ͱ͖ͳ͍ਓͷࢢ৔Ձ஋͸ٸݮ ΫοΫύουͰ͸ݚڀ։ൃͷ੒ՌΛαʔϏεʹಋೖ͢Δͷ΋ݚڀ։ൃ෦໳ͷ໾ׂͷ͏ͪ ɾʮ/PUFCPPLʹ·ͱΊͱ͍ͨɻ͋ͱ͸ΑΖ͘͠ʯͱ͔Ͱ͸ͳ͍ ˠ໾ׂΛՌͨ͢͏ͪʹɺ͓څྉΛ΋Β͍ͭͭɺ/-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘ ɾݴޠɿ3VCZɺ(Pɺ+BWBɺ3VTUɺ+BWB4DSJQUɺ5ZQF4DSJQUɺʜ ɾϑϨʔϜϫʔΫɿ3VCZPO3BJMTɺ3FBDUɺʜ ɾσʔλϕʔεɿ.Z42-ɺ1PTUHSFT2-ɺ3FEJTɺ%ZOBNP%#ɺ3FETIJGUɺʜ

    ɾͦͷଞɿ"84ɺ%PDLFSɺH31$ɺ(SBQI2-ɺʜ
  27. ༷ʑͳධՁ͕࣠͋Δ ΞΧσϛοΫͷੈք͸QVCMJTIPSQFSJTI ɾ࿦จΛॻ͔ͳ͍ͱϙετʹब͚ͳ͍ اۀͷݚڀ։ൃ෦໳͸PVUQVUPSQFSJTI ɾPVUQVU͸࿦จͰͳͯ͘΋Α͍ʢFH 044ɺಛڐɺٕज़ϒϩάɺߨԋʣ ݸਓ͕ձࣾʹߩݙ͢Δํ๏͸༷ʑˠձ͕ࣾݸਓΛධՁ͢Δ࣠΋༷ʑ ɾͳ͓ɺPVUQVU͕ͳ͍ͱධՁෆೳʹͳΔͷͰɺPVUQVU͸ͪΌΜͱ͢Δ

  28. اۀͰͷݚڀ։ൃͷۤ࿑ʁ ΫοΫύου

  29. αʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍ αʔϏε։ൃ͸଎͍ ݚڀ։ൃ͸஗͍ ࣮૷ɾσϓϩΠ
 ධՁɾվળ िؒ िؒ िؒ िؒ ࣮૷ɾσϓϩΠ


    ධՁɾվળ ࣮૷ɾσϓϩΠ
 ධՁɾվળ ࣮૷ɾσϓϩΠ
 ධՁɾվળ αʔϕΠ िؒ िؒ िؒ िؒ Ξϊςʔγϣϯ
 ࣮૷ ֶशɾվળ ධՁʢखݩʣ σϓϩΠ ධՁʢຊ൪ʣ FH αΠΫϧिؒ FH αΠΫϧϲ݄ िؒޙ α ݚ /-1Ͱ
 YYYͰ͖Δʁ ଟ෼Ͱ͖ΔΑ ʢϲ݄͋Ε͹ʣ α ݚ Ͱ͖ͨʁ ͑ͬʂ ʜ ʜ
  30. ͲΕ͘Β͍Ͱ͖Δ͔Λલ΋ͬͯ஌Δͷ͸೉͍͠ ɾҰԠɺਓؒͷਫ਼౓ʢ㱢γεςϜͷਫ਼౓ʣΛଌΕ͹ɺ͓͓·͔ͳਫ਼౓ͷ্ݶ͸෼͔Δ ʮ΍ͬͯΈͨʯˠʮͰ͖ͳ͔ͬͨʯ͸Α͋͘Δ ɾʮͰ͖ͳ͔ͬͨʯͷ൑அ΋೉͍͠ʢʮ΋͏গ͠ؤுΕ͹ʜʯˠ/ϲ݄͕ແବʹʣ ϲ݄ޙ α ݚ /-1Ͱ
 YYYͰ͖Δʁ ϲ݄͋Ε͹

    ଟ෼Ͱ͖ΔΑ ݚ α ਫ਼౓͕
 ݶքͩͬͨʜ ͑ͬʜ ͔ʜ ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍
  31. 405"͕ྑ͍ͱ͸ݶΒͳ͍ ʮ405"Ͱߴਫ਼౓Λୡ੒ʯˠʮͰ͖ͨʂʯͱ͸ͳΒͳ͍ ɾӡ༻·Ͱߟ͑ΔͱɺރΕٕͨज़ʢFH 47.ɺਖ਼نදݱʣͷํ͕ྑ͍έʔε͕ଟ͍ ͚Ͳɺ405"΋࢖͍ͨͯ͘͏ͣ͏ͣ͢Δʜ ɾ΋ͪΖΜɺ405"ͷํ͕ྑ͍έʔεʢਫ਼౓͕΋ͬͱ΋ॏཁͳέʔεʣ΋͋Δ ਫ਼౓ ࣮૷ σϓϩΠ ଐਓੑ

    ଎౓ අ༻ 405" ߴ ೉ ೉ ߴ ஗ ߴ ރΕٕͨज़ ී қ қ ௿ ଎ ҆
  32. ͦͷଞ σʔλ͕࢖͍ʹ͍͘ʜʁ ɾେ͖͍اۀͩͱσʔλ͕ࢄΒ͹͍ͬͯͨΓɺ࢖͏ͷʹਃ੥͕ඞཁͩͬͨΓ ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢσʔλ͕%8)ʹ·ͱ·͍ͬͯΔʣ ੒Ռ͕ൃද͠ʹ͍͘ʜʁ ɾηϯγςΟϒͳσʔλΛѻ͏اۀͩͱϋʔυϧ͕ߴ͍ʢΒ͍͠ʣ ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢηϯγςΟϒͳσʔλ͕গͳ͍ʣ

  33. ·ͱΊ

  34. ·ͱΊ ΫοΫύουͱ/-1 ɾϨγϐ΍ΫΤϦΛॲཧ͢Δͷʹ/-1͕ෆՄܽ /-1͕ؔ܎͢Δ՝୊ ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺղੳࡁΈίʔύεͷߏங اۀͰͷݚڀ։ൃͷָ͠͞ ɾ།ҰແೋͷςʔϚʹऔΓ૊ΊΔ ɾ๛෋ͳϦιʔε͕࢖͑Δ ɾ/-1Ҏ֎ͷεΩϧ͕਎ʹͭ͘ ɾ༷ʑͳධՁ͕࣠͋Δ

    اۀͰͷݚڀ։ൃͷۤ࿑ ɾαʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍ ɾ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍ ɾ405"͕ྑ͍ͱ͸ݶΒͳ͍ ΫοΫύου ΫοΫύου
  35. ྉཧY/-1ʹऔΓ૊Ή஥ؒΛ୳͍ͯ͠·͢ IUUQTJOGPDPPLQBEDPNDBSFFST ಇ͔ͳͯ͘΋ ৯΂͍͚ͯΔະདྷʹɺ ԿΛ૑Γग़ͦ͏ɻ