Upgrade to Pro — share decks privately, control downloads, hide ads and more …

企業での研究開発の楽しさと苦労/WAP-Tech-Talk

j.harashima
February 03, 2021
8.8k

 企業での研究開発の楽しさと苦労/WAP-Tech-Talk

j.harashima

February 03, 2021
Tweet

Transcript

  1. Ԋֵ ೥݄ ༗ݶձࣾίΠϯʢݱΫοΫύουגࣜձࣾʣઃཱ ೥݄ ೥݄ ೥݄ ೥݄ ೥݄ Ϩγϐͷ౤ߘɾݕࡧαʔϏεLJUDIFO!DPJO։࢝ ΫοΫύουʹαʔϏε໊มߋ

    ೥݄ ϓϨϛΞϜαʔϏε։࢝ Ϛβʔζ্৔ ౦ূҰ෦ʹࢢ৔มߋ ϓϨϛΞϜαʔϏεձһ਺ສਓಥഁ ೥݄ ւ֎ల։Λຊ֨Խ ೥݄ ݚڀ։ൃ෦໳ઃཱ
  2. ࿦จ΋গͣͭ͠ʢ·ͩTIPSUQBQFS΍XPSLTIPQ͕ଟΊʣ  $PPLQBE1BSTFE$PSQVT-JOHVJTUJD"OOPUBUJPOTPG+BQBOFTF3FDJQFT -"8  /POJOHSFEJFOU%FUFDUJPOJO6TFSHFOFSBUFE3FDJQFTVTJOHUIF4FRVFODF5BHHJOH"QQSPBDI 8/65  5PXBSET.VMUJ-BOHVBHF3FDJQF1FSTPOBMJTBUJPOBOE3FDPNNFOEBUJPO 3FD4ZT

     7JTVBM(SPVOEJOH"OOPUBUJPOPG3FDJQF'MPX(SBQI -3&$  $BMPSJF&TUJNBUJPOJOB3FBM8PSME3FDJQF4FSWJDF *""*   3FBM8PSME7PJDF"TTJTUBOU4ZTUFNGPS$PPLJOH */-(  /BNFE&OUJUZ3FDPHOJUJPOCZ$IBSBDUFSCBTFE8PSE$MBTTJpDBUJPOVTJOHB%PNBJO4QFDJpD%JDUJPOBSZ $*$-JOH   4UFQPS/PU%JTDSJNJOBUPSGPS5IF3FBM*OTUSVDUJPOTJO6TFSHFOFSBUFE3FDJQFT 8/65  5XP4UFQ7BMJEBUJPOJO$IBSBDUFSCBTFE*OHSFEJFOU/PSNBMJ[BUJPO $&"   $PPLQBE*NBHF%BUBTFU"O*NBHF$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI 4*(*3  "QQSPBDIFTUP'PPE/POGPPE*NBHF$MBTTJpDBUJPO6TJOH%FFQ-FBSOJOHJO$PPLQBE $&"  -FBSOJOH'PPE"QQFBSBODFCZB4VQFSWJTJPOXJUI3FDJQF5FYU $&"   +BQBOFTF&OHMJTI.BDIJOF5SBOTMBUJPOPG3FDJQF5FYUT 8"5  %FTJHOJO&WFSZEBZ$PPLJOH$IBMMFOHFTGPS"TTJTUJOHXJUI.FOV1MBOOJOHBOE'PPE1SFQBSBUJPO $$%  "-BSHF4DBMF3FDJQFBOE.FBM%BUB$PMMFDUJPOBT*OGSBTUSVDUVSFGPS'PPE3FTFBSDI -3&$
  3. y1 yJ y2 … canonical form of the ingredient decoder

    original string of an ingredient encoder x1 x2 xI … softmax softmax softmax … ΧϩϦʔͷܭࢉʢ)BSBTIJNB)BSBTIJNBʣ ՝୊ Ϩγϐݕࡧͷ݁ՌΛʮҰਓ෼ͷΧϩϦʔʯͰߜΓࠐΈ͍ͨ ͚Ͳɺ֤Ϩγϐͷࡐྉ΍෼ྔͷදه͸όϥόϥɺͦͷ··Ͱ͸ΧϩϦʔ͕ܭࢉͰ͖ͳ͍ ΫοΫύουͷऔΓ૊Έ ࡐྉΛਖ਼نԽ͢Δ//ͱ෼ྔΛਓ਺෼ʹ׵ࢉ͢Δ//Λֶश ໿ ϨγϐͷΧϩϦʔΛऔಘ ਖ਼نԽલ ਖ਼نԽޙ දه༳Ε ਓࢀ ʹΜ͡Μ ུه ৽ͨ· ৽ͨ·Ͷ͗ εϖϧϛε ͋΅͕Ͳ ΞϘΧυ ͦͷଞ അླḕ ͡Ό͕͍΋ dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving λΠτϧ ׵ࢉલ ׵ࢉޙʢਓ਺෼ʣ ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ ࡼ෼  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ ߹෼  άϥϊʔϥΫοΩʔ ຕ  ύϯϓΩϯλϧτ DNλϧτܕ 
  4. ՝୊ छʑͷऔΓ૊ΈΛվળ͍ͨ͠ ͚Ͳɺͦ΋ͦ΋ɺͦΕΒͷ౔୆Ͱ͋ΔϨγϐղੳͷੑೳ͕௿͍ ΫοΫύουͷऔΓ૊Έ Ϩγϐʹܗଶૉղੳɾݻ༗දݱೝࣝɾߏจղੳͷਖ਼ղΛ෇༩ ղੳޡΓͷ෼ੳ΍Ϟσϧͷ࠶ֶशͳͲʹར༻ɺछʑͷऔΓ૊ΈΛվળʢ༧ఆʣ ղੳࡁΈίʔύεͷߏஙʢ)BSBTIJNBฏদʣ # Step-ID:1 #

    Sentence-ID:1-1 * 0 4D 1/2 .7 1 3:,,?,35,*,*,*,*,1,,,B-Fi + ?,,<,*,*,*,*,+, , ,I-Fi  0,,$0,,*,*,*,*,,,,O * 1 2D 1/2 =4' ( ?,,<,*,*,*,*,(, , ,B-Sf 6 ?,,<,*,*,*,*,6, , ,I-Sf  0,, 0,,<,*,*,*,,,,O * 2 4P 0/0 /' 2 ;,,-A,*,*,&8),B@%,2, , ,B-Ap * 3 4D 0/1 =4'  ?,,<,*,*,*,*,, , ,B-Fi  0,, 0,,<,*,*,*,,,,O * 4 -1O 0/0 /'  ;,,-A,*,*,&8),!>%,,,,B-Ap  "*,#9,*,*,*,*,,,,O EOS ࠶ֶश ద߹཰ ࠶ݱ཰ '஋ ୯ޠ෼ׂͷΈ ͳ͠    ͋Γ    ୯ޠ෼ׂʴ ඼ࢺλά෇͚ ͳ͠    ͋Γ    ਖ਼ղ཰ ద߹཰ ࠶ݱ཰ '஋ 4BTBEB     -BNQMF     ܗଶૉղੳثʢ.F$BCʣͷੑೳ ݻ༗දݱೝࣝثͷੑೳ ࠶ֶश ਖ਼ղ཰ จઅ୯Ґ จ୯Ґ ͳ͠   ͋Γ   ߏจղੳثʢ$BCP$IBʣͷੑೳ ΞϊςʔγϣϯͷҰྫ
  5. αʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍ αʔϏε։ൃ͸଎͍ ݚڀ։ൃ͸஗͍ ࣮૷ɾσϓϩΠ
 ධՁɾվળ िؒ िؒ िؒ िؒ ࣮૷ɾσϓϩΠ


    ධՁɾվળ ࣮૷ɾσϓϩΠ
 ධՁɾվળ ࣮૷ɾσϓϩΠ
 ධՁɾվળ αʔϕΠ िؒ िؒ िؒ िؒ Ξϊςʔγϣϯ
 ࣮૷ ֶशɾվળ ධՁʢखݩʣ σϓϩΠ ධՁʢຊ൪ʣ FH αΠΫϧिؒ FH αΠΫϧϲ݄ िؒޙ α ݚ /-1Ͱ
 YYYͰ͖Δʁ ଟ෼Ͱ͖ΔΑ ʢϲ݄͋Ε͹ʣ α ݚ Ͱ͖ͨʁ ͑ͬʂ ʜ ʜ