企業での研究開発の楽しさと苦労/WAP-Tech-Talk

2. ೥݄ ೥݄ ژ౎େֶࠇڮݚڀࣨ഑ଐ ΫοΫύουೖࣾ ത࢜ʢ৘ใֶʣऔಘ ΤϯδχΞʢ3VCZ
   PO
   3BJMTʣ ೥݄ ֶੜʢࣗવݴޠॲཧ
   
   ৘ใݕࡧʣ ݪౡ
   ७ ೥݄ Ϛωʔδϟʔʢਓࣄ
   
   ޿ใ
   
   ʜʣ ݚڀ։ൃ෦໳ઃཱ
3. ΫοΫύου Πϯλʔωοτ্ͰϨγϐͷ౤ߘɾݕࡧ౳͕Ͱ͖Δ
   ੈք࠷େͷྉཧϨγϐαʔϏε ݄ؒར༻ऀ਺
   
   ԯਓ௒ʢ
   Χࠃ
   
   ݴޠʣ
   ϓϨϛΞϜձһ਺໿
   
   ສਓ
4. ΫοΫύουϚʔτ
5. ܙൺण
   
   ԣ඿ʢΈͳͱΈΒ͍ʣ
7. ΫοΫύουͰݚڀ։ൃʁ
8. Ԋֵ ೥݄ ༗ݶձࣾίΠϯʢݱΫοΫύουגࣜձࣾʣઃཱ ೥݄ ೥݄ ೥݄ ೥݄ ೥݄ Ϩγϐͷ౤ߘɾݕࡧαʔϏε
   LJUDIFO!DPJO
   ։࢝ ΫοΫύουʹαʔϏε໊มߋ ೥݄ ϓϨϛΞϜαʔϏε։࢝ Ϛβʔζ্৔ ౦ূҰ෦ʹࢢ৔มߋ ϓϨϛΞϜαʔϏεձһ਺
   
   ສਓಥഁ ೥݄ ւ֎ల։Λຊ֨Խ ೥݄ ݚڀ։ൃ෦໳ઃཱ
9. ݚڀ෼໺ ࣗવݴޠॲཧ εϚʔτΩονϯ ը૾ॲཧ ৯จԽ
10. SFTFBSDIDPPLQBEDPN
11. ࿦จ΋গͣͭ͠ʢ·ͩ
    TIPSU
    QBQFS
    ΍
    XPSLTIPQ
    ͕ଟΊʣ 
    
    $PPLQBE
    1BSTFE
    $PSQVT
    -JOHVJTUJD
    "OOPUBUJPOT
    PG
    +BQBOFTF
    3FDJQFT
    -"8
    
    
    /POJOHSFEJFOU
    %FUFDUJPO
    JO
    6TFSHFOFSBUFE
    3FDJQFT
    VTJOH
    UIF
    4FRVFODF
    5BHHJOH
    "QQSPBDI
    8/65
    
    
    5PXBSET
    .VMUJ-BOHVBHF
    3FDJQF
    1FSTPOBMJTBUJPO
    BOE
    3FDPNNFOEBUJPO
    3FD4ZT
    
    
    7JTVBM
    (SPVOEJOH
    "OOPUBUJPO
    PG
    3FDJQF
    'MPX
    (SBQI
    -3&$
    
    
    $BMPSJF
    &TUJNBUJPO
    JO
    B
    3FBM8PSME
    3FDJQF
    4FSWJDF
    *""*
    
    
    3FBM
    8PSME
    7PJDF
    "TTJTUBOU
    4ZTUFN
    GPS
    $PPLJOH
    */-(
    
    
    /BNFE
    &OUJUZ
    3FDPHOJUJPO
    CZ
    $IBSBDUFSCBTFE
    8PSE
    $MBTTJpDBUJPO
    VTJOH
    B
    %PNBJO
    4QFDJpD
    %JDUJPOBSZ
    $*$-JOH
    
    
    
    4UFQ
    PS
    /PU
    %JTDSJNJOBUPS
    GPS
    5IF
    3FBM
    *OTUSVDUJPOT
    JO
    6TFSHFOFSBUFE
    3FDJQFT
    8/65
    
    
    5XP4UFQ
    7BMJEBUJPO
    JO
    $IBSBDUFSCBTFE
    *OHSFEJFOU
    /PSNBMJ[BUJPO
    $&"
    
    
    
    $PPLQBE
    *NBHF
    %BUBTFU
    "O
    *NBHF
    $PMMFDUJPO
    BT
    *OGSBTUSVDUVSF
    GPS
    'PPE
    3FTFBSDI
    4*(*3
    
    
    "QQSPBDIFT
    UP
    'PPE/POGPPE
    *NBHF
    $MBTTJpDBUJPO
    6TJOH
    %FFQ
    -FBSOJOH
    JO
    $PPLQBE
    $&"
    
    
    -FBSOJOH
    'PPE
    "QQFBSBODF
    CZ
    B
    4VQFSWJTJPO
    XJUI
    3FDJQF
    5FYU
    $&"
    
    
    
    +BQBOFTF&OHMJTI
    .BDIJOF
    5SBOTMBUJPO
    PG
    3FDJQF
    5FYUT
    8"5
    
    
    %FTJHO
    JO
    &WFSZEBZ
    $PPLJOH
    $IBMMFOHFT
    GPS
    "TTJTUJOH
    XJUI
    .FOV
    1MBOOJOH
    BOE
    'PPE
    1SFQBSBUJPO
    $$%
    
    
    "
    -BSHF4DBMF
    3FDJQF
    BOE
    .FBM
    %BUB
    $PMMFDUJPO
    BT
    *OGSBTUSVDUVSF
    GPS
    'PPE
    3FTFBSDI
    -3&$
    
12. ΫοΫύουͰ
    /-1
    ʁ
13. ɾλΠτϧ
    ɾ֓ཁ
    ɾࡐྉ
    ɾखॱ
    ɾίπɾϙΠϯτ
    ɾ͜ͷϨγϐͷੜཱ͍ͪ
    ɾͭ͘ΕΆ
    ɾʜ ϨγϐʹςΩετʢʴը૾ʣ
14. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZ
    ͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF
15. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZ
    ͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF /-1
    ͕ෆՄܽ
16. ΫΤϦʹςΩετʢʴϢʔβʔଐੑʣ ؆୯ʂλϐΦΧ౾Ֆʢτ΢ϑΝʣCZ
    ͩΜͲΓ௾͞Μ
    IUUQTDPPLQBEDPNSFDJQF ͨͱ͑͹ɺͲ͏͍͏՝୊͕͋Δʁ
17. Ϩγϐͷ෼ྨ ՝୊
    Ϩγϐݕࡧͷ݁ՌΛʮྉཧͷछྨʢFH
    ओ৯ɺ͓͔ͣɺεʔϓɺʜʣʯͰߜΓࠐΈ͍ͨ
    ͚ͲɺϨγϐʹͦ͏͍ͬͨλά͸෇͍͍ͯͳ͍
    ΫοΫύουͷऔΓ૊Έ
    ϨγϐͷλΠτϧ͔ΒྉཧͷछྨΛ༧ଌ͢Δ
    47.
    Λֶश
    શϨγϐʢ໿
    
    ສ඼ʣʹλάΛ෇༩
18. y1 yJ y2 … canonical form of the ingredient decoder original string of an ingredient encoder x1 x2 xI … softmax softmax softmax … ΧϩϦʔͷܭࢉʢ)BSBTIJNB
    
    )BSBTIJNB
    ʣ ՝୊
    Ϩγϐݕࡧͷ݁ՌΛʮҰਓ෼ͷΧϩϦʔʯͰߜΓࠐΈ͍ͨ
    ͚Ͳɺ֤Ϩγϐͷࡐྉ΍෼ྔͷදه͸όϥόϥɺͦͷ··Ͱ͸ΧϩϦʔ͕ܭࢉͰ͖ͳ͍
    ΫοΫύουͷऔΓ૊Έ
    ࡐྉΛਖ਼نԽ͢Δ
    //
    ͱ෼ྔΛਓ਺෼ʹ׵ࢉ͢Δ
    //
    Λֶश
    ໿
     
    ϨγϐͷΧϩϦʔΛऔಘ ਖ਼نԽલ ਖ਼نԽޙ දه༳Ε ਓࢀ ʹΜ͡Μ ུه ৽ͨ· ৽ͨ·Ͷ͗ εϖϧϛε ͋΅͕Ͳ ΞϘΧυ ͦͷଞ അླḕ ͡Ό͕͍΋ dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving λΠτϧ ׵ࢉલ ׵ࢉޙʢਓ਺෼ʣ ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ 
    ࡼ෼  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ 
    ߹෼  άϥϊʔϥΫοΩʔ 
    ຕ  ύϯϓΩϯλϧτ DN
    λϧτܕ 
19. ՝୊
    εϚʔτϑΥϯ͔ΒͷϨγϐ౤ߘ͕૿͍͑ͯΔ
    ͚ͲɺεϚʔτϑΥϯͷখ͍͞ը໘ͰςΩετΛೖྗ͢Δͷ͸େม
    ΫοΫύουͷऔΓ૊Έ
    ϨγϐͷλΠτϧ͔ΒࡐྉΛ༧ଌ͢Δ
    //
    Λֶश
    Ϣʔβʔ͕λΠτϧΛೖྗͨ͠ΒɺͦͷϨγϐͰ࢖ΘΕ͍ͯͦ͏ͳࡐྉΛਪન ࡐྉͷਪનʢਂᖒ
    ʣ
20. ՝୊
    εϚʔτεϐʔΧʔͰखॱΛಡΈ্͍͛ͨ
    ͚ͲɺϨγϐʹΑͬͯ͸ௐཧͱؔ܎ͳ͍खॱʢಡΈ্͛Δඞཁ͕ͳ͍खॱʣؚ͕·ΕΔ
    ΫοΫύουͷऔΓ૊Έ
    ඇखॱΛݕग़͢Δ
    -45.
    Λֶश
    ಡΈ্͛ͷࡍɺݕग़͞Εͨඇखॱ͸εΩοϓ ඇखॱͷݕग़ʢ*OV[VLB
    
    *UP
    ʣ खॱ -45. खॱ -45. खॱ -45. खॱ -45. खॱ -45. खॱ -45. खॱ -45. ඇखॱ -45. ਫࡊ͸ʜ ✕
21. ՝୊
    छʑͷऔΓ૊ΈΛվળ͍ͨ͠
    ͚Ͳɺͦ΋ͦ΋ɺͦΕΒͷ౔୆Ͱ͋ΔϨγϐղੳͷੑೳ͕௿͍
    ΫοΫύουͷऔΓ૊Έ
    
    Ϩγϐʹܗଶૉղੳɾݻ༗දݱೝࣝɾߏจղੳͷਖ਼ղΛ෇༩
    ղੳޡΓͷ෼ੳ΍Ϟσϧͷ࠶ֶशͳͲʹར༻ɺछʑͷऔΓ૊ΈΛվળʢ༧ఆʣ ղੳࡁΈίʔύεͷߏஙʢ)BSBTIJNB
    
    ฏদ
    ʣ # Step-ID:1 # Sentence-ID:1-1 * 0 4D 1/2 .7 1 3:,,?,35,*,*,*,*,1,,,B-Fi + ?,,<,*,*,*,*,+, , ,I-Fi  0,,$0,,*,*,*,*,,,,O * 1 2D 1/2 =4' ( ?,,<,*,*,*,*,(, , ,B-Sf 6 ?,,<,*,*,*,*,6, , ,I-Sf  0,, 0,,<,*,*,*,,,,O * 2 4P 0/0 /' 2 ;,,-A,*,*,&8),B@%,2, , ,B-Ap * 3 4D 0/1 =4'  ?,,<,*,*,*,*,, , ,B-Fi  0,, 0,,<,*,*,*,,,,O * 4 -1O 0/0 /'  ;,,-A,*,*,&8),!>%,,,,B-Ap
    "*,#9,*,*,*,*,
    ,
    ,
    ,O EOS ࠶ֶश ద߹཰ ࠶ݱ཰ '
    ஋ ୯ޠ෼ׂͷΈ ͳ͠    ͋Γ    ୯ޠ෼ׂʴ
    ඼ࢺλά෇͚ ͳ͠    ͋Γ    ਖ਼ղ཰ ద߹཰ ࠶ݱ཰ '
    ஋ 4BTBEB
         -BNQMF
         ܗଶૉղੳثʢ.F$BCʣͷੑೳ ݻ༗දݱೝࣝثͷੑೳ ࠶ֶश ਖ਼ղ཰ จઅ୯Ґ จ୯Ґ ͳ͠   ͋Γ   ߏจղੳثʢ$BCP$IBʣͷੑೳ ΞϊςʔγϣϯͷҰྫ
23. اۀͰͷݚڀ։ൃͷָ͠͞ʁ ΫοΫύου
24. 
    །ҰແೋͷςʔϚʹऔΓ૊ΊΔ ࣮αʔϏεͷ՝୊͔ΒςʔϚ͕ੜ·ΕΔ
    ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺʜ
    اۀʹ͔͠ͳ͍σʔλ͕࢖͑Δ
    ɾϨγϐʢੜίʔύεɺղੳࡁΈίʔύεɺର༁ίʔύεʣ
    ɾϢʔβʔଐੑʢੑผɺ೥ྸʣɺݕࡧΫΤϦɺӾཡཤྺ
 ɾΫοΫύουϚʔτͷ঎඼৘ใɺ஫จཤྺʢ/FXʣ
 ɾʜ
    ˠ
    ϒϧʔɾΦʔγϟϯʹඈͼࠐΊΔ
    ɾ࿦จ΋ॻ͚Δʢ௨Δͱ͸ݴͬͯͳ͍ʣ
25. 
    ๛෋ͳϦιʔε͕࢖͑Δ ܭࢉػ
    ɾ"NB[PO
    &$ʢ(16
    ΠϯελϯεؚΉʣɺ4ɺ3FETIJGUɺʜ
    ɾΠϯελϯε͸
    TMBDL
    ͔Βؾܰʹ
    TUBSUTUPQUFSNJOBUF
    Ͱ͖Δ
    ͓ۚ
    ɾΞϊςʔγϣϯʢඦສԁʙʣɺւ֎ग़ுʢ਺ेສԁʣɺӳจߍਖ਼ʢ਺ສԁʣɺʜ
    ɾ͋·ΓࠔͬͨهԱ͕ͳ͍
    ਓ
    ɾ/-1
    ʹݶΒͣɺ༷ʑͳ෼໺ʢFH
    $7ɺ*P5ʣͷεϖγϟϦετ͕ࣾ಺ʹ͍Δ
    ɾΞϊςʔγϣϯ΋جຊతʹ͸ࣾ಺ͷΞϊςʔλʔʹґཔʢࣾ֎ͩͱ༨ܭͳख͕͔͔ؒΔʣ
    ࣮αʔϏε
    ɾධՁʹ࢖͑ΔʢFH
    "#
    ςετʣ
    ɾاۀͳΒͰ͸ͷϦιʔε
26. 
    /-1
    Ҏ֎ͷεΩϧ͕਎ʹͭ͘ /-1
    Λ࢓ࣄʹ͍ͨ͠ਓ͸ɺ/-1
    Ҏ֎ͷεΩϧʹ΋໨Λ޲͚Δ΂͖ʢࢲݟʣ
    ɾ͜͜਺೥Ͱ
    /-1FS
    ͸ٸ૿ɺπʔϧ΋ίϞσΟςΟԽ
    ɾ/-1
    ͔͠Ͱ͖ͳ͍ਓͷࢢ৔Ձ஋͸ٸݮ
    ΫοΫύουͰ͸ݚڀ։ൃͷ੒ՌΛαʔϏεʹಋೖ͢Δͷ΋ݚڀ։ൃ෦໳ͷ໾ׂͷ͏ͪ
    ɾʮ/PUFCPPL
    ʹ·ͱΊͱ͍ͨɻ͋ͱ͸ΑΖ͘͠ʯͱ͔Ͱ͸ͳ͍
    ˠ
    ໾ׂΛՌͨ͢͏ͪʹɺ͓څྉΛ΋Β͍ͭͭɺ/-1
    Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    ɾݴޠɿ3VCZɺ(Pɺ+BWBɺ3VTUɺ+BWB4DSJQUɺ5ZQF4DSJQUɺʜ
    ɾϑϨʔϜϫʔΫɿ3VCZ
    PO
    3BJMTɺ3FBDUɺʜ
    ɾσʔλϕʔεɿ.Z42-ɺ1PTUHSFT2-ɺ3FEJTɺ%ZOBNP%#ɺ3FETIJGUɺʜ
    ɾͦͷଞɿ"84ɺ%PDLFSɺH31$ɺ(SBQI2-ɺʜ
27. 
    ༷ʑͳධՁ͕࣠͋Δ ΞΧσϛοΫͷੈք͸
    QVCMJTI
    PS
    QFSJTI
    ɾ࿦จΛॻ͔ͳ͍ͱϙετʹब͚ͳ͍
    اۀͷݚڀ։ൃ෦໳͸
    PVUQVU
    PS
    QFSJTI
    ɾPVUQVU
    ͸࿦จͰͳͯ͘΋Α͍ʢFH
    044ɺಛڐɺٕज़ϒϩάɺߨԋʣ
    ݸਓ͕ձࣾʹߩݙ͢Δํ๏͸༷ʑ
    ˠ
    ձ͕ࣾݸਓΛධՁ͢Δ࣠΋༷ʑ
    ɾͳ͓ɺPVUQVU
    ͕ͳ͍ͱධՁෆೳʹͳΔͷͰɺPVUQVU
    ͸ͪΌΜͱ͢Δ
28. اۀͰͷݚڀ։ൃͷۤ࿑ʁ ΫοΫύου
29. 
    αʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍ αʔϏε։ൃ͸଎͍ ݚڀ։ൃ͸஗͍ ࣮૷ɾσϓϩΠ
 ධՁɾվળ 
    िؒ 
    िؒ 
    िؒ 
    िؒ ࣮૷ɾσϓϩΠ
 ධՁɾվળ ࣮૷ɾσϓϩΠ
 ධՁɾվળ ࣮૷ɾσϓϩΠ
 ධՁɾվળ αʔϕΠ 
    िؒ 
    िؒ 
    िؒ 
    िؒ Ξϊςʔγϣϯ
 ࣮૷ ֶशɾվળ
    ධՁʢखݩʣ σϓϩΠ
    
    
    
    ධՁʢຊ൪ʣ FH
    
    αΠΫϧ
    
    
    िؒ FH
    
    αΠΫϧ
    
    
    ϲ݄ 
    िؒޙ α ݚ /-1
    Ͱ
 YYY
    Ͱ͖Δʁ ଟ෼Ͱ͖ΔΑ
    ʢ
    ϲ݄͋Ε͹ʣ α ݚ Ͱ͖ͨʁ ͑ͬʂ ʜ ʜ
30. ͲΕ͘Β͍Ͱ͖Δ͔Λલ΋ͬͯ஌Δͷ͸೉͍͠
    ɾҰԠɺਓؒͷਫ਼౓ʢ㱢
    γεςϜͷਫ਼౓ʣΛଌΕ͹ɺ͓͓·͔ͳਫ਼౓ͷ্ݶ͸෼͔Δ
    ʮ΍ͬͯΈͨʯˠʮͰ͖ͳ͔ͬͨʯ͸Α͋͘Δ
    ɾʮͰ͖ͳ͔ͬͨʯͷ൑அ΋೉͍͠ʢʮ΋͏গ͠ؤுΕ͹ʜʯˠ
    /
    ϲ݄͕ແବʹʣ 
    ϲ݄ޙ α ݚ /-1
    Ͱ
 YYY
    Ͱ͖Δʁ 
    ϲ݄͋Ε͹
    ଟ෼Ͱ͖ΔΑ ݚ α ਫ਼౓
    
    ͕
 ݶքͩͬͨʜ ͑ͬʜ
    
    ͔ʜ 
    ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍
31. 
    405"
    ͕ྑ͍ͱ͸ݶΒͳ͍ ʮ405"
    Ͱߴਫ਼౓Λୡ੒ʯˠʮͰ͖ͨʂʯͱ͸ͳΒͳ͍
    ɾӡ༻·Ͱߟ͑ΔͱɺރΕٕͨज़ʢFH
    47.ɺਖ਼نදݱʣͷํ͕ྑ͍έʔε͕ଟ͍
    ͚Ͳɺ405"
    ΋࢖͍ͨͯ͘͏ͣ͏ͣ͢Δʜ
    ɾ΋ͪΖΜɺ405"
    ͷํ͕ྑ͍έʔεʢਫ਼౓͕΋ͬͱ΋ॏཁͳέʔεʣ΋͋Δ ਫ਼౓ ࣮૷ σϓϩΠ ଐਓੑ ଎౓ අ༻ 405" ߴ ೉ ೉ ߴ ஗ ߴ ރΕٕͨज़ ී қ қ ௿ ଎ ҆
32. 
    ͦͷଞ σʔλ͕࢖͍ʹ͍͘ʜʁ
    ɾେ͖͍اۀͩͱσʔλ͕ࢄΒ͹͍ͬͯͨΓɺ࢖͏ͷʹਃ੥͕ඞཁͩͬͨΓ
    ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢσʔλ͕
    %8)
    ʹ·ͱ·͍ͬͯΔʣ
    ੒Ռ͕ൃද͠ʹ͍͘ʜʁ
    ɾηϯγςΟϒͳσʔλΛѻ͏اۀͩͱϋʔυϧ͕ߴ͍ʢΒ͍͠ʣ
    ɾΫοΫύουͰ͸͋·Γࠔ͍ͬͯͳ͍ʢηϯγςΟϒͳσʔλ͕গͳ͍ʣ
33. ·ͱΊ
34. ·ͱΊ ΫοΫύουͱ
    /-1
    ɾϨγϐ΍ΫΤϦΛॲཧ͢Δͷʹ
    /-1
    ͕ෆՄܽ
    /-1
    ͕ؔ܎͢Δ՝୊
    ɾϨγϐͷ෼ྨɺΧϩϦʔͷܭࢉɺࡐྉͷਪનɺඇखॱͷݕग़ɺղੳࡁΈίʔύεͷߏங
    اۀͰͷݚڀ։ൃͷָ͠͞
    ɾ།ҰແೋͷςʔϚʹऔΓ૊ΊΔ
    ɾ๛෋ͳϦιʔε͕࢖͑Δ
    ɾ/-1
    Ҏ֎ͷεΩϧ͕਎ʹͭ͘
    ɾ༷ʑͳධՁ͕࣠͋Δ
    اۀͰͷݚڀ։ൃͷۤ࿑
    ɾαʔϏε։ൃͷεϐʔυʹ௥͍͚ͭͳ͍
    ɾ΍ͬͯΈͳ͍ͱ෼͔Βͳ͍
    ɾ405"
    ͕ྑ͍ͱ͸ݶΒͳ͍ ΫοΫύου ΫοΫύου
35. ྉཧ
    Y
    /-1
    ʹऔΓ૊Ή஥ؒΛ୳͍ͯ͠·͢ IUUQTJOGPDPPLQBEDPNDBSFFST ಇ͔ͳͯ͘΋ ৯΂͍͚ͯΔະདྷʹɺ ԿΛ૑Γग़ͦ͏ɻ