Upgrade to Pro — share decks privately, control downloads, hide ads and more …

自然言語処理の基礎と応用 〜 料理と医療を題材として 〜 /JADI2021

j.harashima
September 10, 2021
3.3k

自然言語処理の基礎と応用 〜 料理と医療を題材として 〜 /JADI2021

j.harashima

September 10, 2021
Tweet

More Decks by j.harashima

Transcript

  1.   ژ౎େֶʹͯࣗવݴޠॲཧͷݚڀࣨʹ ഑ଐ ത࢜ʢ৘ใֶʣΛऔಘɺΫοΫύου ʹೖࣾ ݪౡ७  ݚڀ։ൃ෦Λ৽ઃ 

    ϨγϐݕࡧνʔϜΛ৽ઃɺϦʔμʔʹ ब೚ʢݚڀ։ൃ෦෦௕΋݉຿ʣ  ಉ෦෦௕ʹब೚
  2. ܗଶૉղੳ จதͷܗଶૉʢ㲈୯ޠʣͷڥքͱ඼ࢺɺݪܗΛೝࣝ͢Δॲཧ ೔ຊޠ͸୯ޠ͕εϖʔεͰ۠੾ΒΕ͍ͯͳ͍ˠܗଶૉղੳ͸೔ຊޠॲཧͷୈҰา ϑϥϯε ଠ࿠ ͸ Λ ৯΂ ύϯ c

    ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ໊ࢺ c c c ৯΂Δ ଠ࿠ ͸ Λ ϑϥϯε ύϯ ݪܗ ڥք ඼ࢺ c ॿࢺ ଠ࿠͸ϑϥϯεύϯΛ৯΂ͨ ೖྗ ग़ྗ ͨ ͨ c ॿಈࢺ จ
  3. ݻ༗දݱೝࣝ จதͷݻ༗දݱʢFH ਓ໊ɺ஍໊ɺʜʣΛೝࣝ͢Δॲཧ ܗଶૉղੳͷग़ྗΛೖྗͱ͠ɺݻ༗දݱͷϥϕϧΛग़ྗ ϑϥϯε ଠ࿠ ͸ Λ ৯΂ ύϯ

    c ໊ࢺ ໊ࢺ ಈࢺ ॿࢺ ໊ࢺ c c c ৯΂Δ ଠ࿠ ͸ Λ ϑϥϯε ύϯ ݪܗ ڥք ඼ࢺ c ॿࢺ ೖྗ ͨ ͨ c ॿಈࢺ ग़ྗ ਓ໊ ͦͷଞ ͦͷଞ ͦͷଞ ͦͷଞ ͦͷଞ ஍໊ ϥϕϧ
  4. ಉٛؔ܎ೝࣝ ͋Δޠ۟ͱผͷޠ͕۟ಉ͡ҙຯ͔ҧ͏ҙຯ͔Λೝࣝ͢Δॲཧ ୯ޠಉ࢜Ͱ͸ಉ͡ҧ͏ҙຯͰ΋ɺผͷ୯ޠͱ߹ΘͤΔͱҧ͏ಉ͡ҙຯʹͳΔ͜ͱ΋ ৯΂Δ ͨ΂Δ ৯΂Δ ৯͏ ৯΂Δ ҿΉ ୯ޠϖΞ

    ೖྗ ग़ྗ ೝࣝ݁Ռ ಉ͡ ҧ͏ ಉ͡ ৯͏ ࢖͏ ҧ͏ ϑϨʔζϖΞ ೝࣝ݁Ռ ϝϞϦΛ৯͏ ϝϞϦΛ࢖͏ ಉ͡ Ұഋ৯͏ Ұഋ৯΂Δ ҧ͏ ʢͩ·͞ΕΔʣ ೖྗ ग़ྗ
  5. ༷ʑͳՄೳੑ Ϩετϥϯ Ϩγϐ ϝχϡʔ ޱίϛ ৘ใݕࡧ ػց຋༁ จॻ෼ྨ ʜ ྉཧυϝΠϯʹ͓͚ΔԠ༻

    ʹ º ྉཧυϝΠϯʹ ͓͚ΔςΩετ ࣗવݴޠॲཧͷ Ԡ༻ ʜ ৘ใநग़ ʢͷ঺հϖʔδʣ
  6. Ϩγϐº৘ใݕࡧ ͨ·Ͷ͗ πφͱͨ·Ͷ͗ͷ ࿨෩ύελ ߜΓࠐΉ   ඼ ۄೢͱੜᇙͷ ͔͋ͬͨຯ઻ो

    ΧϦΧϦ̇ ΦχΦϯϦϯά ۄͶ͗ͱτϚτͷ αϥμ ΦχΦϯάϥλϯ εʔϓ  ܗଶૉղੳ΍ݻ༗දݱೝࣝΛ֤Ϩγϐʹద༻͠ɺ 
 Ϩγϐதͷ୯ޠ΍ݻ༗දݱΛೝࣝ 
  ֤୯ޠʹ͍ͭͯಉٛޠΛల։ 
 FH ͨ·Ͷ͗ʹۄೢʹۄͶ͗ʹΦχΦϯ 
  ΫΤϦʢ͓Αͼɺͦͷಉٛޠʣ͕ग़ݱ͢ΔϨγϐΛ 
 ݕࡧ݁Ռͱͯ͠ఏࣔ
  7. Ϩγϐºจॻ෼ྨ ͨ·Ͷ͗ ओࡊ ओ৯ ۄೢͱੜᇙͷ ͔͋ͬͨຯ઻ो ෭ࡊ ो෺ ߜΓࠐΉ 

     ඼ ΦχΦϯάϥλϯ εʔϓ ཛͱ౾෗ͱۄೢͷ ༏͍͠εʔϓ ͨ·Ͷ͗ͱਓࢀͱ Ωϟϕπͷϙτϑ  ܗଶૉղੳ΍ݻ༗දݱೝࣝΛ֤Ϩγϐʹద༻͠ɺ 
 Ϩγϐதͷ୯ޠ΍ݻ༗දݱΛೝࣝ 
  ֤୯ޠʹ͍ͭͯಉٛޠΛల։ 
 FH ͨ·Ͷ͗ʹۄೢʹۄͶ͗ʹΦχΦϯ 
  ֤ΫϥεʢFH ो෺ʣʹॴଐ͢΂͖ϨγϐΛਓखͰ 
 ऩू͠ɺͦΕΒʹग़ݱ͢Δ୯ޠͷύλʔϯΛ೺Ѳ 
  Ͱऩूͨ͠ϨγϐҎ֎ͷϨγϐʹύλʔϯΛద༻͠ɺ 
 ֤Ϋϥεʹ෼ྨ
  8. y1 yJ y2 … canonical form of the ingredient decoder

    original string of an ingredient encoder x1 x2 xI … softmax softmax softmax … Ϩγϐதͷදه ৯඼੒෼දதͷදه දه༳Ε ਓࢀ ʹΜ͡Μ ུه ৽ͨ· ৽ͨ·Ͷ͗ εϖϧϛε ͋΅͕Ͳ ΞϘΧυ ͦͷଞ അླḕ ͡Ό͕͍΋ dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving λΠτϧ .ࡼ෼౳ /ਓ෼ ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ ࡼ෼  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ ߹෼  άϥϊʔϥΫοΩʔ ຕ  ύϯϓΩϯλϧτ DNλϧτܕ  ৄ͘͠͸ɺJun Harashima, Makoto Hiramatsu, and Satoshi Sanjo. Calorie Estimation in a Real-World Recipe Service. In Proceedings of the 32nd Annual Conference on Innovative Applications of Arti fi cial Intelligence (IAAI-20), 2020. Λ͝ཡ͍ͩ͘͞ɻ Ϩγϐºػց຋༁ʢΧϩϦʔܭࢉʣ  Ϩγϐதͷ֤ࡐྉͷදهΛ৯඼੒෼දதͷදهʹม׵  ʮ.ࡼ෼ʯ΍ʮ.߹෼ʯɺʮ.ຕʯͳͲΛʮ/ਓ෼ʯʹม׵  ֤ࡐྉͷΧϩϦʔΛ৯඼੒෼ද͔Βऔಘ͠ɺ߹ܭ  ߹ܭΛ/Ͱׂͬͯɺਓ෼ͷΧϩϦʔΛऔಘ ˞ผݴޠ΁ͷ຋༁ʢҰൠతͳػց຋༁ʣͰ͸ͳ͘ɺಉҰݴޠ΁ͷ຋༁ʢݴ͍׵͑ʣ
  9. ༷ʑͳՄೳੑ Χϧς ࿦จ Ϩηϓτ αϚϦ ৘ใݕࡧ ػց຋༁ จॻ෼ྨ ʜ ҩྍυϝΠϯʹ͓͚ΔԠ༻

    ʹ º ҩྍυϝΠϯʹ ͓͚ΔςΩετ ࣗવݴޠॲཧͷ Ԡ༻ ʜ ৘ใநग़