Upgrade to Pro — share decks privately, control downloads, hide ads and more …

(Reading )Does BERT Know that the IS-A Relation Is Transitive?

ando
January 23, 2023

(Reading )Does BERT Know that the IS-A Relation Is Transitive?

Komachi lab

ando

January 23, 2023
Tweet

More Decks by ando

Other Decks in Science

Transcript

  1. ACL2022 Short paper

  2. - #&35͕*4"ؔ܎ͷ5SBOTJUJWFੑ࣭ͱͲͷఔ౓Ұக͢Δ͔ΛఆྔԽɻ - #&35ͷ༧ଌ͸*4"ؔ܎ͷਪҠੑʹ׬શʹ͸ैΘͳ͍͜ͱ͕໌Β͔ʹͳͬͨ 5SBOTJUJWF A is-a B & →

    A is-a C︖ B is-a C - #&35͸*4"ؔ܎Λͷ"DDVSBDZͰ༧ଌͰ͖Δ - #&35͕"JTB#ͱ#JTB$Λਖ਼͘͠༧ଌͨ͠৔߹ɺ"JTB$͸ ˠͦͷ··஌ࣝϕʔεͱͯ͠ѻ͑ͳ͍ 2 概要
  3. - ໊ࢺΛ༻͍Δ 3 Task definition 語義のペア Is-aであれば1, でなければ0

  4. -\TcT㱨4 BOEIZQP T 㱵 ^ 8PSE/FUͷશͯͷϦʔϑηϯεɻ 4͸8PSE/FUͷશͯͷޠٛͷू߹ɺIZQP T ͸ҙຯTͷԼҐޠٛͷू߹Λද͢ɻ -

    *4"ΛऔΓग़͢ • -͔ΒMFBGͷޠٛ/ΛϥϯμϜʹநग़͠ɺ/ΛSPPU3ʹ઀ଓͯ͠ɺύεQ /ˠ3 Λಘ Δ Q͔Β"ɺ#ɺ$ͷͭͷޠٛΛϥϯμϜʹநग़͠ɺ"ɺ#ɺ$ͷޠٛͷྫจΛಘΔ ͜ͷ݁Ռɺλϓϧʢ"ɺ#ɺ$ʣͱͭͷਖ਼ྫʢ"ɺ#ʣɺʢ#ɺ$ʣɺʢ"ɺ$ʣ͕ಘ ΒΕΔɻ - /PU*4"ΛऔΓग़͢ • -͔Βೋͭͷ/ /ΛϥϯμϜʹநग़͠ɺೋͭͷύεQ /ˠ3 ͱQ /ˠ3 Λ ಘΔQɺQ͔ΒͦΕͧΕ"⒌ɺ#⒌ΛϥϯμϜʹαϯϓϦϯά͠ɺޠٛ"⒌ɺ#⒌ͷྫจΛಘ Δ "⒌͕#⒌ˠ3ͷύε্ʹͳ͍৔߹ɺ·ͨͦͷٯͷ৔߹͸ɺෛྫʢ"⒌ #⒌ʣΛಘΔ - σʔληοτͰ͸ɺݸͷλϓϧ͕͋Γɺݸͷਖ਼ྫͱݸͷෛྫ͕͋Δɻ 4 Positive, Negative example抽出
  5. - #&35ͷ࠷ऴ૚ͷϕΫτϧΛ࢖༻ʢTVCXPSE͸BWFSBHFʣ - #&35͸ϑΝΠϯνϡʔχϯά͠ͳ͍ɺ࠷ۙ๣ʢOOʣ෼ྨثΛ࢖༻ ˠγϯϓϧͳ΋ͷΛ࢖͍͍ͨ - ϢʔΫϦουڑ཭Λڑ཭ࢦඪͱͯ͠༻͍Δɻ 5 分類 語義2

    語義1
  6. - ςετηοτͰ͸ɺ " # ͱ # $ ͷฏۉϗοϓ਺͸ͦΕͧΕ ͱ Ͱ͋ͬͨɻ

    - ͜ͷࠩ͸ɺ8PSE/FUͷྫจΛ࣋ͭޠ͕ٛۉ౳ʹ෼෍͍ͯ͠ͳ͍͜ͱʹىҼ͍ͯ͠Δɻ ʢ্Ґޠ͸ྫจΛ͍࣋ͬͯ΍͍͢ʣ 6 Hop数
  7. - ϗοϓ਺͕গͳ͍৔߹ʢʣ͸ɺϗοϓ਺͕ଟ͍৔߹ʢʣΑΓ΋ߴ͍ਫ਼౓Ͱ*4"ؔ ܎Λ༧ଌͰ͖Δ - ϗοϓ਺͕૿Ճͯ͠΋༧ଌਫ਼౓͸େ͖͘௿Լͤͣɺϗοϓ಺Ͱਫ਼౓ʹେ͖ͳ͹Β͖ͭ ͸ͳ͍ɻ 7 実験結果 ?

  8. - #&35͕ʢ"ɺ#ʣɺʢ#ɺ$ʣΛਖ਼͘͠༧ଌͨ͠৔߹ʹɺ*4"ؔ܎ʢ"ɺ$ʣΛਖ਼͘͠༧ଌ ͢Δස౓Λଌఆ - Q "# ͸૊ͷ " # ͷ͏ͪɺਖ਼͘͠༧ଌ͞Εͨ

    " # ͷׂ߹ - Q "$c"# #$ ͸ɺ " # ͱ # $ ͕ਖ਼͘͠༧ଌ͞ΕΔ৔߹ɺ " $ ͕ਖ਼͘͠༧ଌ͞ΕΔׂ߹ - "JTB$͕ৗʹਖ਼͘͠༧ଌ͞Εͳ͍͜ͱ͸ɺ#&35͕࿦ཧతʹҰ؏ͨ͠༧ଌΛ͢ΔೳྗΛ ͍͍ܽͯΔ͜ͱΛ͍ࣔࠦͯ͠Δɻ 8 Prediction Ability for Transitivity