Share
Embed
[2026前期火5] 論理学(京都大学文学部 前期 第14回)「計算は、証明ではない——ハルシネーションを三層ハーモニーで診る」
科学哲学科学史 (演習) 前期 第14回 論理学 (京都大学文学部・矢田部俊介)
「計算は、証明ではない——ハルシネーションを三層ハーモニーで診る」
2026年7月21日(火)1645〜1815(予定)
前期の総まとめ(最終回)。LLM は文章を「一語ずつ・確率で」作る=分布意味論(意味の全体論の一バリエーション)で意味を「近似」しています。近似であって本物(証明の資格ある意味)ではないので、必ず「差分」が出る——それがハルシネーションです。この差分を、前期に完成した三層ハーモニー(局所=詰まらない/中間=止まる・全域性/大域=積み上がる・保存拡大)で診断し、対策も同じ枠で読み替えます。オチは「LLM の中にシステム2的な仮想計算機を=それが論理」。
Shunsuke Yatabe
July 19, 2026
Transcript
59 slides
-
ՊֶֶՊֶ࢙ (ԋश) લظ ୈ 14 ճʢ࠷ऴճʣ ཧֶ ͬͯɺࢭ·ͬͯɺੵΈ্͕Δͦͯ͠ LLM
ʢϋϧγωʔγϣϯΛࡾϋʔϞχʔͰஅ͢Δɾલظ૯ׅʣ 2026 7 ݄ 21 ʢՐʣ16:45–18:15 จֶ෦ୈ 4 ߨٛࣨ ୲ɿా෦ढ़հʢຊཱྀ٬మಓגࣜձࣾʣ [email protected] -
ࠓͷओɿLLM จষΛʮҰޠͣͭʯ࡞Δ େنݴޠϞσϧʢLLMʣͱ ChatGPT ͳͲͷதʹେྔͷςΩετͰ܇࿅ͨ͠ڊେͳχϡʔϥϧωοτϫʔΫɻ ͍ͬͯΔ͜ͱɺೖྗʢϓϩϯϓτʣʹଓ͘จষΛҰޠͣͭ࡞Δ͜ͱɻ ੜͷϧʔϓʢࣗݾճؼʣ ʦೖྗจʧ → Ϟσϧ͕࣍ͷޠΛ༧ଌ
→ ҰޠΛબΜͰඌʹ͢ → ͦΕΛ৽͍͠ೖྗʹͯ͠·ͨ࣍ͷޠ. . . ΛɺࢭΊͲ͖·Ͱ܁Γฦ͢ɻ ʹʮจશମΛ·Δ͝ͱߟ͑ΔʯͷͰͳ͘ɺ࣍ͷҰޠͷ࿈ͱͯ͠จষ͕Ͱ͖Δɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 4 -
࣍ͷҰޠɺͲ͏બΕΔ͔ɿ֬ͰબͿʢsoftmaxʣ ީิͷޠʹʮ֬ʯΛৼΔ ϞσϧɺޠኮͷશީิʹͦΕͧΕΛ͚ͭΔɻ ͦͷΛ߹ܭ 1 ͷ֬ʹม͢Δʢ͜ͷมஔ͕ softmaxɻ໊લ֮͑ͳͯ͘ Α͍ʣ ɻ ͦͷ֬ʹैͬͯҰޠΛબͿʢߴ֬ͷޠ΄ͲબΕ͍͢ʣ
ɻ ྫɿ࣍ͷҰޠ ʮژຊͷ ? ʯ ⇒ ݹʢ0.4ʣʗࢢʢ0.2ʣʗटʢ0.1ʣʗ. . . Ͳͷީิʹඞͣਖ਼ͷ͕֬͘ʹϞσϧඞͣ࣍ͷޠΛग़ͤΔʢ͜ͷؚҙޙͰޮ͘ʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 5 -
Ͳ͏ֶशͨ͠ͷ͔ɿ ʮͬͱΒ͍͠ଓ͖ʯΛ֮͑Δ ࣄલֶश ʹ ͻͨ͢Βʮ࣍ͷޠͯʯͷ࿅श େͳςΩετͰʮ࣍ͷޠͯʯΛ܁Γฦ͠ɺͨΔ֬ʢʣ্͕͕ΔΑ͏ʹ෦ͷ Λඍௐ͢Δʢʹ࠷ਪఆʣ ɻֶͿͷͬͱΒ͍͠ଓ͖ͷύλʔϯɻ ࣄޙֶशʢRLHFʣʹ ਓؒΈʹ͑Δ
͞ΒʹਓؒͷධՁͰඍௐ͠ɺʹཱͭɾஸೡͳԠʹدͤΔɻ ཁ͢Δʹ LLM ʮͬͱΒ͍͠ଓ͖Λ࡞ΔʯܭࢉΛ͍ͯ͠Δɻ Ͱɺ͜ͷʮ࣍ͷޠΛͯΔʯΈɺ ҙຯΛͲ͏ѻ͍ͬͯΔͷ͔ʁ ɹ࣍ʹɺͦΕΛݟΔɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 6 -
ҙຯҙຯΛʮΘΕํʯͰଊ͑Δʢ༻આʣ ҙຯͷ༻આɿҙຯͱʮ͍ํʯ ʮޠͷҙຯͱɺݴޠʹ͓͚Δͦͷ༻Ͱ͋Δʯ ʢΟτήϯγϡλΠϯʰֶ୳ڀʱ§43ʣ ɻ ҙຯɺ͜ΕΛʮͲΜͳޠͱҰॹʹݱΕΔ͔ʢڞىͷʣ ʯͱͯ͠ૢ࡞Խ͢Δɻ Ծઆʢdistributional hypothesisʣ ϑΝʔεʮޠɺͦͷ͖ͭ͋͏ؒͰ͔Δʯ[Firth
1957] ʗϋϦεʮߏʯ[Harris 1954]ɻ ࣅͨจ຺ͰΘΕΔޠɺࣅͨҙຯʹΘΕํ͕ҙຯΛܾΊΔɻ ʹҙຯΛʮࣄ࣮ͱͷରԠʯͰͳ͘ʮݴޠͷΘΕํʯͰଊ͑Δཱɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 8 -
औࡐରʮΣϒنͷίʔύεʯ͔ͩΒԿΛֶͿ͔ LLM ͕ݟΔʮʯɺԿͷ͔ LLM ֶ͕ͿʮΘΕํʯɺਓ͕ؒॻ͍ͨେྔςΩετʢΣϒɾॻ੶ɾهࣄʹίʔύ εʣͰͷڞىɻޠΛͦͷ͔ΒϕΫτϧʹࣸ͢ʹ୯ޠຒΊࠐΈʢword2vecʣ[Mikolov et al. 2013]ɻ ͔ͩΒ
LLM ͕ଊ͑ΔͷʮͬͱΒ͠͞ʯ ͕ڭ͑Δͷʮͦͷޠͷ·ΘΓʹԿ͕དྷ͍͔͢ʯʹίʔύεͰͷͬͱΒ͠͞ɻ ੈքͷࣄ࣮Ͱূ໌Ͱͳ͘ɺΘΕํͷ౷ܭɻ ʹ LLM ҙຯΛʪίʔύε্ͷʫͰۙࣅ͍ͯ͠Δʢʹڊେͳҙຯʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 9 -
ࢠʮશମͷܾఆՄೳͳஅยʯ͍͍ͱ͜ͲΓ ڞ௨ͷ൫ɿҙຯʮ͍ํʢਪͰͷׂʣ ʯͰܾ·Δ ҙຯࢠɺҙຯʹ͍ํͱ͍͏ʮ༻આʯͷҰछɻ͔ΕʮͲ͜·Ͱͷ ͍ํΛݟΔ͔ʯɻ શମʢݴޠશମʣ ࢠ ʹܾఆՄೳͳஅย શମɿ͍ํʹݴޠશମͰͷׂ ˠ
ܾఆෆೳɾݟͤͳ͍ɾֶͳ͍ɻ ࢠɿ͍ํΛݟͤΔɾܾఆՄೳͳஅยʹݶΔ ˠ ҙຯʹ͍ํ ͷॴͦͷ··ɺܾఆՄೳɾֶशՄೳɾ߹ తɻ ͍͍ͱ͜ͲΓɿࡾϋʔϞχʔ͕ʮஅยʯΛΓग़͢ ࢠʹશମͷܾఆՄೳͳϑϥάϝϯτɻࡾʢ٧·Βͳ͍ɾࢭ·ΔɾੵΈ্͕ΔʣɺͦͷஅยΛΓ ग़ܾ͢ఆՄೳੑͷ݅ɻ LLM શମͷ͝ͱۙࣅ͠ɺஅยʹऩΊΔอূ͕ͳ͍ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 10 -
Կ͕ʮࢠʯͳͷ͔μϝοτΛҾ͖ͳ͕Βʢূ໌ਤͰʣ μϝοτͷࢠઆ จͷҙຯΛཧղ͢ΔͷʹཁΔͷɺͦͷߏ෦ͷҙຯͱΈཱͯํ͚ͩ ݴޠશମΛ Δඞཁͳ͍ [Dummett 1973/1991]ɻʹࢠͱɺҰͭͷޠͷҙຯΛࣗݾ݁తʹܾΊ Δنଇͷଋʢಋೖʴআڈʣ ɻ ʮࢠʯͷ࣮ྫɿ
ʮ→ʢͳΒʣ ʯʹೋͭͷنଇ ಋೖʢ࡞Δʣ [A] . . . . B A → B →I A ΛԾఆͯ͠ B ͕ग़Ε A → B আڈʢ͏ʣ A → B A B →E A → B ͱ A ͔Β Bʢmodus ponensʣ సݪཧɿআڈͰऔΓग़ͤΔͷಋೖͰೖΕͨͷͪΐ͏Ͳʹ͜ͷ 2 نଇ͚ͩͰด͡Δʹࢠɻ ͔ͩΒࠜڌ෦ʢنଇʣͱͯ͠औΓग़ͤΔʢҙຯʹɺ͜ͷݟͤΔଋ͕ͳ͍ʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 11 -
ΧϊχΧϧϑΥʔϜɿA ∧ B A, B ͚ͩͰΓΔ ҙຯʮඪ४తͳ࡞ΓํʹಋೖنଇʯͰ༩͑Δ [Dummett 1991
ʗ Prawitz] ʮA ∧ BʯͷΧϊχΧϧͳূ໌ʹ A ͷূ໌ͱ B ͷূ໌Λʹͨ͠ͷɿ A B A ∧ B ∧I ⇝ a, b (a:A, b:B) ۩ମྫɿӍ ∧ ෩ ʮӍ͕͍߱ͬͯΔ ∧ ෩͕ਧ͍͍ͯΔʯͷඪ४తͳূ໌ʹʪӍͷূڌ, ෩ͷূڌʫ ɻ ͔֬ΊΔͷʹཁΔͷʮӍʯͱʮ෩ʯͷҙຯ͚ͩ ݴޠશମཁΒͳ͍ɻ ਖ਼نԽʹͲΜͳճΓಓɺ͜ͷʮʯʹΔʢୈ 12ɾ13 ճʣ ԕճΓͨ͠ূ໌Ͱɺਖ਼نܗʢΧϊχΧϧϑΥʔϜʣʹͤ a, b ʹΔʹ݁ہ A ͱ B ͔͑͞ΕΑ ͍ʢݟͤΔɾܾఆͰ͖Δʹࢠʣ ɻLLM ʹɺ͜ͷʮʹ͢ඪ४ܗʯ͕ͳ͍ʢʹ࣍ͷࠩʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 12 -
ۙࣅ͔ͩΒɺ͕ࠩग़ΔͦΕ͕ϋϧγωʔγϣϯ ۙࣅ ʺ ຊ LLM શମͷ͝ͱۙࣅ͢ΔʹܾఆՄೳͳஅยʢࢠʣʹऩΊΔอূ͕ͳ͍ɻ͔ͩΒ ຊʢূ໌ͷࢿ֨͋Δҙຯʣͱͷؒʹɺஅย͔ΒΈग़͢ʮࠩʯ͕ඞͣΔɻ ͜ͷʮࠩʯ͕ͦ͜ɺϋϧγωʔγϣϯ ʮݬ֮ʯͰͳ͘ɺʪۙࣅʫͱʪຊʫͷζϨɻ ͰࠩͲ͏ݱΕΔ͔ʁલظʹͨ͠
ࡾͭͷϋʔϞχʔʢہॴɾதؒɾେҬʣ͕ɺ ࠩΛྨ͢Δࠩ͠ʹͳΔɻ ʢ࣍અʣ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 13 -
લظͷ౸ୡɿࡾϋʔϞχʔ × ܭࢉʢͨ͠ਤʣ ୈ 10–13 ճͰͨ͠ʮྑ͍ূ໌ʹྑ͍ݴޠʯͷ݅ ࡾ ূ໌ ܭࢉ ہॴ
సݪཧ ٧·Βͳ͍ʢਐߦੑʣ ✓ தؒ ਖ਼نԽ ࢭ·Δʢఀࢭੑ ʹ શҬੑʣ ✓ େҬ อଘ֦େ ϞδϡϥϦςΟʢੵΈ্͕Δʣ ✓ ͬͯʢ٧·Βͳ͍ʣ ɺࢭ·ͬͯʢࢭ·Δʣ ɺͦͯ͠ੵΈ্͕ΔʢϞδϡϥϦ ςΟʣ ܕʢʹ໋ʣ͕ࡾΛ؏͍ͯอূ͢Δ ʹ ܕ҆શੑɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 15 -
෮शɿࡾ ʹ ༗ݶੑͷࡾͭͷإʢࠓͷஅදͷݩʣ ༗ݶੑͷإ ҙຯ ہॴ ҙຯͷ୯Ґͷ༗ݶੑ ҰͭҰͭͷ݁߹ࢠʹ༗ݶͷ෦ʢࢠʣ தؒ
ܾఆϓϩηεͷ༗ݶੑ ҙຯΛ֬ఆ͢Δܭࢉ͕ࢭ·ΔʢશҬੑʣ େҬ վగٴͷ༗ݶੑ ૿ஙͯ͠طଘͷؒऔΓมΘΒͳ͍ʢอଘ֦େʣ ࠓͷ෬ઢ ͜ͷࡾͭͷإΛɺͦͷ·· LLM ʹͯΔͷ͕ࠓɻ ࡾͭͷإͷཪฦ͕͠ɺϋϧγωʔγϣϯͷஅදʹͳΔɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 16 -
ࠓͷܭըɿࠩΛɺࡾͷࠩ͠Ͱྨ͢Δ ۙࣅ͕ੜΉʮࠩʯΛɺલظͷࡾͰΔ ࠩʢʹϋϧγωʔγϣϯʣ͕ہॴɾதؒɾେҬͷͲ͜ʹݱΕΔ͔ΛɺҰຕͣͭྨɾ அ͢Δɻ େҬɿอଘ֦େ ʹ ϞδϡϥϦςΟ ૿ஙͯ͠طଘෆมʹੵΈ্͕ΔʢഁΕʹരൃɾ tonkʣ தؒɿਖ਼نԽ
ʹ ࢭ·Δ શҬੑʢࢭ·ͬͯূ໌ͷࢿ֨͋ΔΛฦ͢ʣ ہॴɿసݪཧ ʹ ٧·Βͳ͍ progressʢࠜڌʹ݁ͼ͖ͭ؆ઌ͕ඞͣ͋Δʣ ࡾʮຊͷҙຯʯ͕ຬͨ͢ࡾͭͷ ݅ɻۙࣅͲΕΛ֎͔͢ɻ ͦͯ͠ॲํΛɺಉ͡ࡾͰಡΈସ͑Δɻ લظͷ૯·ͱΊɿ ʮܭࢉ͍ͯ͠Δʯ͜ͱ ʮূ໌͍ͯ͠Δʯ͜ͱΛؚҙ͠ͳ͍ɻ ͜ΕΛࠓ ূ໌͢Δɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 17 -
ہॴͷཁٻɿओுࠜڌʹ݁ͼͭ͘ʢࢠʣ എࠎͷ͍·͜͜ɿࡾͷʪہॴʫΛ LLM ʹͯΔ ہॴϋʔϞχʔʢ෮शʣ ہॴʹ٧·Βͳ͍ʢprogressʣʹసݪཧɿ݁߹ࢠͷҙຯಋೖʹআڈͷௐͰܾ ·Δɻ ͔ͩΒʮA Λओு͢Δʯ͜ͱʮA ͷࠜڌʢূ໌ʹ߲ʣΛ࣋ͭʯ͜ͱͱ݁ͼͭ͘ɻ
ҙຯ༗ݶͷ෦͔ΒΈ্͕Δ͔ͩΒࠜڌ෦ʹղͰ͖Δʢʹ §2 Ͱݟͨ ҙຯͷࢠߏɾμϝοτʣ ɻ ͍ɿLLM ͷʮ࣍ͷޠΛग़͢ʯɺ͜ͷࠜڌʹ݁ͼ͍ͭͨલਐ͔ʁ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 19 -
LLM ͷഁΕɿ٧·Βͳ͞ͷʮِʯ softmax ɺ͍ͭͰ࣍ͷޠΛग़ͤͯ͠·͏ʢː 1 ͷΈʣ ː 1 Ͱݟͨͱ͓ΓɺLLM ֤εςοϓͰඞͣ࣍ͷޠΛબͿʢΕͳ͍ʣ
ɻ ʹҰݟʮ٧·Βͳ͍ʯɻߦ͖ࢭ·Γ͕ܾͯ͠ͳ͍ɻ ͕ͩɺͦΕసݪཧʹࢧ͑ΒΕ͍ͯͳ͍ ཧͷʮ٧·Βͳ͍ʯࠜڌʢ؆نଇʣ͕͋Δ͔ΒਐΊΔɻ LLM ͷʮ٧·Βͳ͍ʯࠜڌ͕ͳͯ͘ਐΊΔʹࠜڌͳ͖લਐɻ ιʔεࢀরဃʢsource-reference divergenceʣʹओு͕ιʔεʹࠜڌʹґڌ͠ͳ͍ɻ [Ji et al. 2023, ACM Comput. Surv.ɿهจͷ 62%͕ιʔεඇґڌใΛؚΉʢWIKIBIOʣ] ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 20 -
ࠜڌΛऔΓग़ͤͳ͍ཧ༝ɿҙຯͷࢠߏ͕ͳ͍ LLM ͷҙຯʮ෦ʯʹ͔Ε͍ͯͳ͍ §2 Ͱݟͨͱ͓Γɺཧͷࠜڌ෦ʢنଇʣͱͯ͠औΓग़ͤΔʢࢠߏ͕͋Δʣ ɻ ͕ͩ LLM ͷҙຯࢄදݱʹશମతޠͷҙຯ͕ͷશମʹ༹͚͍ͯͯɺ ෦
ʹ͔Ε͍ͯͳ͍ɻ ͔ͩΒʮ͜ͷओுͷࠜڌʯΛ෦ͱͯ͠औΓग़ͤͳ͍ʹࢠߏ͕ͳ͍ɻ ͦͦࠜڌ͕ଘࡏ͠ͳ͍߹͢Β͋Δ ֶशσʔλʹҰ͔͠ݱΕͳ͍ࣄ࣮ʢsingleton ʗ arbitrary factsʣɺࠜڌ͕౷ܭతʹཱ֬ ͠ͳ͍ɻ[Kalai & Vempala 2024, STOC] ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 21 -
தؒͷཁٻɿࢭ·ͬͯɺূ໌ͷࢿ֨͋ΔΛฦ͢ എࠎͷ͍·͜͜ɿࡾͷʪதؒʫΛͯΔ͕͜͜ࠓͷ৺ଁ தؒϋʔϞχʔʢ෮शɾୈ 12–13 ճʣ தؒʹࢭ·Δʢਖ਼نԽʣʹશҬੑʢtotalʣ ɻ શҬੑͱʮඞͣ͑Δʯ͜ͱͰͳ͍ɻ ࢭ·ͬͯɺূ໌ͷࢿ֨͋ΔΛฦ͢͜ͱʢBHKʣ ɻ
ࢭ·Βͳ͍ܭࢉʢΩɾρʣূ໌ͷࢿ֨Λ࣋ͨͳ͍ɻ ͍ɿLLM ͷग़ྗʮࢭ·ͬͯূ໌Λฦ͢ʯͷ͔ɺ ʮࠩ͠ग़ͨ͠;Γʯ͔ʁ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 24 -
LLM ͷഁΕɿࠩ͠ग़ͨ͠;Γʢଋखܗͷෆཤߦʣ ཧɿࢭ·߲ͬͯΛฦ͢ [x : A] . . . .
M : B λx.M : A → B →I λx.M ʹূ໌ͷࢿ֨͋Δ߲ɻ ܕʢ໋ʣʹ߲͕͍ͬͯΔɻ LLMɿओுΛࢭΊͯฦ͕͢. . . ʮA → B ͕ΓཱͭʯͱจࣈྻΛฦ͢ɻ ͕ͩɺͦΕΛࢧ͑Δ߲ʢূ໌ʣΛ࣋ͨͳ͍ɻ ʹܕ͚ͩݴͬͯɺ߲͕ͳ͍ɻ ࢭ·͍ͬͯΔɻ͕ͩࠩ͠ग़ͨ͠ͷʮূ໌ʯͰͳ͘ʮূ໌ͷ;Γʯ ʹӬԕʹཤߦ͞Εͳ͍ଋखܗʢୈ 13 ճඌͷޠኮʣ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 25 -
Ͱ LLM Ͳ͏ʮࢭ·Δʯͷ͔ਖ਼نԽͰͳ͘ଧͪΓ ͍ɿ͑ʹਖ਼نܗʹʮ౸ୡ͔ͨ͠Βʯࢭ·Δͷ͔ʁ ূ໌ͷਖ਼نԽࡏతʹࢭ·Δʢܕ͕͋Εਖ਼نԽఆཧɾୈ 12 ճʣ ɻLLM ҧ͏ࢭ ·Δͷɺ֎͔Β՝͞ΕͨଧͪΓͷɻ
1. ༧ࢉɿ࠷େτʔΫϯɾਪτʔΫϯɾ࣌ؒɾܭࢉྔɻ ਚ͖ͨΒଧͪΓɻ 2. ֶशͨ͠ EOS ɿ͘ͳΔͱʮ·ͱΊͯ݁Λ ॻ͖ऴ͑ΔʯΛ౷ܭతʹֶशɻ 3. ෮ɾҟৗݕʢج൫ଆʣ ɿಉޠ෮ɾλΠϜΞτ ΛػցతʹଧͪΓʗ࠶ࢼߦɻ ӡ༻ʢٖࣅίʔυʣ while not finished: think() if budget exhausted: print best answer() ʹͲΕਖ਼نԽఆཧͷࡏతอূͰͳ͘֎ࡏతͳଧͪΓɻҙຯΛཧղͨ͠ಜऀͰͳ͍ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 26 -
֩৺ɿਪͷਖ਼نԽͱɺग़ྗͷਖ਼نԽʮʯ͍ͯ͠Δ ূ໌ɿਪͦͷͷ͕ਖ਼نԽ ԕճΓΛফͬͯ͠ਖ਼نܗʹଥͳূ໌ʹࢸΔɻࡏ తʹอূʢਖ਼نԽఆཧɾୈ 12 ճʣ ɻ LLMɿग़ྗʢจষʣ͚ͩਖ਼نԽ ෦ਪਖ਼نԽ͠ͳ͍͜ͱ͕͋ΔʢԕճΓ͕૿͑ Δɾಉ͡มܗΛ෮ɾ୳ࡧࢬ͕໎ʣ
ɻ͕ͩʮͨ͠ ͕ͬͯʯͰจষΛด͡ΔͷֶशࡁΈͷߦಈɻ LLM ূ໌Λਖ਼نԽͰ͖ͳͯ͘ɺ ূ໌ʮΒ͍͠จॻʯΛਖ਼نԽͯ͠ग़ͤΔ ୳ࡧঢ়ଶ S −→ quote(S)ʢͬͱΒ͍͠֎෦දݱʣ ਖ਼͍͠ূ໌ͷਖ਼نܗͱݶΒͳ͍ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 27 -
ਖ਼نԽ vs LLMͦͯ͠ʮ٧·ͬͨͱ͖΄Ͳಊʑʯ ূ໌ʢਖ਼نԽʣ LLM ؐݩྻ͕ਖ਼نܗ౸ୡ ୳ࡧɾੜ͕͑౸ୡ ڧਖ਼نԽʹͲͷॱংͰඞͣਖ਼ن ܗʢܕ͕อূʣ ͦͷࡏతอূͳ͍ʢ༧ࢉʹΑΔ֎ࡏతͳଧͪΓͷΈʣ
ਖ਼نܗʹଥͳূ໌ ʢূ໌ͷࢿ֨ʣ ʮ݁Β͍͠จষʯʹਖ਼نܗͱݶΒͳ͍ ൃࢄ͢Δؐݩྻ ෮ɾಊʑ८Γɾ୳ࡧࢬͷ໎ ͔ͩΒʮ٧·ͬͨͱ͖΄Ͳɺ࠷ޙ͚ͩಊʑͱͨ͠ޡʯ ෦୳ࡧ͕ະͰճϑΣʔζҠΔʢreasoning ܥ୳ࡧͱճ͕ผϑΣʔζʣ ɻʹʮ෦Ͱղܾͨ͠ʯͱ ʮճʹҠͬͨʯผɻ࠷ޙ୳ࡧ͔Β࡞จͷඇৗޱΛ͏ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 28 -
அᶄͷݟऔΓਤɿ ʮࢭ·Δʯ ɾ͕ɾ ʮূ໌Ͱͳ͍ʯ தؒͷഁΕɺೋޠͰͰ͖͍ͯΔ அᶄʹʮࢭ·Δʯ ɾ͕ɾ ʮূ໌Ͱͳ͍ʯɻ͜ͷೋޠΛɺ͜͜·Ͱͱ͔͜͜ΒͰผʑʹݟΔɻ ͜͜·Ͱʹʮࢭ·ΔʯͲ͏ى͖͔ͨ ʢN1–N3ʣ
ਖ਼نԽͰͳ͘֎͔ΒͷଧͪΓʴग़ྗ͚ͩͷਖ਼ن Խʹ͍ͭͰʮͬͱΒ͘͠ด͡Δʯ ʢquote(S)ʣ ɻ ͔͜͜Βʹʮূ໌Ͱͳ͍ʯͳ͔ͥ ࢭΊͯࠩ͠ग़ͨ͑͠ɺͳͥਖ਼͍͠ͱݶΒͣɾ֎Ε ͕ආ͚ΒΕͳ͍ͷ͔ɻࣝผͱੜ → Kalai ͷԼք → ධՁ͕غݖΛേ͢Δ → ઇͩΔ·ɻ ܧ͗ɿ ʮͬͱΒ͘͠ด͡Δʯ͜ͱʮਖ਼͍͠ʯ͜ͱΛอূ͠ͳ͍ʢഎࠎʹۙࣅͷࠩʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 29 -
ʮࣝผʯͱʮੜʯͳͥੜͷ΄͏͕͍͔͠ എࠎͷ͍·͜͜ɿ࣍εϥΠυͷෆࣜΛಡΉͨΊͷݴ༿Λઌʹ༻ҙ͢Δ ೋͭͷ՝Λ۠ผ͢Δ ࣝผʢIs-It-Validʣ ɿࠩ͠ग़͞Εͨจʮ͜Εਖ਼͍͠ʯΛ Yes/No Ͱఆ͢Δɻ ੜɿਖ਼͍͠จΛࣗͰ࡞ͬͯࠩ͠ग़͢ɻ ྫɿ͋Δਓͷੜ ࣝผɿ
ʮੜ 3/4 ͩʯͱݴΘΕͯɺਖ਼͍͔͠ఆ͢Δɻ ੜɿੜΛࣗͰͯͯݴ͏ɻ ֶशσʔλʹҰ͔͠ग़ͳ͍ࣄ࣮ʢsingletonʣͳΒɺਖ਼͍͠Λِ͔Βݟ͚ΒΕͳ͍ʹࣝผʹࣦഊ ͢Δɻ·ͯࣗ͠ͰͯΔੜͬͱແཧɻ ԡ͑͞ΔҰɿੜͰ͖Δ ⇒ ࣝผͰ͖Δʢ࡞ΕΔͳΒྑ͠ѱ͔͠Δͣʣ ɻ ରۮɿࣝผͰ͖ͳ͍ ⇒ ੜͰ͖ͳ͍ɻੜͷࣝ͠͞ผͷ͠͞ʹԼ͔ΒറΒΕΔɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 30 -
ͳͥආ͚ΒΕͳ͍͔ɿݬ֮ ʹ ೋྨͷޡΓ ੜͷޡΓɺࣝผͷޡΓʹ༁Ͱ͖Δ લεϥΠυͷʮੜ ⇒ ࣝผʯΛఆྔԽ͢Δͱʢ[Kalai, Nachum, Vempala, Zhang
2025, Nature/OpenAI]ʣ ɿ ʢੜͷޡΓʣ ≳ 2×ʢࣝผͷޡΓʣ ಡΈํɿ≳ ʮগͳ͘ͱ͓͓Αͦʯ ɻੜͷޡΓࣝผͷޡΓͷ 2 ഒΛԼճΕͳ͍ɻ͔ͩΒࣝผ͕ຊ࣭ తʹ͍͠ʢʹ arbitrary factsʣͱɺੜͷޡΓඞͣҾ͖ͣΒΕͯग़Δɻ ͳͥʮ2 ഒʯ͔ʗσʔλ͕ޡΓθϩͰ Is-It-Valid ʮຊͷਖ਼͍͠จʯͱʮͬͱΒِ͍͠ʯΛʑʹࠞͥͨೋɻੜͷޡΓʹ͜ͷೋ ͷऔΓҧ͑ʹ༁͞Εɺߏ্΄΅ 2 ഒͰޮ͘ɻ ʹͨͱֶ͑शσʔλ͕શʹਖ਼ͯ͘͠ɺ࠷খԽ͢Δతؔͦͷͷ͕ޡΓΛੜΉɻ ʹʮࠩ͠ग़ͨ͠;ΓʯઃܭϛεͰͳ͘ɺͬͱΒ͠͞Λ࠷దԽͨ݁͠Ռɻ ˞Լք͕ޮ͘ͷ arbitrary factsʢਅֶِ͕शσʔλ͔Βܾ·Βͳ͍ࣄ࣮ʣ ɻମܥతࣄ࣮ɾݕࡧซ༻Ͱผɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 31 -
શҬੑͷഊɿධՁ͕ʮΘ͔Βͳ͍ʯΛേ͢Δ ࠷ਪఆʮͬͱΒ͠͞ʯΛ࠷దԽ͢Δʢː 1 ͷֶशͷؼ݁ʣ ː 1 Ͱݟͨͱ͓Γֶश্͕͛ΔͷʹͬͱΒ͠͞Ͱɺࣄ࣮తෆ߹Λേ͠ͳ͍ɻ [Ji et al.
2023] ࠷దԽ͞ΕΔͷਅཧੑͰͳͬ͘ͱΒ͠͞ɻ 0-1 ࠾͕ɺͯͣͬΆ͏Λ࠷దղʹ͢Δ େͷϕϯνϚʔΫਖ਼ޡೋͰɺغݖʢ ʮΘ͔Βͳ͍ʯ ʣʹಘΛ༩͑ͳ͍ɻˠ IDK Α ΓͯͣͬΆ͏͕࠷దɻ[Kalai et al. 2025] ʹʮඞͣ͑ΔʯِͷશҬੑʹڲਖ਼͞ΕΔʢغݖΛേ͢Δ epidemicʣ ɻ શҬੑͷຊٛʮ͑ΔͳΒূ໌Λ͏ʯ ɻLLM ʮͱʹ͔͑͘ΔʯʹତͪΔɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 32 -
ࢭ·ͬͯਖ਼نܗͰͳ͍ɿઇͩΔ·ࣜͷޡΓ Hallucination Snowballing [Zhang et al. 2023, ACL] ࣗݾճؼσίʔσΟϯάࠨˠӈͷ֬ఆΛఫճͰ͖ͳ͍ɻॳظͷ 1
ޡτʔΫϯ͕Ҏ߱શମ ͷೖྗͱͳΓɺҰ؏ੑҡ࣋ͷͨΊޡΓΛੵΉɻ ୯ಠͳΒݟൈ͚ΔͷʹɺྲྀΕͷதͰॏͶΔ GPT-4 ޡओுΛ୯ಠఏࣔͳΒ 87%ݟൈ͚Δͷʹɺલͷࣗͷग़ྗͱͷ߹Λ༏ઌ͠ ͯޡΓΛॏͶΔɻ ʹܭࢉࢭ·Δ͕ɺͦΕਖ਼نԽʢ͑ͯূ໌ʹ͢ΔܭࢉʣͰͳ͘ɻ ୈ 12 ճͷ Ωʢࢭ·Βͳ͍߲ʣͷྡʹ͋Δঢ়ɿࢭ·͕ͬͨਖ਼نܗͰͳ͍߲ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 33 -
͏Ұஈɿ ʮͬͱΒ͠͞ʯɺਅཧʹಧ͔ͳ͍ ֶश͕࠷దԽ͢ΔͷʮʯͰ͋ͬͯʮਅཧʯͰͳ͍ ࣄલֶशਓؒͷςΩετͷΛ࠶ݱ͢Δ͜ͱʢʹີਪఆʣ ɻ ඪʮਓ͕ؒॻ͖ͦ͏ͳจʯͰ͋ͬͯɺ ʮਖ਼͍͠จʯͰͳ͍ɻ ͔ͩΒʮੈؒͷΑ͋͘Δޡղʯ࣮ʹ࠶ݱ͢Δ ͬͱΒ͍͠ޡΓʢimitative falsehoodʣ·ͰਅࣅΔɻ
ͦΕΛଌΔͷ͕ TruthfulQA [Lin et al. 2022]ਓؒͷࢥ͍ࠐΈΛͲΕ͚ͩ฿͢Δ͔ɻ ई͕ҧ͏ɿશମతͳʮͬͱΒ͠͞ʯ vs ࢠతͳʮূ໌ʯ ͬͱΒ͠͞ʹίʔύεશମͷద߹ʢશମతʣʗূ໌ͷࢿ֨ʹ෦͔ΒہॴنଇͰΊΔʢࢠతʣ ɻ ผͷ͔ࠩͩ͠ΒɺͬͱΒ͠͞Λ͍͘Β্͛ͯূ໌ʹಧ͔ͳ͍ɻଛࣦθϩͷʮᘳͳʯ LM Ͱ ݬ֮ফ͑ͳ͍ʢୈ 2 ճʮS1 ʹͬͱΒ͠͞ͷ฿ʯͷਖ਼ମʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 34 -
େҬͷཁٻɿ૿ஙͯ͠طଘ͕յΕͳ͍ʢੵΈ্͕Δʣ എࠎͷ͍·͜͜ɿࡾͷʪେҬʫΛͯΔ େҬϋʔϞχʔʢ෮शɾୈ 13 ճː 3ɾୈ 2 ճԾܭࢉػʣ େҬʹอଘ֦େʹϞδϡϥϦςΟɿ৽͍݁͠߹ࢠΛͯ͠طଘͷਪෆมɻ ͔ͩΒଞਓͷิΛ҆৺ͯ͠आΓΒΕɺ͕ࣝੈΛ͑ͯੵΈ্͕Δɻ
ഁΕʹരൃʢtonkɾୈ 11 ճʣʹ૿ங͕طଘΛԚછ͢Δɻ ͍ɿLLM ʮֶͿͨͼʹյΕͣʹੵΈ্͕Δʯͷ͔ʁ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 36 -
LLM ͷഁΕɿ࠶ֶशͰطଘ͕յΕʮ͏Δʯ ʢഁ໓త٫ʣ ഁ໓త٫ʢcatastrophic forgettingʣͱ χϡʔϥϧωοτΛ৽͍͠λεΫʹஞֶ࣍शͤ͞Δͱɺطशͷੑೳ͕ٸམ͠͏Δݱɻ ࢄදݱ͕ॏͳΓ߹͏ͨΊʹى͖Δʢ҆ఆੑʖՄ઼ੑͷδϨϯϚʣ ɻ จݙʢྫͱͯ͠ʣ ൃݟ
[McCloskey & Cohen 1989 ʗ Ratcliff 1990] ʗ૯આ [French 1999, TICS] ʗޯϕʔεͰ࣮ূ [Goodfellow et al. 2013]ɻ LLM ͰܧଓతϑΝΠϯνϡʔχϯάͰ؍ଌ [Luo et al. 2023, 1B–7B]ʢ͜ͷൣғͰنେ΄Ͳਂࠁʣ ɻ ʴैʢsycophancyʣ ऀɾલఏΛ૿ங͢Δͱ͕݁ಈ͘ʹඇอଘతɾෆ҆ఆ [Sharma et al. 2023, Anthropic]ɻͲͪΒʮ ͢ͱطଘ͕յΕΔʗಈ͘ʯํͷঢ়ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 37 -
ਖ਼͘͠ʮඞͣյΕΔʯͰͳ͘ʮյΕͳ͍อূ͕ͳ͍ʯ ٫ෆՄආͰͳ͍؇Ͱ͖Δ ͔ͭͯʮഁ໓త٫ෆՄආͱ͘৴͡ΒΕ͍ͯͨʯ͕ɺͦΕ෴ͬͨɻ[Kirkpatrick et al. 2017, PNAS] EWCʢॏཁͳॏΈͷֶशΛ͑Δʣ ɾϦϓϨΠɾύϥϝʔλִɾҰൠࢦࣔσʔλͷࠞ߹ ͳͲͰେ͖͘؇Ͱ͖Δɻ
͕ͩɺͲͷख๏ʮඇ٫ʯΛอূ͠ͳ͍ EWC ιϑτͳਖ਼ଇԽͰɺλεΫྻ͕͍ͱྼԽ͢Δ [Kemker et al. 2018]ɻޮՌنɾλ εΫͳͲͷ݅࣍ୈɻܧଓֶशͱɺ٫Λௐ͢ΔӦΈͰ͋ͬͯɺճආ͕ࣗಈอূ͞ ΕΔΈͰͳ͍ [De Lange 2021 ʗ Wang 2024]ɻ ཧอଘ֦େΛࡏతʹอূ͢Δʢ૿ஙͯ͠طଘյΕͳ͍ʣ ɻ LLM ࠶ֶशʹͦͷอূ͕ͳ͍͔ͩΒʮ ੵΈ্͕Δʯͱݴ͍Εͳ͍ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 38 -
அͷ·ͱΊɿࡾͭͷഁΕɺ͕ࠜҰͭ େҬͷഁΕɿੵΈ্͕Δอূ͕ͳ͍ ഁ໓త٫ʹ࠶ֶशͰطଘ͕յΕ͏Δ தؒͷഁΕɿࢭ·Δ͕ূ໌Ͱͳ͍ ࠩ͠ग़ͨ͠;Γʹଋखܗͷෆཤߦ ہॴͷഁΕɿసݪཧͳ͖લਐ ٧·Βͳ͞ͷِʹࠜڌͳ࣍͘ͷޠΛग़͢ ࠜͻͱͭɿҙຯͷࢠߏͷܽ ࢠ͕ͳ͍ͱ. .
. ʢہॴʣࠜڌʹ݁ͳ͍ ʢதؒʣΛݕূͰ͖ͳ͍ ʢେҬʣ෦Λͤͳ͍ ʹʮ༗ݶੑͷࡾͭͷإʯ ʢS3ʣͷ ͪΐ͏Ͳཪฦ͠ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 39 -
ہॴΛิڧɿओுΛࠜڌʹࢠʹ݁ͼ͚ͭΔ సݪཧΛʮ֎ʯ͢Δ RAG ʗݕࡧ֦ுɿ֎෦ιʔεʹओுΛ݁ͼ͚ͭΔʹιʔεࢀরဃΛຒΊΔɻ FActScore[Min et al. 2023]ɿओுΛ atomic fact
ʹׂ֤ͬͯʑݕূʹࢠʹղɻ ه߸తཪ͚ͮɾ֎෦πʔϧɾܗࣜݕূɿओுʹܕΛ͚ͭΔʢہॴʴதؒʣ ɻ ͍ͣΕʮࠜڌͳ͖લਐʯΛʮࠜڌʹ݁ͼ͍ͭͨલਐʯͦ͏ͱ͢ΔࢼΈɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 42 -
தؒΛิڧɿશҬੑΛਖ਼ʹ͢Δʢغݖʣ ཤߦͰ͖ͳ͍ଋखܗΛɺΒͳ͍ غݖʢabstentionʣ ɾ ʮΘ͔Βͳ͍ʯ܇࿅ɾෆ࣮֬ੑਪఆɿ Λฦͤͳ͍ͱ͖ฦ͞ͳ͍ʹʮূ໌ͷࢿ͕֨ͳ͍ͳΒࠩ͠ग़͞ͳ͍ʯ ʢBHKʣ ɻ ධՁվֵɿغݖʹಘΛ༩͑ΔʢKalai et
al. ͷॲํʣʹதؒͷཁٻΛධՁʹΈࠐΉɻ ࢭ·͕ͬͨຊ͔ɺ͔֬ΊΔ self-consistency ʗ SelfCheckGPT[Manakul et al. 2023]ɿෳੜͷҰ؏ੑͰࢿ֨Λۙ ࣅݕূɻ DoLa[Chuang et al. 2023]ɿࣄ࣮ੑํʹσίʔσΟϯάΛิਖ਼ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 43 -
େҬΛิڧʴϝλɿΛʮԼքͷޮ͔ͳ͍ྖҬʯҠ͢ ੵΈ্͕ΔΛճ෮͢Δ RAGʢ࠶ܝʣɿࣝΛ֎෦Խʹߋ৽͕طଘΛյ͞ͳ͍ʢඇഁյత૿ஙʣʹೋɻ ܧଓֶशɾ٫ରࡦʗπʔϧҕৡɿମܥతࣄ࣮ه߸ܥʹͤΔɻ ϝλɿෆՄආੑʮݶఆ͖ͭʯ͔ͩΒͦ͜ॲํ͕ޮ͘ ౷ܭతෆՄආੑͷԼք arbitrary facts ݶఆʢRAGɾࢉज़ʹඇద༻ʣ ɻ
ରࡦͱɺΛԼքͷޮ͔ͳ͍ྖҬҠ͢ʹࡾͷཁٻΛ֎ૠ͢ΔӦΈɻ ධՁث TruthfulQA[Lin et al. 2022]ɾHaluEval[Li et al. 2023]ɾFActScore ʹͲͷ͕ഁΕ͔ͨଌΔஅثɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 44 -
ࢀߟɿϋϧγωʔγϣϯͷඪ४తͳྨʢαʔϕΠΑΓʣ ֶքʮԿͱ৯͍ҧ͏͔ʯͰΔ ྨ࣠ʢදαʔϕΠʣ ԼҐܕ ࣄ࣮ੑʗ࣮ੑ [Huang et al. 2023/25] ࣄ࣮ੑʹໃ६ɾ፻ʗ࣮ੑʹࢦࣔɾจ຺ɾཧͷෆ߹
ࡏʗ֎ࡏ [Ji et al. 2023] ࡏʹιʔεͱໃ६ʗ֎ࡏʹιʔεͰݕূෆೳ ࡾ छ ͷ ি ಥ [Zhang 2023, Siren’s Song] ೖྗিಥʗจ຺িಥʗੈքࣝিಥ ຊतۀͷࡾɺ͜Εͱʮަʯ͢Δ ඪ४ྨʹԿͱ৯͍ҧ͏͔ɻຊतۀʹͲͷܭࢉత͕݅յΕ͔ͨʢہॴɾதؒɾେҬʣ ɻྫɿཧతෆ߹˺ ہॴ/தؒʢূ໌ͱͯ͠Ίͳ͍ʣʗ፻ (fabrication) ˺தؒʢࢿ֨ͳࠩ͘͠ग़͢ʣʗจ຺ෆ߹˺ہॴʢೖ ྗʹࠜڌͷ࣮ͷഁΕʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 45 -
ࢀߟɿରࡦΧλϩάΛࡾʹΔʢαʔϕΠΑΓɾྫʣ ʢຊतۀʣ දతͳରࡦख๏ʢҰ࣍จݙʣ ہॴʢࠜڌʹ݁Ϳʣ RAG [Lewis 2021] ʗ FActScore [Min
2023] ʗه߸తݕূɾ֎෦πʔϧ தؒʢશҬੑɾغݖʣ R-Tuning ʹغݖ [Zhang 2023] ʗ SelfCheckGPT [Manakul 2023] ʗ DoLa [Chuang 2023] ʗ CoVe [Dhuliawala 2023] ʗ ITI [Li 2023] େҬʢඇഁյߋ৽ʣ RAGʢࣝͷ֎෦Խʣʗܧଓֶशɾ٫ରࡦʗπʔϧҕৡ ؇αʔϕΠɿTonmoy et al. 2024ʢ32 ख๏ɾϓϩϯϓτֶʗϞσϧ։ൃʣ[2401.01313]ɺJi et al. 2023 ʢσʔλؔ࿈ʗϞσϧɾਪʣ ɻ ˞ख๏ͷ༗ޮੑݚڀ్্ɻ͜͜ͰʮͲͷͷཁٻΛิڧ͢Δ͔ʯͱ͍͏Ґஔ͚ͮͷྫΛࣔ͢ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 46 -
ʮݬ֮ʯޡশΧϦʔɾϋϫʔυͰଊ͑͢ ͦͦʮݬ֮ʯͱ͍͏໊લ͕ѱ͍ LLM ײ֮Λ࣋ͨͳ͍ɻޡΓܹͷෆࡏͰͳ͘σʔλͱతؔʹ༝དྷ͢Δɻ[Maleki et al. 2024, IEEE CAI][Ostergaard &
Nielbo 2023] ຊतۀͷݴ͍͑ ʮݬ֮ʯͰͳ͘ɺ ʮূ໌ͷࢿ֨ͷͳ͍߲ΛɺશҬੑΛͬͯࠩ͠ग़͢ߏతੑ࣭ʯɻ ໊લΛΧϦʔɾϋϫʔυͷޠኮʹม͑ΔͱɺॲํʢͲͷΛิڧ͢Δ͔ʣ͕ݟ͑Δɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 48 -
ͳͥਓؒʮγεςϜ2ʯΛҭͯͨͷ͔ʢୈ2ճͷճऩʣ γεςϜ 1 ʹ LLM ͕฿͍ͯ͠Δଆ ͍ɾײɾࣗಈɾੜಘతʢϕΠζతʣ ɻLLM ʹ ͜ͷʮγεςϜ
1ʯͷ฿ʹͬͱΒ ͠͞ͷ฿ʢୈ 2 ճʣ ɻ͕ͩ γεςϜ 1 Ͱূ໌Ͱ͖ͳ͍ɻ ͔ͩΒਓؒʮγεςϜ 2ʯΛҭͯͨ γεςϜ 2 ʹ ͷ্ͷԾܭࢉػʢσωοτʣʹݴޠͱ͍͏ OSʢΫϥʔΫʣ͕ಈ͔͢ɻ ୈ 2 ճͷҰ൪େࣄͳࣄ࣮ Ծܭࢉػ࠷ॳ͔Βʹͳ͔ͬͨɻਓʹग़ͯ͠ਪͨ͠ʹܭࢉ֎෦ʹ͋Γɺ͕ͯԽͨ͠ɻγ εςϜ 2 ͷىݯࣾձతɾݴޠత࣮ફ͔ͩΒ ϓϩάϥϚϒϧʢֶΔɾͤΔʣ ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 50 -
ΦνɿLLM ͷதʹʮγεςϜ2ʯΛͦΕ͕ཧ Γͳ͍ͷɺγεςϜ 2 LLM ʹ γεςϜ 1ʢͬͱΒ͠͞ʣ ɻ͚͍ܽͯΔͷγεςϜ 2
ʹ ূ໌ΛΒͤΔԾ ܭࢉػʹࠓͷࡾϋʔϞχʔʢہॴͷنଇɾఀࢭɾϞδϡϥϦςΟʣ ɻ ࠓͷʮॲํʯɺͦͷޙ͚ͩͬͨ ֎෦πʔϧɾه߸తݕূɾCoVeɾRAGɾغݖͲΕʮ γεςϜ 1 ͷ্ʹɺγεςϜ 2 Λޙ͚͢ΔʯࢼΈɻ ͔ͩΒɺཧ͕ཁΔ ཧͦ͜ɺͦͷʮγεςϜ 2ʯͷ༷ॻɻ ͷঈɿγεςϜ 1 ͍҆͘ʗγεςϜ 2 ͘ߴՁʢҰา͔ͣͭ֬ΊΔʣ ɻ͕ͩূ໌ͷࢿ֨ɺͦ ͜ʹ͔͠ͳ͍ɻ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 51 -
ԋशʢ࠷ऴճɾܰΊʣ ԋशʢղʹ͔͔ͬͨ࣌ؒॻ͘͜ͱʣ ͋ͳ͕ͨ࠷ۙݟ͔͚ͨʢ͋Δ͍ࣗͰ LLM ʹग़ͤͨ͞ʣϋϧγωʔγϣϯͷ࣮ྫΛҰ ͭڍ͛ɺͦΕ͕ࡾͷͲΕͷഁΕ͔ ہॴʢࠜڌͳ͖લਐʣʗதؒʢূ໌ͷࢿ֨ͳࠩ͘͠ग़͢ʣʗେҬʢطଘΛյ͢ɾैʣ ͷͲΕʹͨΔ͔Λஅ͠ɺ ҰͭॲํΛࡾͷݴ༿ͰఏҊͤΑɻ ώϯτ
ʮͬͱΒ͍͕ࠜ͠ڌΛग़ͤͳ͍ʯʹہॴɻ ʮࣗ৴ຬʑʹஅఆ͢Δ͕ཪ͚͕ͮͳ͍ʯʹதؒʢશҬੑͷِʣ ɻ ʮલͷͱໃ६͢Δʗࢦఠʹܴ߹ͯ͠ҙݟ͕มΘΔʯʹେҬɻ ʢఏग़ํ๏ɾక KULMS ͷࢦࣔʹै͍ͬͯͩ͘͞ɻ ʣ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 54 -
ࢀরจݙʢ1/4ʣҙຯͷཧ Wittgenstein, L. (1953). Philosophical Investigations. Blackwell.ʢː 43ʮҙຯͱ༻ʯ ʣ Firth,
J. R. (1957). “A synopsis of linguistic theory, 1930–1955.” Studies in Linguistic Analysis, 1–32. Blackwell. Harris, Z. S. (1954). “Distributional structure.” Word 10(2–3): 146–162. Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). “Efficient Estimation of Word Representations in Vector Space.” arXiv:1301.3781.ʢword2vecʣ Dummett, M. (1973). Frege: Philosophy of Language. Duckworth. Dummett, M. (1991). The Logical Basis of Metaphysics. Harvard Univ. Press. Prawitz, D. (1965). Natural Deduction: A Proof-Theoretical Study. Almqvist & Wiksell.ʢਖ਼نԽɾূ໌తҙຯʣ ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 56 -
ࢀরจݙʢ2/4ʣϋϧγωʔγϣϯɿྨɾݪҼɾෆՄආੑ Ji, Z., et al. (2023). “Survey of Hallucination in
Natural Language Generation.” ACM Computing Surveys 55(12): 1–38. Huang, L., et al. (2023/2025). “A Survey on Hallucination in Large Language Models.” ACM Trans. Information Systems. arXiv:2311.05232. Zhang, Y., et al. (2023). “Siren’s Song in the AI Ocean: A Survey on Hallucination in LLMs.” arXiv:2309.01219. Zhang, M., et al. (2023). “How Language Model Hallucinations Can Snowball.” arXiv:2305.13534ʢICML 2024ʣ. Kalai, A. T., Nachum, O., Vempala, S. S., & Zhang, E. (2025). “Why Language Models Hallucinate.” arXiv:2509.04664ʢOpenAIʣ. Kalai, A. T., & Vempala, S. S. (2024). “Calibrated Language Models Must Hallucinate.” STOC 2024. arXiv:2311.14648. Sharma, M., et al. (2023). “Towards Understanding Sycophancy in Language Models.” Anthropic. arXiv:2310.13548. Maleki, N., et al. (2024). “AI Hallucinations: A Misnomer Worth Clarifying.” IEEE CAI. arXiv:2401.06796. Østergaard, S. D., & Nielbo, K. L. (2023). “False Responses From AI Models Are Not Hallucinations.” Schizophrenia Bulletin 49(5). ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 57 -
ࢀরจݙʢ3/4ʣରࡦɾධՁϕϯνϚʔΫ Lewis, P., et al. (2020). “Retrieval-Augmented Generation for Knowledge-Intensive
NLP Tasks.” NeurIPS 2020. arXiv:2005.11401. ʢRAGʣ Chuang, Y.-S., et al. (2023). “DoLa: Decoding by Contrasting Layers.” arXiv:2309.03883ʢICLR 2024ʣ. Dhuliawala, S., et al. (2023). “Chain-of-Verification Reduces Hallucination in LLMs.” arXiv:2309.11495.ʢCoVeʣ Manakul, P., Liusie, A., & Gales, M. (2023). “SelfCheckGPT.” EMNLP 2023. arXiv:2303.08896. Zhang, H., et al. (2023). “R-Tuning: Instructing LLMs to Say ‘I Don’t Know’.” arXiv:2311.09677ʢNAACL 2024ʣ. Li, K., et al. (2023). “Inference-Time Intervention.” NeurIPS 2023. arXiv:2306.03341.ʢITIʣ Tonmoy, S. M. T. I., et al. (2024). “A Comprehensive Survey of Hallucination Mitigation Techniques in LLMs.” arXiv:2401.01313. Lin, S., Hilton, J., & Evans, O. (2022). “TruthfulQA.” ACL 2022. arXiv:2109.07958. Li, J., et al. (2023). “HaluEval.” EMNLP 2023. arXiv:2305.11747. Min, S., et al. (2023). “FActScore.” EMNLP 2023. arXiv:2305.14251. ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 58 -
ࢀরจݙʢ4/4ʣഁ໓త٫ɾܧଓֶश McCloskey, M., & Cohen, N. J. (1989). “Catastrophic Interference
in Connectionist Networks.” Psychology of Learning and Motivation 24: 109–165. Ratcliff, R. (1990). “Connectionist Models of Recognition Memory.” Psychological Review 97(2): 285–308. French, R. M. (1999). “Catastrophic Forgetting in Connectionist Networks.” Trends in Cognitive Sciences 3(4): 128–135. Goodfellow, I. J., et al. (2013). “An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks.” arXiv:1312.6211ʢICLR 2014ʣ. Kirkpatrick, J., et al. (2017). “Overcoming Catastrophic Forgetting in Neural Networks.” PNAS 114(13): 3521–3526.ʢEWCʣ Kemker, R., et al. (2018). “Measuring Catastrophic Forgetting in Neural Networks.” AAAI 2018. arXiv:1708.02072. Luo, Y., et al. (2023). “An Empirical Study of Catastrophic Forgetting in LLMs During Continual Fine-tuning.” arXiv:2308.08747 ʢIEEE/ACM TASLP 2025ʣ. De Lange, M., et al. (2021). “A Continual Learning Survey.” IEEE TPAMI 44(7). arXiv:1909.08383. Wang, L., et al. (2024). “A Comprehensive Survey of Continual Learning.” IEEE TPAMI. arXiv:2302.00487. ՊֶֶՊֶ࢙ (ԋश) ཧֶʢલظʣ ୲ɿా෦ढ़հ 59