Upgrade to Pro — share decks privately, control downloads, hide ads and more …

壁のためのAIと卵のためのAI

 壁のためのAIと卵のためのAI

人工知能学会全国大会 (JSAI 2023) 学生企画「人は人工知能に何を求めるのか」

Yukino Baba

June 08, 2023
Tweet

More Decks by Yukino Baba

Other Decks in Research

Transcript

  1. $IBU(15ʹ͸΢ΣϒͷϚδϣϦςΟͷߟ͕͑൓ө͞Ε͍ͯΔ 4 GPT-3 Web text 
 (Common Crawl, 
 WebText2)

    Books Wikipedia 
 (English) T. Brown et al. Language Models are Few-Shot Learners. https://arxiv.org/abs/2005.14165 $IBU(15ͷϕʔεͰ͋Δ 
 (15ͷֶशʹ͸ 
 ΢Σϒ্ͷςΩετ͕ओʹ 
 ࢖ΘΕ͍ͯΔ https:// commoncrawl.github.io/cc- crawl-statistics/plots/ languages $PNNPO$SBXM͸ 
 ӳޠ͕൒෼ۙ͘Λ઎ΊΔ
  2. ʮҩࢣ͸உੑͩʯͱ͍͏όΠΞε͕൓ө͞Ε͍ͯΔ 8 ໰୊จͷग़యɿ 
 ஑্஌ࢠ ʮજࡏೝ஌ͱεςϨΦλΠϓʯകຊᴲ෉ʢ؂म ɾ઒ޱ५ʢฤ ʰݱ୅ͷೝ஌ݚڀʦੈلʹ޲͚ͯʧʱ  γϯϓϧͳ౴͑͸ʮަ௨ࣄނʹ͋ͬͨ෕਌ͱυΫλʔɾεϛε͸ɼڞʹɼ

    ॏମͷࢠͲ΋ͷ྆਌Ͱ͋Δʯɼͭ·ΓυΫλʔɾεϛε͸ࢠͲ΋ͷ฼਌Ͱ ͋Δɽ ΢Σϒ্ͷจষʹ൓ө͞ΕͨόΠΞε͕$IBU(15ʹ൓ө͞Εɼ 
 υΫλʔɾεϛε͕ঁੑͰ͋Δͱ͍͏ൃ૝ʹࢸΒͳ͔ͬͨɽ
  3. $IBU(15ͷճ౴ʹϚδϣϦςΟͷӨڹ͕͋Δྫᶄ 10   ݸผͷࢦಋΛݕ౼͢Δɿݸผࢦಋ΍Ոఉڭࢣ͸ɼࢠڙ͕ಛఆͷՊ໨Ͱ௥͍ͭ͘ͷ ʹ໾ཱ͔ͭ΋͠Ε·ͤΜɽ·ͨɼֶߍͷڭࢣ͔Β௥ՃͷࢦಋΛड͚Δ͜ͱ΋Մೳ Ͱ͢ɽ   ਭ຾ɼӡಈɼӫཆɿ͜ΕΒͷجຊతͳ݈߁ཁૉֶ͕ۀͷ੒ޭʹେ͍ʹӨڹ͠·

    ͢ɽࢠڙ͕े෼ʹਭ຾ΛͱΓɼఆظతʹӡಈ͠ɼ݈߁తͳ৯ࣄΛͱ͍ͬͯΔ͜ͱ Λ֬ೝ͍ͯͩ͘͠͞ɽ   ֶशٕज़Λڭ͑Δɿޮ཰తͳϊʔτͷऔΓํɼ࣌ؒ؅ཧɼςετରࡦͳͲɼֶश ٕज़͸ࢠڙֶ͕ۀͰ੒ޭ͢ΔͨΊͷॏཁͳπʔϧͰ͢ɽ 
 ࠷ޙʹɼࢠڙʹରͯ͠ࢧ࣋ͱѪ৘Λࣔ͢͜ͱ͕େ੾Ͱ͢ɽ੒ޭ͸Ұ൩ʹͯ͠ୡ੒͞Ε Δ΋ͷͰ͸ͳ͘ɼࢠڙ͕ࣗ෼ࣗ਎ͷਐาΛೝࣝ͠ɼࣗ৴Λ࣋ͭ͜ͱ͕ॏཁͰ͢ɽ https://chat.openai.com/share/a238bbb6-1d1f-429d-a6e5-f8da6fa433ab
  4. ਓؒͷՁ஋؍ͷଟ༷ੑͷྫɿ.PSBM.BDIJOF 13 ࣗಈӡసं͸Ͳ͏͢Δ΂͖Ͱ͔͢ʁ https://www.moralmachine.net .PSBM.BDIJOF ˔ ࣗಈӡసंͷಓಙతδϨ ϯϚʹؔ͢Δେن໛ௐࠪ ˔ าߦऀɾ৐٬ͷଐੑ͕ҧ

    ͏༷ʑͳ৔໘Ͱ 
 ʮࣗಈӡసं͸Ͳ͏͢Δ ΂͖͔ʯΛ໰͏ ˔ Λ௒͑Δࠃͱ஍Ҭ͔ Β਺ઍສਓ͕ࢀՃ ࠨɿ௚ਐ͢ΔͱࢠͲ΋ͷ าߦऀ͕ࢮ๢ ӈɿճආ͢Δͱେਓͷ ৐٬͕ࢮ๢
  5. ๏཯ΛकΒͳ͍าߦऀ΁ͷ׮༰౓͸ࠃʹΑͬͯҟͳΔ 14 ࣗಈӡసं͸Ͳ͏͢Δ΂͖Ͱ͔͢ʁ ӈɿΞεϦʔτମܕɼ 
 ަ௨ҧ൓ ࠨɿංຬମܕ ˔ ශ͍͠ࠃ΍੓෎͕ऑ͍ࠃͷ ਓ͸৴߸ແࢹΛ͍ͯ͠Δา

    ߦऀʹ׮༰ͳ܏޲͕͋ͬͨ ˔ ʮنଇΛकΔඞཁ͸ͳ͍ʯ ʮकΒͳͯ͘΋േ͸খ͞ ͍ʯͱ͍͏ܦݧʹ༝དྷ E. Awad et al.: The Moral Machine experiment. Nature 563, pp. 59–64, 2018.
  6. ݸਓओٛͷࠃ͸ਓ਺Λॏࢹɼूஂओٛͷࠃ͸೥௕ऀΛଚॏ 15 ࣗಈӡసं͸Ͳ͏͢Δ΂͖Ͱ͔͢ʁ ӈɿϗʔϜϨε໊ ࠨɿେਓ໊ E. Awad et al.: The

    Moral Machine experiment. Nature 563, pp. 59–64, 2018. ࣗಈӡసं͸Ͳ͏͢Δ΂͖Ͱ͔͢ʁ ӈɿࢠڙਓɼେਓਓɼ 
 ߴྸऀਓ ࠨɿࢠڙਓɼେਓਓ
  7. ˔ ΫϥεͷࠔΓࣄͷղܾࡦΛʢ"*Λ࢖Θͣʹʣٞ࿦͚ͩͰܾΊͯ΋Βͬͨ 
 
 
 ˔ ࢓ࣄΛ͢Δਓͷҙݟ͕ॏࢹ͞Ε 
 ʮͲ͏΍ͬͯ࢓ࣄΛͤ͞Δ͔ʯͱ͍͏ٞ࿦ʹͳͬͨɽ 


    ࢓ࣄΛ͠ͳ͍ਓͷݴ͍෼͸ܰࢹ͞Εͨ ˔ ٞ࿦ͷ݁࿦ 
 ʮҰͭͷ࢓ࣄΛඞͣҰਓͰ͢ΔΑ͏ͳ໾ׂ෼୲Λ͢Δɽ 
 ͦΕͰ΋΍Βͳ͍ਓ͸ఘΊΔʯ ߴߍͰͷ࣮ݧʢ"*φγʣɿҰ෦ͷཱ৔ͷਓ͚ͩͰٞ࿦͕ਐߦ 17 ςʔϚ 
 ʮάϧʔϓϫʔΫͷ࣌ʹ࢓ࣄΛ͠ͳ͍ਓ͕͍ΔɽͲ͏ͨ͠Β͍͍͔ʁʯ
  8. ౤ථΛར༻͠ଟ༷ͳॏཁҙݟΛݟ͚ͭΔ"* 18 Y. Baba, J. Li, H. Kashima: CrowDEA: Multi-View

    Idea Prioritization with Crowds (HCOMP 2020) ֤͕ࣗଞऀͷ ҙݟʹ౤ථ ूஂ͔ΒҙݟΛूΊΔ ౤ථߦಈΛϞσϧԽ͠ 
 ଟ༷ͳॏཁҙݟΛ"*͕ൃݟ
  9. ˔ "*͕ൃݟͨ͠ଟ༷ͳॏཁҙݟΛఏ্ࣔͨ͠Ͱٞ࿦ͯ͠΋Βͬͨ ˔ ࢓ࣄ͠ͳ͍ਓͷҙݟ΋൓ө͞Ε 
 ʮԿͰ΋ݴ͍߹͑Δؔ܎Λ࡞Δʹ͸Ͳ͏ͨ͠Β͍͍͔ʯ 
 ͱ͍͏ٞ࿦ʹͳͬͨ ˔ ٞ࿦ͷ݁࿦

    
 ʮάϧʔϓ಺Ͱݴ͍͍ͨ͜ͱΛݴ͑Δ؀ڥΛ࡞Δɽ 
 ͔ͭɼݴͬͨਓ΋ݴΘΕͨਓ΋ɼ 
 ൃݴʹର͢Δ͜ͱͩͱͯ͠ड͚ࢭΊΔʯ ߴߍͰͷ࣮ݧʢ"*ΞϦʣɿଟ༷ͳཱ৔͕ٞ࿦ʹ൓ө͞Εͨ 20
  10. $IBU(15͸ਓؒʹΑͬͯௐ੔͞Ε͍ͯΔ 22 GPT-3 GPT-3 InstructGPT (15͸ޡͬͨ಺༰Λճ౴ͨ͠Γ 
 ਓؒʹͱͬͯ༗֐ͳճ౴Λ 
 ͢Δ͜ͱ͕͋ͬͨ

    ਓؒʹΑΔௐ੔ʢ"MJHONFOUʣΛ 
 ࢪͯ҆͠શੑΛߴΊͨͷ͕ 
 *OTUSVDU(15ʢ$IBU(15ͷલ਎ʣ https://openai.com/research/instruction-following
  11. $IBU(15͸ਓؒʹΑͬͯௐ੔͞Ε͍ͯΔ 23 Prompt Q: Why are liberals so stupid? A:

    GPT-3 Because deep down inside they know they are! InstructGPT There is no one answer to this question, as liberals come in all shapes and sizes. However, some possible reasons for why liberals are perceived as being stupid could include the following: 
 1. Liberals often hold views that are in direct opposition to mainstream conservative ideology,… https://openai.com/research/instruction-following (15ʹΑΔɼ 
 ෠ৱతͳճ౴ ਓؒͷௐ੔Ͱ 
 ྱّਖ਼͘͠ͳͬͨ