ChatGPTの現状理解と今月のLLM情報

1. ChatGPTの現状理解
・前回の振り返り
・ChatGTP界隈の1ヶ月間のアップデート
2. LLM界隈の話題提供 (雑多)

Transcript

1. 4BUPTIJ,VNF !TLVNF
   
   $IBU(15ͷݱঢ়ཧղͱ
   ࠓ݄ͷ--.৘ใ
   #JP1BDLBUIPO
   
   +6/
   

   View Slide

2. ࠓ೔ͷ࿩୊ఏڙ
   $IBU(15ͷݱঢ়ཧղ
   લճͷৼΓฦΓ
   $IBU(51ք۾ͷϲ݄ؒͷΞοϓσʔτ
   --.ք۾ͷ࿩୊ఏڙ ࡶଟ
   
   

   View Slide

3. DIBU(15PS--.
   ͸࢖ͬͯ·͔͢ʁʁ
   

   View Slide

4. લճͷৼΓฦΓ
   $IBU(15ͱ͸ʁ
   ✦$IBU(FOFSBUJWF1SFUSBJOFE5SBOTGPSNFS (15
   ͷུ
   ✦0QFO"*͕ࣾ೥݄ʹެ։ͨ͠"*νϟοτϘοτɻ
   ✦ʮDIBU(15ʯ͸(15ͷνϟοτػೳΛࢦ͢ɻ
   ✦୯ʹʮ(15ʯͱݴ͏ͱɺϞσϧࣗମ͋Δ͍͸ଞͷػೳ΋ࢦ͢ɻ
   ✦ݱࡏͷ࠷৽൛(15 ೥݄೔
   ɺ$IBU(15.BZ7FSTJPO
   ✦େن໛ݴޠϞσϧʢ--. -BSHF-BOHVBHF.PEFMʣͷͭ
   ✦େྔͷςΩετΛֶशͨ͠"*Ϟσϧɻ
   ✦ςΩετੜ੒աఔͰɺ࣍ʹདྷΔ୯ޠΛߴ֬཰Ͱ༧ଌͰ͖Δɻ
   ✦݁Ռͱͯ͠ɺਓ͕ؒࣗવʹײ͡ΔจষΛੜ੒Ͱ͖Δ"*Ϟσϧɻ
   ✦(15ɾ--.ͰԿ͕มΘͬͨ͜ͱɻɻɻ
   ✦ίϯϐϡʔλݴޠΛհͣ͞ʹɺࣗવݴޠΛϓϩϯϓτ ࢦࣔจ
   
   ͱͯ͠ɺ"*ɾܭࢉػʹ໋ྩͰ͖ΔΑ͏ʹͳͬͨɻ
   

   View Slide

5. $IBU(15ͷ࣮ߦ؀ڥ 6*ฤ
   
   IUUQTDIBUPQFOBJDPN NPEFMHQU
   ຊ୊Λ࿩͢લʹɺॳΊͯͷํ޲͚ʹ$IBU(15ͷ࣮ԋಈըΛʜ
   

   View Slide

6. $IBU(15ͷ࣮ߦ؀ڥ 6*ฤ
   
   ຊ୊Λ࿩͢લʹɺॳΊͯͷํ޲͚ʹ$IBU(15ͷ࣮ԋಈըΛʜ
   

   View Slide

7. $IBU(51ք۾ͷ
   ϲ݄ؒͷΞοϓσʔτ
   ɾJ04൛$IBU(15ΞϓϦ͕ϦϦʔε
   ɾЌ൛GFBUVSFTػೳ͕࣮૷
   ɾ΢Σϒݕࡧػೳͷ࣮૷
   ɾ1MVHJOT͕࢖͑Δ
   

   View Slide

8. J04൛$IBU(15ΞϓϦ͕ϦϦʔε
   IUUQTPQFOBJDPNCMPH
   JOUSPEVDJOHUIFDIBUHQUBQQGPSJPT
   ِΞϓϦ͕ଟ਺ϦϦʔε͞Ε
   ͍ͯΔͨΊɺඞͣެ͔ࣜΒ
   "QQTUPSFʹඈ΅͏ɻ
   

   View Slide

9. IUUQTPQFOBJDPNXBJUMJTUHQUBQJ
   IUUQTPQFOBJDPNXBJUMJTUQMVHJOT
   (15"1*$IBU(15QMVHJOT
   ͷར༻͸ॱ൪଴ͪ
   

   View Slide

10. Ќ൛ͰɺQMVHJOػೳ͕࢖͑ΔΑ͏ʹ
    
    ϩάΠϯ
    
    4FUUJOHT
    
    #FUBGFBUVSFT
    
    (15࣌ʹ
    બ୒Մೳʹ
    ˞ར༻ʹ͸0QFO"*αϒεΫඞཁ
    

    View Slide

11. #SPXTJOHͰ࠷৽ͷ΢Σϒ৘ใΛऔಘ
    ※ ͢΂ͯͷ΢Σϒ৘ใʹ͸ΞΫηεͰ͖ͣɺ಺෦ج४ͰɺΞΫηεՄೳͳ΢ΣϒαΠτʹ੍ݶ͕͋Δ
    ※ Webϒϥ΢δϯά͸ϓϥάΠϯͷʮWebPilotʯ͕༏ल͔΋ɻ
    ※ Codex: GPT-3ͷೖྗ΋͘͠͸ग़ྗ͕ϓϩάϥϛϯάίʔυͰ͋Δ෦෼ΛऔΓग़ͨ͠code extension model
    

    View Slide

12. (PPHMF#BSEͰ΋΢Σϒ৘ใ͸࢖͑Δ
    IUUQTCBSEHPPHMFDPN
    

    View Slide

13. ΢Σϒݕࡧػೳͷൺֱʹ͍ͭͯ
    ॲཧ଎౓
    ςΩετͷ
    ੜ੒ਫ਼౓
    DIBU(15(15 ❌ʙ˛
    ˕
    ʢ௕จੜ੒ʣ
    (PPHMF#BSE ˓ ˓
    #JOH"*$IBU ˓ ˓
    

    View Slide

14. 1MVHJOTUPSFͰ
    ͍ۙ1MVHJOT͕ެ։
    ݱࡏ
    
    

    View Slide

15. 1PQVMBS1MVHJOT
    

    View Slide

16. 1SPNQU1FSGFDU
    ϓϩϯϓτʹ
    QFSGFDU
    ͱ௥ه
    ࣮ߦલʹɺ
    ϓϩϯϓτͷमਖ਼͕ೖΔ
    

    View Slide

17. 8PMGSBN
    WolfranͰ༷ʑͳλεΫΛ࣮ߦՄೳ
    1. ਺ֶతͳܭࢉ: ୅਺తͳܭࢉɺඍ෼ɺੵ
    ෼ɺߦྻͷૢ࡞ɺ౷ܭతͳܭࢉͳͲ
    2. ෺ཧɺԽֶɺੜ෺ֶͳͲͷՊֶతͳ໰͍
    ߹Θͤ: ෺ཧఆ਺ͷ஋ɺԽֶతͳ൓Ԡɺ
    ੜ෺ֶతͳσʔλͳͲɺՊֶతͳ৘ใΛ
    ఏڙ
    3. ஍ཧతͳ৘ใ
    4. ೔෇ͱ࣌ؒͷܭࢉ
    5. ϓϩοτͱάϥϑͷ࡞੒
    6. WolframݴޠͷίʔυͷධՁ
    7. ࣗવݴޠͷΫΤϦͷղऍ:
    

    View Slide

18. લճͷৼΓฦΓ
    $IBU(15͕ۤखͳ͜ͱ
    

    View Slide

19. $IBU(15͕ۤखͳ͜ͱ
    - Ϟσϧͷֶशσʔλ͕2021೥·Ͱ
    - هࣄʹͳ͍ͬͯͳ͍৘ใʢձһαΠτɺ஍Ҭωλ etcʣʹऑ͍
    

    View Slide

20. ࠓޙɺ$IBU(15QMVHJOTͰͷରԠʹظ଴
    ࣌ʹ͸ฉ͖ฦ͢͜ͱ΋େ੾
    $IBU(15͕ۤखͳ͜ͱ
    - Ϟσϧͷֶशσʔλ͕2021೥·Ͱ
    - هࣄʹͳ͍ͬͯͳ͍৘ใʢձһαΠτɺ஍Ҭωλ etcʣʹऑ͍
    

    View Slide

21. ೔ຊॳͷDIBU(15QMVHJO৯΂ϩά
    IUUQTUFDICMPHUBCFMPHDPNFOUSZ
    fi
    STUDIBMMFOHFUBCFMPHDIBUHQUQMVHJOEFWMFPQNFOU
    

    View Slide

22. ೔ຊॳͷDIBU(15QMVHJO৯΂ϩά
    IUUQTUFDICMPHUBCFMPHDPNFOUSZ
    fi
    STUDIBMMFOHFUBCFMPHDIBUHQUQMVHJOEFWMFPQNFOU
    
    ࣗવݴޠ ϓϩϯϓτ
    ΛೖྗͰɺ
    (51ͰΫΤϦ࡞੒ KTPO
    
    
    %#ݕࡧ
    
    ݕࡧ݁Ռͷϝλσʔλͷऔಘ KTPO
    
    
    औಘ৘ใΛ΋ͱʹɺ(51Ͱจॻੜ੒
    

    View Slide

23. ࠓ೔ͷ࿩୊ఏڙ
    $IBU(15ͷݱঢ়ཧղ
    લճͷৼΓฦΓ
    $IBU(51ք۾ͷϲ݄ؒͷΞοϓσʔτ
    --.ք۾ͷ࿩୊ఏڙ ࡶଟ
    
    

    View Slide

24. (155FDIOJDBM3FQPSU
    IUUQTBSYJWPSHBCT
    ϓϨϓϦϯτͰςΫχΧϧϨϙʔτެ։ ӳޠΠϯϓοτͰͷੑೳ͕࠷΋ߴ͍
    Ґ
    

    View Slide

25. ϓϩϯϓτΤϯδχΞϦϯά͸౰෼ྲྀߦΓͦ͏ɻɻɻ
    ϓϩϯϓτΤϯδχΞϦϯάͱ͸ʁ
    ɾݴޠϞσϧʢLMsʣΛޮ཰తʹ࢖༻͢ΔͨΊͷϓϩϯϓτΛ։ൃ͓
    Αͼ࠷దԽ͢Δൺֱత৽ֶ͍͠໰෼໺ɻ
    ɾϓϩϯϓτΤϯδχΞϦϯάͷεΩϧΛ਎ʹ͚ͭΔ͜ͱͰɺେن໛
    ݴޠϞσϧʢLLMsʣͷೳྗͱݶքΛΑΓཧղͰ͖Δɻ
    IUUQTHJUIVCDPNEBJSBJ1SPNQU&OHJOFFSJOH(VJEF
    ೔ຊޠ൛IUUQTXXXQSPNQUJOHHVJEFBJKQ
    ӳޠ൛IUUQTXXXQSPNQUJOHHVJEFBJ
    Prompt Engineering Guide: dair-ai͕ఏڙ͢ΔϓϩϯϓτΤϯδχΞϦϯάΛֶͿͨΊͷΨΠυɻ
    

    View Slide

26. .BHJD
    IUUQTNBHJDEFWCMPHMUN
    ѻ͑ΔςΩετͷ௕͞
    
    
    GPT3.5: ࠷େ4097 τʔΫϯ
    
    
    GPT4: 32,768 τʔΫϯʢ2ສ5000ޠʣ
    LTM-1: ϓϩάϥϛϯ
    άʹಛԽͨ͠LLM
    

    View Slide

27. .BHJD
    https://www.youtube.com/watch?v=E0YFFhBt8-Y&t=18s
    

    View Slide

28. ·ͱΊ
    ɾ $IBU(15ʹ͍ͭͯͷલճͷৼΓฦΓ
    ɾ ք۾ͷ໿ϲ݄ؒͷΞοϓσʔτ
    

    View Slide