Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ファインチューニングがしたい

Aipa
October 10, 2023

 ファインチューニングがしたい

「【沖縄】第2回 ChatGPTについて語ろう会!初心者OK!」でLTした内容です。
https://re-build.connpass.com/event/285499/

Aipa

October 10, 2023
Tweet

More Decks by Aipa

Other Decks in Technology

Transcript

  1. ϑΝΠϯνϡʔχϯά͕ͨ͠
    ͍
    ʲԭೄʳୈ̎ճ$IBU(15ʹ͍ͭͯޠΖ͏ձʂॳ৺ऀ0,ʂ
    BJQBDPNNBOEFS!ಹ೼

    View full-size slide

  2. ࣗݾ঺հ
    w ΞΠύʔୂ௕ͱ͍͍·͢ !BJQBDPNNBOEFS

    w ͏ͪͳʔΜͪΎͰ͢
    w $#DMPVEגࣜձࣾͰಇ͍͍ͯ·͢
    w ෺ྲྀۀքͰΠϊϕʔγϣϯىͨͯ͘͜͠೔ʑؤு͍ͬͯ·͢

    View full-size slide

  3. એ఻'MVUUFSΠϕϯτ΍Γ·͢ʂʢʣ
    IUUQT
    fl
    VUUFSPLJOBXBDPOOQBTTDPNFWFOU

    View full-size slide

  4. ࠓ೔࿩͢͜ͱ

    View full-size slide

  5. ϑΝΠϯνϡʔχϯά͕͍ͨ͠
    • ChatGPTΛۀ຿ʹಋೖ͍ͨ͠


    • զʑͷݱ৔͸ར༻Ͱ͖ͦ͏ͳͱ͜Ζ͕͍ͬͺ͍͋Δʂʂʂʂʂ


    • ΦϖϨʔλʔʢి࿩ɾνϟοτʣ૭ޱͷαϙʔτ඼࣭UP!!!


    • FAQपΓͷฦ৴


    • ΞϓϦͷૢ࡞


    • νϟοτ΍ίʔϧϩάʢԻ੠σʔλʣ͸͍ͬͺ͍͋ΔͷͰ৯ΘͤΒΕΔʢ͸ͣʣ


    • ϓϩμΫτͷDBࢀর͠ͳ͍ͱௐࠪͰ͖ͳ͍ܥλεΫΛΦϖϨʔλʔʹ΍ͬͯ΋Β͏ˠϓϩμΫτνʔϜͷޮ཰UP!!!

    View full-size slide

  6. ϑΝΠϯνϡʔχϯά͕͍ͨ͠
    • ChatGPTΛۀ຿ʹಋೖ͍ͨ͠


    • զʑͷݱ৔͸ར༻Ͱ͖ͦ͏ͳͱ͜Ζ͕͍ͬͺ͍͋Δʂʂʂʂʂ


    • ΦϖϨʔλʔʢి࿩ɾνϟοτʣ૭ޱͷαϙʔτ඼࣭UP!!!


    • FAQपΓͷฦ৴


    • ΞϓϦͷૢ࡞


    • νϟοτ΍ίʔϧϩάʢԻ੠σʔλʣ͸͍ͬͺ͍͋ΔͷͰ৯ΘͤΒΕΔʢ͸ͣʣ


    • ϓϩμΫτͷDBࢀর͠ͳ͍ͱௐࠪͰ͖ͳ͍ܥλεΫΛΦϖϨʔλʔʹ΍ͬͯ΋Β͏ˠϓϩμΫτνʔϜͷޮ཰UP!!!


    • ഑ૹґཔͷαϙʔτBotͷ༻ҙˠ཭୤཰Լ͛Δ!!!ʢ҆қͳߟ͑ʣ

    View full-size slide

  7. ϑΝΠϯνϡʔχϯά͕͍ͨ͠
    • ͨͩɺΫϩʔζυͳσʔλͰɺϓϥΠόγʔؔ࿈ͰαΫοͱಋೖ͢Δͷ
    ͸ݫͦ͠͏


    • ΦʔϓϯͳLLMͳΒಋೖͰ͖ͦ͏


    • ࠷ۙͷCyberAgent͞ΜͷϞσϧͱ͔ʢ·͋͡Γ͕ͱ͏͍͟͝·͢ʣ


    • ͦͷ··Ͱ͸࢖͑ͳ͍ʢࣦྱʣͷͰɺϑΝΠϯνϡʔχϯά͍ͨ͠

    View full-size slide

  8. ϑΝΠϯνϡʔχϯάͱ͸ʁ

    View full-size slide

  9. ϑΝΠϯνϡʔχϯάͱ͸ʁ
    ΈΜͳ͕஌͍ͬͯΔAI σΟʔϓϥʔχϯά
    ೣ ೣ

    View full-size slide

  10. ϑΝΠϯνϡʔχϯάͱ͸ʁ
    σΟʔϓϥʔχϯά

    View full-size slide

  11. ϑΝΠϯνϡʔχϯάͱ͸ʁ
    σΟʔϓϥʔχϯά

    ύϥϝʔλΛౚ݁ ύϥϝʔλΛߋ৽͢Δ
    ϨΠϠʔΛ௥Ճ͢Δ

    View full-size slide

  12. ϑΝΠϯνϡʔχϯάͱ͸ʁ
    σΟʔϓϥʔχϯά
    χϟΦϋ

    View full-size slide

  13. ͜ΕΛ--.Ͱ΋΍Γ͍ͨ

    View full-size slide

  14. Ͳ͏͢Ε͹͍͍ͷ͔ʁ

    View full-size slide

  15. ͳΔ΄ͲʂʢͳΜ΋Θ͔ΒΜʣ
    https://blog.brainpad.co.jp/entry/2023/05/22/153000

    View full-size slide

  16. ʢ಄ۭͬΆʣ
    ͦ͏ͩʂ·ͣ͸ୟ͍ͯΈΑ͏ʂ

    View full-size slide

  17. ͱ͋ΔهࣄΛࢀߟʹ͢Δ
    https://note.com/masuidrive/n/n0e2a11fc5bfa

    View full-size slide

  18. DZCFSBHFOUPQFODBMNC
    Google Colaboratoryʢແྉ࿮ʣͰಈ͘

    View full-size slide

  19. ΍Δͧʂʂʂ

    View full-size slide

  20. Զͨͪͷઓ͍͸͜Ε͔Βͩʂʂʂʂʂʂ🙏
    • ೖྗσʔλͷϑΥʔϚοτͱίʔυͷҙຯΛཧղ͠ͳ͕Βɺ༻ޠɺք۾
    ͷ࣌ܥྻ΍ΒɺΞϧΰϦζϜΛཧղ͍͖͍ͯͨ͠


    • ࠷ۙॻ੶΋όϯόϯͰ͍ͯΔͬΆ͍͔ΒTransformerʢཧղ͍ͯ͠Δͱ͸
    ͍͍ͬͯͳ͍ʣࢭ·ΓͩͬͨͷͰɺ௥͍͖͍ͬͯͨ


    • ͸΍͘ۀ຿ಋೖͯ͠ɺ෺ྲྀͷੈքม͍͑ͨ

    View full-size slide

  21. ʲݴ͍༁ʳ
    ࠓिͷ͍͋ͺ

    View full-size slide

  22. ʲݴ͍༁ʳ
    ࠓिͷ͍͋ͺ

    View full-size slide

  23. ʲݴ͍༁ʳ
    ࠓिͷ͍͋ͺ

    View full-size slide

  24. ʲݴ͍༁ʳ
    ࠓिͷ͍͋ͺ

    View full-size slide

  25. ʲݴ͍༁ʳ
    ࠓिͷ͍͋ͺ

    View full-size slide