Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Hoon Heo Hoon Heo
July 25, 2024
Technology
2.5k
0

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning

Avatar for Hoon Heo

Hoon Heo

July 25, 2024

More Decks by Hoon Heo

See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
Avatar for Hoon Heo huffon
0
800
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
Avatar for Hoon Heo huffon
0
1.6k
​고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
Avatar for Hoon Heo huffon
3
2k
Autonomous Agent in Production
Avatar for Hoon Heo huffon
2
1.3k
Generative UX in LLM Application
Avatar for Hoon Heo huffon
1
1.1k

Other Decks in Technology

See All in Technology
Claude Codeをどのように キャッチアップしているか
Avatar for Oikon oikon48
12
7.4k
日本 Fintech 未来予測レポート 2027〜2028年（オリジナル版）
Avatar for 8maki 8maki
0
2.1k
Oracle AI Database@Azure：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
6
2k
Oracle AI Database@AWS：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
4
2.9k
なぜ Platform Engineering の土台に Kubernetes を選ぶのか
Avatar for Ray r4ynode
2
620
作って終わりにしない タイミーのセマンティックレイヤー育成の現在地
Avatar for chanyou0311 chanyou0311
4
2.3k
入門！AWS Blocks
Avatar for Yosuke Suzuki ysuzuki
1
110
protovalidate-es を導入してみた
Avatar for 弁護士ドットコム bengo4com
0
180
AIのReact習熟度を測る
Avatar for uhyo uhyo
2
300
白金鉱業Meetup_Vol.24_「AIエージェントは分けるほど良い」は本当か？ / Is it true that “the more you divide AI agents, the better”?
Avatar for BrainPad brainpadpr
1
350
AAIFに入ってみた ～内から見えるコミュニティ動向～
Avatar for Satoshi Ito sato4
0
190
非エンジニアがClaudeと挑んだ「1ヶ月間プロダクト30本ノック」
Avatar for kinako askokc
0
430

Featured

See All Featured
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
52k
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
400
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
1k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
76
5.2k
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
160
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
3.4k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
333
25k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.7k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
sira's awesome portfolio website redesign presentation
Avatar for ElsiraPls elsirapls
0
280
Crafting Experiences
Avatar for Bethany Jepchumba bethany
1
180
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
1
770

Transcript

  1. ,BSUFS)FP!-JOFS What if…? ୊਺ࠗఠ ׮द LLM য೒ܻா੉࣌ਸ ѐߊೠ׮ݶ : ૑դ

    1֙ р੄ ߓ਑ ӒܻҊ ࢿࣼ೧оח ী੉੹౟ ѐߊ ࢤక҅

  2. ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH

  3. Orchestration

  4. Orchestration ݽ؛ࢶఖदੌ߈੸ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS

  5. Orchestration ഑਷ࢎਊ੗ীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ੓਺

  6. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  7. Orchestration .PEFM'BNJMZ߹۽׹߸ࢤࢿ۽૒ਸ߹ѐҳഅ೧઱যঠೣ

  8. Orchestration ੉ਬחݽفة੗੸ੋ4%,ܳഝਊೞҊ੓ӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,

  9. Orchestration ೞա੄4%,ীࢲࢲ۽׮ܲী۞ী؀ೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU

  10. Orchestration ী੉੹౟ѐߊਸҳਗ೧઴-JUF--.

  11. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  12. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  13. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  14. Orchestration ઑӘ؊਄बਸղࠄ׮ݶ3PVUF--.ѐ֛ө૑੸ਊ

  15. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  16. Orchestration 3PVUF--.਷औѱ݈೧௪ܻܳۄ਋ఠীకਕ੸׼ೠݽ؛۽ࠁղחѐ֛

  17. Orchestration 3PVUF--.ѐ֛੄੸ਊਸా೧ࣘب৬࠺ਊ୭੸ചоמ

  18. Cost Operation

  19. Cost Operation ݆਷ӝস੉--.࠺ਊҙܻীয۰਑ਸѻҊ੓਺

  20. Cost Operation ৔ܻӝস਷ѾҴઁಿਸా೧੉ਮਸٜ݅যյࣻ੓যঠೣ

  21. Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ

  22. Cost Operation ѾҴ--.য೒ܻா੉࣌਷--.࠺ਊ୭੸ചীٮۄӝস੉ਮী৔ೱਸ઱ѱؽ

  23. Cost Operation ޷द੸ҙ੼ীࢲஹನք౟ױਤ࠺ਊ࠺઺ী؀ೠхਸղ੤ച೧ঠೣ

  24. Cost Operation xyz ࡺ݅ইפۄੌ੗߹۽যځೠন࢚ਸࠁ੉ח૑ ౠ੉੼਷হ঻ח૑١بҙஏ

  25. Cost Operation Ѣद੸ҙ੼ীࢲੌр࠺ਊ૑ࠛ੉যڌѱഋࢿغח૑ب੗زചా೧ҙஏ

  26. Cost Operation ب؀୓੉۞ೠࣻ஖חযڌѱࢸ੿ೞѱغחѦө

  27. Cost Operation ೠݺ੄ࢎਊ੗ীѱ঴݃ܳߥযٜੌࣻ੓ח૑҅࢑

  28. Cost Operation ೠݺ੄ࢎਊ੗ীѱੌрदр࠙рಣӐ঴݃ܳై੗ೡࣻ੓ח૑҅࢑

  29. Cost Operation ੸੿ై੗оמࣻ஖ܳઁಿী੸ਊ

  30. Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆੉աয়Ҋ੓਺

  31. Cost Operation ↟࠺ਊী੓য--.ীై੗оמೠࣻળী؀ೠхਸ૑פҊ੓যঠೣ ↟੉ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١੸ਊ ↟૑ࣘ੸ਵ۽ઑ૒ղ࠺ਊхпਸ੊൧ࣻ੓ب۾ݽפఠ݂ दпചъച ↟--.ਸ׸׼ೞחઑ૒਷ࢿמ ࠺ਊ

    ࣘبࣁਃੋী؀೧ࢻࣁೞѱ੽Ӕ ↟ࣁਃੋ઺बਵ۽ઑ૒ݾ಴ܳࢸ੿ೞҊ ୭੸ചܳਤೠز۱ਸٜ݅যঠೣ

  32. Fine-tuning

  33. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 1&'5

  34. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ 1&'5 1&'5

  35. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH

  36. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSח੉ױ҅ীਤ஖ ֙ਘ

  37. Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ੹'JOFUVOJOHਸ೧ঠ݅ೞח੉ਬী؀೧೤੄ܳݏ୶যঠೣ

  38. Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭੸ചܳ੉ܖযյࣻ੓ਸ૑  ೐۽ં࣌೙ਃ

  39. Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁ׮ڪযդஹನք౟ٜܳ݅যյࣻ੓ਸ૑  ࢿמૐݺ೙ਃ

  40. Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻ૑ೡࣻ੓ח1SPQSJFUBSZؘ੉ఠо੓ח૑  झझ۽ঌҊ੓ਸѪ

  41. Fine-tuning খ੄җ੿ਸ૑աݶಽҊ੗ೞחޙઁী؀ೠ੿੄о೙ࣻ੸

  42. Fine-tuning ޙઁ੿੄о࢚ࣁ൤ ೤੄ػ଻۽غ૑ঋਵݶ೟ण੉়ڨೞѱൗ۞тࣻ੓਺

  43. Fine-tuning ੉റ೟णҗ੿ীࢲஏ੿ೡࣻ੓חݫ౟ܼী؀ೠ੿੄о೙ਃ

  44. Fine-tuning ੹ా੸ੋݫ౟ܼ੄੸ਊ੉য۵׮ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ੓਺

  45. Fine-tuning ੿੄ػޙઁ৬ݫ౟ܼ ӒܻҊపझ౟ؘ੉ఠࣇী؀ೠ"4*4ஏ੿

  46. Fine-tuning ೟णػݽ؛੄ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ੿

  47. We are hiring!

  48. Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥