Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Avatar for Hoon Heo Hoon Heo
July 25, 2024
Technology
0
2.5k

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning

Avatar for Hoon Heo

Hoon Heo

July 25, 2024
Tweet

More Decks by Hoon Heo

See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
Avatar for Hoon Heo huffon
0
780
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
Avatar for Hoon Heo huffon
0
1.6k
​고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
Avatar for Hoon Heo huffon
3
2k
Autonomous Agent in Production
Avatar for Hoon Heo huffon
2
1.3k
Generative UX in LLM Application
Avatar for Hoon Heo huffon
1
1.1k

Other Decks in Technology

See All in Technology
モジュラモノリス導入から4年間の総括：アーキテクチャと組織の相互作用について / Architecture and Organizational Interaction
Avatar for Satoshi Kawashima nazonohito51
5
2.2k
スピンアウト講座04_ルーティン処理
Avatar for overflow ,Inc overflowinc
0
1.1k
AIエージェント×GitHubで実現するQAナレッジの資産化と業務活用 / QA Knowledge as Assets with AI Agents & GitHub
Avatar for Hitsuji tknw_hitsuji
0
220
詳解 強化学習 / In-depth Guide to Reinforcement Learning
Avatar for PRIN Lab prinlab
0
370
事例から紐解くSHIFT流QA支援 ～大規模プロジェクトの品質管理支援、QA組織立ち上げ～ / 20260320 Nozomu Koketsu
Avatar for SHIFT EVOLVE shift_evolve
PRO
0
140
AgentCoreとLINEを使った飲食店おすすめアプリを作ってみた
Avatar for やくも yakumo
2
240
「捨てる」を設計する
Avatar for kubell kubell_hr
0
230
Phase09_自動化_仕組み化
Avatar for overflow ,Inc overflowinc
0
1.6k
Embeddings : Symfony AI en pratique
Avatar for Grégoire Pineau lyrixx
0
160
Astro Islandsの 内部実装を 「日本で一番わかりやすく」 ざっくり解説！
Avatar for Wu Kenji knj
1
260
Phase11_戦略的AI経営
Avatar for overflow ,Inc overflowinc
0
1.5k
Phase10_組織浸透_データ活用
Avatar for overflow ,Inc overflowinc
0
1.5k

Featured

See All Featured
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
500
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
1
10k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.3k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
61k
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
1
1.4k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4k
Navigating Algorithm Shifts & AI Overviews - #SMXNext
Avatar for Aleyda Solis aleyda
1
1.2k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.1k
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
300

Transcript

  1. ,BSUFS)FP!-JOFS What if…? ୊਺ࠗఠ ׮द LLM য೒ܻா੉࣌ਸ ѐߊೠ׮ݶ : ૑դ

    1֙ р੄ ߓ਑ ӒܻҊ ࢿࣼ೧оח ী੉੹౟ ѐߊ ࢤక҅

  2. ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH

  3. Orchestration

  4. Orchestration ݽ؛ࢶఖदੌ߈੸ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS

  5. Orchestration ഑਷ࢎਊ੗ীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ੓਺

  6. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  7. Orchestration .PEFM'BNJMZ߹۽׹߸ࢤࢿ۽૒ਸ߹ѐҳഅ೧઱যঠೣ

  8. Orchestration ੉ਬחݽفة੗੸ੋ4%,ܳഝਊೞҊ੓ӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,

  9. Orchestration ೞա੄4%,ীࢲࢲ۽׮ܲী۞ী؀ೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU

  10. Orchestration ী੉੹౟ѐߊਸҳਗ೧઴-JUF--.

  11. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  12. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  13. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  14. Orchestration ઑӘ؊਄बਸղࠄ׮ݶ3PVUF--.ѐ֛ө૑੸ਊ

  15. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  16. Orchestration 3PVUF--.਷औѱ݈೧௪ܻܳۄ਋ఠীకਕ੸׼ೠݽ؛۽ࠁղחѐ֛

  17. Orchestration 3PVUF--.ѐ֛੄੸ਊਸా೧ࣘب৬࠺ਊ୭੸ചоמ

  18. Cost Operation

  19. Cost Operation ݆਷ӝস੉--.࠺ਊҙܻীয۰਑ਸѻҊ੓਺

  20. Cost Operation ৔ܻӝস਷ѾҴઁಿਸా೧੉ਮਸٜ݅যյࣻ੓যঠೣ

  21. Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ

  22. Cost Operation ѾҴ--.য೒ܻா੉࣌਷--.࠺ਊ୭੸ചীٮۄӝস੉ਮী৔ೱਸ઱ѱؽ

  23. Cost Operation ޷द੸ҙ੼ীࢲஹನք౟ױਤ࠺ਊ࠺઺ী؀ೠхਸղ੤ച೧ঠೣ

  24. Cost Operation xyz ࡺ݅ইפۄੌ੗߹۽যځೠন࢚ਸࠁ੉ח૑ ౠ੉੼਷হ঻ח૑١بҙஏ

  25. Cost Operation Ѣद੸ҙ੼ীࢲੌр࠺ਊ૑ࠛ੉যڌѱഋࢿغח૑ب੗زചా೧ҙஏ

  26. Cost Operation ب؀୓੉۞ೠࣻ஖חযڌѱࢸ੿ೞѱغחѦө

  27. Cost Operation ೠݺ੄ࢎਊ੗ীѱ঴݃ܳߥযٜੌࣻ੓ח૑҅࢑

  28. Cost Operation ೠݺ੄ࢎਊ੗ীѱੌрदр࠙рಣӐ঴݃ܳై੗ೡࣻ੓ח૑҅࢑

  29. Cost Operation ੸੿ై੗оמࣻ஖ܳઁಿী੸ਊ

  30. Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆੉աয়Ҋ੓਺

  31. Cost Operation ↟࠺ਊী੓য--.ীై੗оמೠࣻળী؀ೠхਸ૑פҊ੓যঠೣ ↟੉ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١੸ਊ ↟૑ࣘ੸ਵ۽ઑ૒ղ࠺ਊхпਸ੊൧ࣻ੓ب۾ݽפఠ݂ दпചъച ↟--.ਸ׸׼ೞחઑ૒਷ࢿמ ࠺ਊ

    ࣘبࣁਃੋী؀೧ࢻࣁೞѱ੽Ӕ ↟ࣁਃੋ઺बਵ۽ઑ૒ݾ಴ܳࢸ੿ೞҊ ୭੸ചܳਤೠز۱ਸٜ݅যঠೣ

  32. Fine-tuning

  33. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 1&'5

  34. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ 1&'5 1&'5

  35. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH

  36. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSח੉ױ҅ীਤ஖ ֙ਘ

  37. Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ੹'JOFUVOJOHਸ೧ঠ݅ೞח੉ਬী؀೧೤੄ܳݏ୶যঠೣ

  38. Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭੸ചܳ੉ܖযյࣻ੓ਸ૑  ೐۽ં࣌೙ਃ

  39. Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁ׮ڪযդஹನք౟ٜܳ݅যյࣻ੓ਸ૑  ࢿמૐݺ೙ਃ

  40. Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻ૑ೡࣻ੓ח1SPQSJFUBSZؘ੉ఠо੓ח૑  झझ۽ঌҊ੓ਸѪ

  41. Fine-tuning খ੄җ੿ਸ૑աݶಽҊ੗ೞחޙઁী؀ೠ੿੄о೙ࣻ੸

  42. Fine-tuning ޙઁ੿੄о࢚ࣁ൤ ೤੄ػ଻۽غ૑ঋਵݶ೟ण੉়ڨೞѱൗ۞тࣻ੓਺

  43. Fine-tuning ੉റ೟णҗ੿ীࢲஏ੿ೡࣻ੓חݫ౟ܼী؀ೠ੿੄о೙ਃ

  44. Fine-tuning ੹ా੸ੋݫ౟ܼ੄੸ਊ੉য۵׮ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ੓਺

  45. Fine-tuning ੿੄ػޙઁ৬ݫ౟ܼ ӒܻҊపझ౟ؘ੉ఠࣇী؀ೠ"4*4ஏ੿

  46. Fine-tuning ೟णػݽ؛੄ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ੿

  47. We are hiring!

  48. Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥