Upgrade to Pro — share decks privately, control downloads, hide ads and more …

DGX SparkでローカルLLMをLangChainで動かした話

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Hirokatsu Endo Hirokatsu Endo
November 27, 2025
Technology
1
610

DGX SparkでローカルLLMをLangChainで動かした話

Avatar for Hirokatsu Endo

Hirokatsu Endo

November 27, 2025
Tweet

More Decks by Hirokatsu Endo

See All by Hirokatsu Endo
AgentCore BrowserとClaude Codeスキルを活用した 『初手AI』を実現する業務自動化AIエージェント基盤
Avatar for Hirokatsu Endo ruzia
9
3.6k
Amazon Bedrock Agent Core ~ AIエージェント時代を支えるAWSの新基盤 ~
Avatar for Hirokatsu Endo ruzia
0
54
Lambda＆FargateとPlanetScaleで作るServerless Rails環境
Avatar for Hirokatsu Endo ruzia
0
290
デフォルトにして至高、RubyMineの大好きな所
Avatar for Hirokatsu Endo ruzia
0
3.9k
AWS Lambda + PlanetScale = 超絶スケールWebアプリ
Avatar for Hirokatsu Endo ruzia
1
300
Jets ~ Rubyで始めるServerless生活 ~
Avatar for Hirokatsu Endo ruzia
0
1.3k
Jets ~Rubyで始めるServerless生活~
Avatar for Hirokatsu Endo ruzia
0
800
プログラマがAMPと付き合う上で 知っておくべきこと
Avatar for Hirokatsu Endo ruzia
0
2.4k

Other Decks in Technology

See All in Technology
CDK対応したAWS DevOps Agentを試そう_20260201
Avatar for モブエンジニア（Masaki Okuda） masakiokuda
1
420
We Built for Predictability; The Workloads Didn’t Care
Avatar for Michael Stahnke stahnma
0
150
登壇駆動学習のすすめ — CfPのネタの見つけ方と書くときに意識していること
Avatar for おおいし bicstone
3
130
生成AIと余白 〜開発スピードが向上した今、何に向き合う？〜
Avatar for KAKEHASHI kakehashi
PRO
0
160
Cosmos World Foundation Model Platform for Physical AI
Avatar for Takuya MINAGAWA takmin
0
970
Context Engineeringの取り組み
Avatar for nutslove nutslove
0
380
プロダクト成長を支える開発基盤とスケールに伴う課題
Avatar for yuu26 yuu26
4
1.4k
今日から始める Amazon Bedrock AgentCore
Avatar for Har1101 har1101
4
420
マーケットプレイス版Oracle WebCenter Content For OCI
Avatar for oracle4engineer oracle4engineer
PRO
5
1.6k
Claude_CodeでSEOを最適化する_AI_Ops_Community_Vol.2__マーケティングx_AIはここまで進化した.pdf
Avatar for 小笠原理久 riku_423
2
610
外部キー制約の知っておいて欲しいこと - RDBMSを正しく使うために必要なこと / FOREIGN KEY Night
Avatar for soudai sone soudai
PRO
12
5.6k
Frontier Agents (Kiro autonomous agent / AWS Security Agent / AWS DevOps Agent) の紹介
Avatar for msysh msysh
3
190

Featured

See All Featured
Kristin Tynski - Automating Marketing Tasks With AI
Avatar for Tech SEO Connect techseoconnect
PRO
0
150
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
34k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
302
51k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.3k
Design in an AI World
Avatar for tapps tapps
0
150
How to Grow Your eCommerce with AI & Automation
Avatar for Katarina Dahlin katarinadahlin
PRO
1
110
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
56
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
130
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
2
250
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
120
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.3k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k

Transcript

  1. personal AI computer DGX Spark ~ ϩʔΧϧLLMͰLangChainಈ͔ͯ͠Έͨ ~ LangChain Meetup

    Tokyo #7 גࣜձࣾδΣωϥςΟϒΤʔδΣϯπ ԕ౻ େհ / @ruzia ಧ ͍ ͨ ʂ

  2. ࣗݾ঺հ ‣ԕ౻ େհ / @ruzia ‣δΣωϥςΟϒΤʔδΣϯπॴଐ ‣Πϯϑϥͱػցֶशܥ͕޷͖ ‣Claude CodeͲͬ΀Γ ‣ϩʔυόΠΫָ͍͠

    ‣FLUX.2ྑ͍ͧɾɾɾʂ
  3. None

  4. AIΤʔδΣϯτ͕ʮϋϒʯͱͳΓ ਓؒͱAIΤʔδΣϯτͷڠಇ͕ ౰ͨΓલʹͳΔੈքΛ࣮ݱ͢Δ

  5. None

  6. ຊ୊

  7. ຊ೔ͷ͓୊໨΍Β ‣DGX SparkͬͯͲ͏͍͏΋ͷʁ ‣ϩʔΧϧLLMͲ͏΍ͬͯಈ͔͢ʁ ‣ͱ͍͏͜ͱ͸LangChainͰϩʔΧϧLLM͕ʂ ‣ϑΟʔυόοΫ͸ #LangChainJP ·Ͱ

  8. Q DGX Sparkͬͯ ฉ͍ͨ͜ͱ͋Δਓʁ

  9. NVIDIA͕࡞ͬͨ ύʔιφϧAIίϯϐϡʔλ

  10. None

  11. ͪͳΈʹॳ୅ͷ DGX-1͸͜ΜͳαΠζײ

  12. None

  13. ॳ୅͸FP16Ͱ
 960ςϥϑϩοϓε FP4ਫ਼౓Ͱ࠷େ1ϖλϑϩοϓεͷ ԋࢉೳྗͱ128GBͷϝϞϦΛ ࣋ͪͭͭ΋ফඅిྗ͕240W ͱ͍͏Խ͚෺Ϛγϯ

  14. OS͸UbuntuΛ ΧελϜͨ͠DGX OS

  15. None

  16. ηοτΞοϓ͸ ϒϥ΢βܦ༝Ͱ΋Մೳ

  17. None
  18. None

  19. Q ϩʔΧϧLLMΛ ಈ͔ͨ͠ࣄ͕͋Δਓʁ

  20. Ollama
 Chat & build with open models

  21. OllamaΛ࢖͏ͱϩʔΧϧͰ gpt-ossͱ͔qwen3-vlͱ͔Λ ಈ͔͢ࣄ͕Ͱ͖Δ

  22. None
  23. None

  24. LangChainʹ͸Ollama༻ͷ ΠϯςάϨʔγϣϯ͕ ࣮૷͞ΕͯΔ ͳΜͱʂ

  25. “https://docs.langchain.com/oss/python/integrations/chat/ollama”

  26. ͱ͍͏͜ͱ͸ʂ LangChainͰʂ ϩʔΧϧLLM͕ʂ

  27. None

  28. $ python main.py ࢲ͸LangChain͕େ޷͖Ͱ͢ʂ

  29. None

  30. ϩʔΧϧͰ120BͷϞσϧ͕ αΫοͱಈ͔ͤΔͷ͸ ·͡Ͱ೤͍͠໘ന͍

  31. ৭ʑݴΘΕͯΔ DGX Spark͚ͩͲ
 ৮Δͱָ͍͠ʂ ເ͔͠ͳ͍ʂ

  32. ͝ਗ਼ௌ͋Γ͕ͱ͏ ͍͟͝·ͨ͠ʂ