Upgrade to Pro — share decks privately, control downloads, hide ads and more …

LLMOps Operationalizing Large Language Models f...

Avatar for Raj Raj
March 28, 2025
Technology
88
0

LLMOps Operationalizing Large Language Models for the Real World

LLMOps Operationalizing Large Language Models for the Real World

Avatar for Raj

Raj

March 28, 2025

More Decks by Raj

See All by Raj
A Software Engineer’s Guide to Raising Future-Ready Kids
Avatar for Raj rajkumarsakthi
0
160
Power of Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
140
Minimalism in DevOps 2023
Avatar for Raj rajkumarsakthi
0
180
Are You a Modern Software Engineer?
Avatar for Raj rajkumarsakthi
0
59
Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
89
Are You are a Modern DevOps Engineer?🤔
Avatar for Raj rajkumarsakthi
0
73
PHP Vegas : Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
2
110
PHP & Coding : Modern Software Developer
Avatar for Raj rajkumarsakthi
0
200
Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
0
120

Other Decks in Technology

See All in Technology
Generative UI × A2UI で AI エージェントを作った話　AI-DLC も使ってみた！
Avatar for たけのこ kmiya84377
1
290
APIテストとは？
Avatar for 草薙昭彦 nagix
0
160
電子辞書Brainをネットに繋げてみた(自力編)
Avatar for らすぴー raspython3
0
370
権限管理設計を完全に理解した
Avatar for r-sugi rsugi
2
240
美味しいスイスチーズを作ろう🧀🐭
Avatar for Taiga Mikami taigamikami
1
190
20260528_生成AIを専属DSに_Howの次にすべきことを考える
Avatar for NobuakiOshiro doradora09
PRO
0
270
ITエンジニアを取り巻く環境とキャリアパス / A career path for Japanese IT engineers
Avatar for 高玉 広和 / TAKATAMA Hirokazu takatama
4
1.8k
Agentic AI時代における メルカリのAIガバナンスとガードレール実装
Avatar for ichihara naoichihara
16
17k
TROCCOで始めるクラウドコストを民主化するためのFinOps
Avatar for Hiroki Takatsuka tk3fftk
1
460
Javaで学ぶSOLID原則
Avatar for Negima negima
1
240
Anthropic AIネイティブ・スタートアップ構築のプレイブック を理解する
Avatar for 長津孝輔 nagatsu
0
230
個人の発見を、組織の知恵に 〜生成AI活用を"探索"から"組織の仕組み"へ〜
Avatar for KintoTech_Dev kintotechdev
2
180

Featured

See All Featured
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.2k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
21k
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
200
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.5k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
274
21k
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
570
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
3k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
378
71k
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
310
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
11
38k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
26k

Transcript

  1. LLMOps Operationalizing Large Language Models for the Real World

  2. Hello! I’m Raj 😊 I ❤ to design & develop

    modern software

  3. About me Rajkumar Sakthivel (Raj) Senior Pro Dev @ Tesco

    Technology Founder @ tessellit_uk @rajkumarsakthi

  4. LLMOps Operationalizing Large Language Models for the Real World

  5. AI Disaster

  6. None
  7. None
  8. None
  9. None
  10. None
  11. None

  12. Cost

  13. None

  14. Real-World Challenges

  15. Hallucinations & Safety

  16. Cost Management

  17. Model Drift

  18. Security

  19. Best Practices

  20. RAG Workflow Rule 1: Start with RAG & Fine tune

    later

  21. Prompt Versioning: Rule 2: Treat prompts like code diff tool

    showing how changing ‘Summarize’ to ‘TLDR’ boosted accuracy

  22. GPU Optimization: Rule 3: Right-size GPUs Use A100s for training,

    T4s for inference
  23. None

  24. LLMOps bridges the prototype-to-production gap. Start small, monitor obsessively, and

    never trust an LLM alone with customers.

  25. Any Questions? 😊