Upgrade to Pro — share decks privately, control downloads, hide ads and more …

fluentdサーバをchefで構築するの辛かったけどDockerも別に救世主じゃなかった ...

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for h3poteto h3poteto
July 29, 2018
Technology
5.1k
0

fluentdサーバをchefで構築するの辛かったけどDockerも別に救世主じゃなかった / tokyu ruby kaigi 12

fluentdのchefメンテまじで辛い，どうせみんなcookbookとか忘れたでしょ

Avatar for h3poteto

h3poteto

July 29, 2018

More Decks by h3poteto

See All by h3poteto
EKS on Fargateは最高のJob基盤 / jawsug_bgnr
Avatar for h3poteto h3poteto
1
1k
Kubernetes上で単発のジョブを実行するkube-jobというツールを作った / kubernetesmeetuptokyo22
Avatar for h3poteto h3poteto
6
8.8k
Electronによるアプリケーション開発事情2018 / builderscon2018
Avatar for h3poteto h3poteto
9
11k
ECSのサービスをslack botでデプロイする // ecs-goploy
Avatar for h3poteto h3poteto
1
5.8k
まだRailsで消耗してるの？
Avatar for h3poteto h3poteto
7
4.9k
阿澄佳奈と昇竜拳
Avatar for h3poteto h3poteto
1
550

Other Decks in Technology

See All in Technology
社内エンジニア勉強会の醍醐味と苦しみ/tamadev
Avatar for Ichiro Nishiuma nishiuma
0
230
ネットワーク運用を楽にするAWS DevOps Agent活用法！！ / 20260421 Masaki Okuda
Avatar for SHIFT EVOLVE shift_evolve
PRO
2
220
EBS暗号化に失敗してEC2が動かなくなった話
Avatar for Moe Hamaguchi hamaguchimmm
2
210
ハーネスエンジニアリングの概要と設計思想
Avatar for sergicalsix sergicalsix
9
5.3k
Revisiting [CLS] and Patch Token Interaction in Vision Transformers
Avatar for yu4u yu4u
0
390
LLM時代の検索アーキテクチャと技術的意思決定
Avatar for shibuiwilliam shibuiwilliam
3
1.5k
AndroidアプリとCopilot Studioの統合
Avatar for なかしょ nakasho
0
120
国内外の生成AIセキュリティの最新動向 & AIガードレール製品「chakoshi」のご紹介 / Latest Trends in Generative AI Security (Domestic & International) & Introduction to AI Guardrail Product "chakoshi"
Avatar for NTT docomo Business nttcom
4
1.4k
目的ファーストのハーネス設計 ~ハーネスの変更容易性を高めるための優先順位~
Avatar for Gota gotalab555
8
2.3k
AIを共同作業者にして書籍を執筆する方法 / How to Write a Book with AI as a Co-Creator
Avatar for ama-ch ama_ch
2
150
Claude Code を安全に使おう勉強会 / Claude Code Security Basics
Avatar for MasahiroKawahara masahirokawahara
12
36k
コミュニティ・勉強会を作るのは目的じゃない
Avatar for uutan1108 ohmori_yusuke
0
250

Featured

See All Featured
How to make the Groovebox
Avatar for あそなす asonas
2
2.1k
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
440
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
190
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
Applied NLP in the Age of Generative AI
Avatar for Ines Montani inesmontani
PRO
4
2.2k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
6
35k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
360
30k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
510
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
320
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
260
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
9.9k
Navigating Algorithm Shifts & AI Overviews - #SMXNext
Avatar for Aleyda Solis aleyda
1
1.2k

Transcript

  1. fluentdαʔόΛchefͰߏங͢Δ ͷਏ͔͚ͬͨͲDocker΋ผʹٹ ੈओ͡Όͳ͔ͬͨ @h3_poteto

  2. ࣗݾ঺հ • Akira Fukushimaʢ෱ౡ ໌ʣ • github: h3poteto • twitter:

    h3_poteto • ࢓ࣄɿterraform৬ਓ@scouty

  3. એ఻

  4. None
  5. None

  6. એ఻ऴΘΓ

  7. fluentdαʔόΛchefͰߏங͢Δͷਏ͔ͬ ͚ͨͲDocker΋ผʹٹੈओ͡Όͳ͔ͬͨ ָԂͰ͢ɼࠓ͙͢Dockerʹ͠·͠ΐ͏ @h3_poteto

  8. ղܾࡦ͕Θ͔Βͳ͍ͬͯ࿩Λ ͠Α͏ͱࢥͬͯͨͷʹɼ ղܾࡦ͕ݟ͔ͭͬͯ͠·ͬͨ

  9. Έͳ͞Μ ϩάͷू໿ʹfluentd ࢖ͬͯ·͢ΑͶʁ

  10. None

  11. ͜Εͷ࿩

  12. aggregatorͷfluentdΛ chefͰߏங͍ͯͨ͠

  13. Έͳ͞Μchefͷ͜ͱ ֮͑ͯ·͔͢ʁ

  14. None

  15. chefͭΒ͍ • immutable infra? • ͨ·ʹࣦഊ͢Δ • ΈΜͳ΋͏cookbookͷϝϯςͯ͠ͳ͍Ͱ ͠ΐʁ

  16. chef-td-agent΋͋Δ

  17. td-agentͷcookbook಺Ͱ͸ yum install͍ͯ͠Δ

  18. ͳͷʹamazon linux ͨ·ʹݹ͍yumϦϙδτϦΛ ফͯ͘͠Δ

  19. ͋Δ೔ಥવ Կ΋ͯ͠ͳ͍ͷʹ ಈ͔ͳ͘ͳΔʂ

  20. fluentd v0.12ܥΛ ӡ༻ͯͨ͠ࠒͷ࿩

  21. td-agentͷґଘʹؒҧ͑ͯ v0.14ܥͷgem͕ࠞೖͨ͠

  22. None

  23. amazon linuxͷyum ฏવͱtd-agent 2.3.5ʹߋ৽ ͞ΕΔ

  24. ͔͠΋2.3.4͕ফ͞ΕΔ

  25. ͜ͷޙ1ϲ݄ۙ͘yum͸ v2.3.5ͷ·· ߋ৽͞Εͳ͔ͬͨ

  26. ͢΂ͯͷΠϯελϯεͰchef ͷprovision͕ࣦഊ͢Δ

  27. ͭΒ͍

  28. chefࣗମͷόʔδϣϯΞοϓ Λ΍ͬͨͱ͖

  29. ࠓ·Ͱrhelͱ൑ఆ͞Ε͍ͯͨ amazon linuxɼ৽ͨʹ amazonͱ͍͏ࣝผࢠΛ৽ઃ ͞ΕΔ

  30. platformͷ൑ఆΛ͍ͯͨ͠ cookbook͕΄ͱΜͲ࢖͍෺ ʹͳΒͳ͍

  31. None

  32. ࢓ํͳ͍ͷͰҰͭͣͭमਖ਼ͷ Pull Request

  33. ͚ͩͲະͩʹϦϦʔε͞Εͯ ͍ͳ͍΋ͷ΋͋Δ

  34. None
  35. None

  36. Ͳ͏ͤ΋͏ΈΜͳcookbook ͷϝϯςͯ͠ͳ͍Ͱ͠ΐ……

  37. ͭΒ͍

  38. ࣮͸΋͏ΈΜͳDockerͰ ӡ༻ͯ͠Δͷʁ ͔ͩΒchefϝϯς ͯ͠ͳ͍ͷʁ

  39. গͳ͘ͱ΋Ξοϓσʔτ͸ chefΑΓසൟ

  40. σϓϩΠ࣌ͷBuffer Ͳ͏͢Μͷʁ ؾʹͳΔͱ͜Ζ……

  41. None

  42. Memory or File ?

  43. Ͳͬͪ΋ίϯςφࡴͨ͠Β ফ͑Δ͡ΌΜʂ ͯࢥͬͯͨΜ͚ͩͲ……

  44. flush_at_shutdown

  45. flush_at_shutdown • SIGTERMΛड͚औͬͨͱ͖ʹBufferΛflush • flush׬ྃ·Ͱtd-agent͕଴͔ͬͯΒऴྃ • buf_memoryͰ͸σϑΥϧτͰ༗ޮ • SIGKILLͷͱ͖͸ޮ͔ͳ͍

  46. ߟ͑ͯͨ͜ͱ • k8sͷPersistentVolumesͰNFSʢ΋͘͠͸ EBSʣΛvolumeϚ΢ϯτ͢Δ • k8sͷPreStopͰbufferΛS3ʹΞοϓϩʔυ͢ Δ • fluentdΫϥελ2ܥ౷࡞Δʁ

  47. શ෦͍Βͳ͔ͬͨʂ flush_at_shutdownͰk8sʹ ͦͷ··৐ͤΕ͹ྑ͍ʂ

  48. SIGKILLΛ΋Β͏ͱ͖΋͋Δ • td-agentɼtimeoutҎ಺ʹflush࢓੾Βͳ͍ͱऴ ྃ͠ͳ͍ • k8sͷGracePeriodSecondsҎ಺ʹίϯςφ͕ ऴྃ͠ͳ͍ͱSIGKILL

  49. ͜Ε͸ྲྀྔͱͷ݉Ͷ߹͍

  50. ৗʹਖ਼ৗऴྃͰ͖ͳ͍ͷͰ͋ Ε͹ɼbufferͷઃఆ΍output ͷεϨου౳Λௐઅͨ͠ํ͕ ͍͍͔΋

  51. fluentd on Docker͸ ָԂͰ͋Δ

  52. chefΛࣺͯͯDockerʹߦ͜͏