Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Kubernetes Logging Introduction
Search
Kyohei Mizumoto
March 13, 2019
Technology
0
24
Kubernetes Logging Introduction
Kyohei Mizumoto
March 13, 2019
Tweet
Share
More Decks by Kyohei Mizumoto
See All by Kyohei Mizumoto
安全な Kubernetes 環境を目指して
kyohmizu
4
620
Unlocking Cloud Native Security
kyohmizu
5
850
コンテナ × セキュリティ × AWS
kyohmizu
10
3.2k
コンテナセキュリティ
kyohmizu
10
3.8k
コンテナイメージのマルウェア検出とその実用性について
kyohmizu
4
2k
Play with 🐐 in Kubernetes
kyohmizu
1
1k
Security Command Center × PagerDuty 自動アラート通知の取り組み
kyohmizu
0
440
サイバー攻撃から Kubernetes クラスタを守るための効果的なセキュリティ対策
kyohmizu
13
3.2k
脆弱性に学ぶコンテナセキュリティ
kyohmizu
4
2.4k
Other Decks in Technology
See All in Technology
OpenTelemetry実践 はじめの一歩
taxin
0
300
家族アルバム みてねで直面してきた技術的負債 / MIXI KAG 2024
isaoshimizu
17
7.7k
複数の LLM モデルを扱う上で直面した辛みまとめ
kazuyaseki
1
220
Introduction to Jetpack Compose
pohjus
1
110
チーム単位で保守性を高める:独自指標と向上にむけた実践
tarappo
0
300
サービス成長と共に肥大化するモノレポ、長くなるCI時間 / As services grow, monorepos get bigger and CI time gets longer
kohbis
5
2k
KubeCon EU 2024 : Knative Maintainers Session
salaboy
0
360
2023 Japan AWS Jr.Championsに選出されての振り返りとこれから
hiropy877
1
130
Kubeflow Pipelines v2 で変わる機械学習パイプライン開発
asei
4
330
技育祭2024春 LT Finatextホールディングス
kevinrobot34
1
160
やっていきテスト
k6s4i53rx
0
160
マイクロサービス環境におけるDB戦略 in DMMプラットフォーム
pospome
11
3k
Featured
See All Featured
A better future with KSS
kneath
230
16k
BBQ
matthewcrist
78
8.7k
How To Stay Up To Date on Web Technology
chriscoyier
781
250k
Building Better People: How to give real-time feedback that sticks.
wjessup
350
18k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
225
51k
How to Ace a Technical Interview
jacobian
272
22k
We Have a Design System, Now What?
morganepeng
42
6.7k
Designing for Performance
lara
601
67k
Documentation Writing (for coders)
carmenintech
59
3.8k
Building a Scalable Design System with Sketch
lauravandoore
455
32k
The Mythical Team-Month
searls
214
42k
Facilitating Awesome Meetings
lara
39
5.5k
Transcript
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 1/31 Kubernetes Logging Introduction 1
/ 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 2/31 Kyohei Mizumoto(@kyohmizu) C# Software
Engineer Interests Docker/Kubernetes Go Security whoami 2 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 3/31 Required Kubernetesの概要程度の知識 Targets Kubernetes
Logging未経験者 3 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 4/31 Contents 1. Logging Overview
2. Fluentd 3. Get Started with GKE 4. Demo 5. Other Services 4 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 5/31 Logging Overview 5 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 6/31 6 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 7/31 Logging 標準出⼒と標準エラー出⼒にログを出⼒ "kubectl logs"コマンドで表⽰
安定保存のため、ログを集約して外部に転送 7 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 8/31 kubectl logs $ kubectl
logs kube-dns-[num] -c kubedns -n kube-system 8 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 9/31 Landscape 9 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 10/31 Fluentd 10 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 11/31 CNCFがホストするプロジェクト DaemonSetを利⽤ 標準出⼒ログを読み出して転送 Fluentd
11 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 12/31 Before Fluentd 12 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 13/31 After Fluentd 13 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 14/31 Architecture Unified Logging with
JSON プロセス(収集、フィルタリング、出⼒)の統⼀ Pluggable Architecture フレキシブルな⼊出⼒プラグイン Minimum Resources Required Built-in Reliability バッファ、フェイルオーバーによるHA構成 14 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 15/31 Forward To CloudWatch Elasticsearch
Google Cloud Storage(GCS) Graylog Kafka Kinesis Amazon S3 Stackdriver Syslog etc... 15 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 16/31 Get Started 公式イメージ 16
/ 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 17/31 Get Started with GKE
17 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 18/31 Get Started with GKE
GKEではリソース作成済み $ kubectl get po -n kube-system | grep fluentd // 結果は⼀部省略 fluentd-gcp-scaler-8b674f786-jc4wk 1/1 Running fluentd-gcp-v3.2.0-4hqm6 2/2 Running fluentd-gcp-v3.2.0-m5p49 2/2 Running fluentd-gcp-v3.2.0-x6rlq 2/2 Running 18 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 19/31 Stackdriver Real-time Log Management
and Analysis Seamlessly Resolve Issues Scalable and Fully Managed All Your Cloud Logs In One Place Real Time Insights 19 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 20/31 Stackdriver Monitoring 20 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 21/31 Stackdriver Logs Viewer 21
/ 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 22/31 Demo 22 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 23/31 Other Services 23 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 24/31 SaaS型の監視&解析ツール 課⾦制 様々なサービスのメトリクスをシー ムレスに集約
Datadog 24 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 25/31 Log Explorer 25 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 26/31 Log Management Datadog Agent
がログを収集 DaemonSet for Kubernetes 暗号化通信を使⽤してデータを送信 ログのFiltering、Monitoring、Alert機能 Custom Logs 26 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 27/31 Fluent Bit シンプルかつ軽量なFluentd 既存のプラグインは使⽤不可
27 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 28/31 Books 28 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 29/31 Links The Twelve-Factor App
https://12factor.net/ Fluentd https://www.fluentd.org/ Fluent Bit https://fluentbit.io/ Stackdriver Logging https://cloud.google.com/logging/ Datadog https://www.datadoghq.com/ 29 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 30/31 Others fluentd-gcp-scaler のコードについて調べたので、 Qiita記事を投稿しました。
https://qiita.com/kyohmizu/items/cbf9cca76a826d8eb130 30 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 31/31 Thank you! 31 /
31