Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Kubernetes Logging Introduction
Search
Kyohei Mizumoto
March 13, 2019
Technology
0
34
Kubernetes Logging Introduction
Kyohei Mizumoto
March 13, 2019
Tweet
Share
More Decks by Kyohei Mizumoto
See All by Kyohei Mizumoto
コンテナサプライチェーンセキュリティ
kyohmizu
1
110
サイバーセキュリティの最新動向:脅威と対策
kyohmizu
1
230
コンテナセキュリティの基本と脅威への対策
kyohmizu
4
1.5k
安全な Kubernetes 環境を目指して
kyohmizu
4
1.1k
Unlocking Cloud Native Security
kyohmizu
5
1.3k
コンテナ × セキュリティ × AWS
kyohmizu
10
3.8k
コンテナセキュリティ
kyohmizu
10
4.2k
コンテナイメージのマルウェア検出とその実用性について
kyohmizu
4
3.4k
Play with 🐐 in Kubernetes
kyohmizu
1
1.3k
Other Decks in Technology
See All in Technology
ローカルLLMを活用したコード生成と、ローコード開発ツールへの応用
kazuhitoyokoi
0
130
抽象化をするということ - 具体と抽象の往復を身につける / Abstraction and concretization
soudai
27
14k
The Future of SEO: The Impact of AI on Search
badams
0
240
Exadata Database Service on Cloud@Customer セキュリティ、ネットワーク、および管理について
oracle4engineer
PRO
1
1.5k
Building Products in the LLM Era
ymatsuwitter
10
6.1k
利用終了したドメイン名の最強終活〜観測環境を育てて、分析・供養している件〜 / The Ultimate End-of-Life Preparation for Discontinued Domain Names
nttcom
2
310
Raycast AI APIを使ってちょっと便利な拡張機能を作ってみた / created-a-handy-extension-using-the-raycast-ai-api
kawamataryo
0
150
Goで作って学ぶWebSocket
ryuichi1208
3
2.3k
データ資産をシームレスに伝達するためのイベント駆動型アーキテクチャ
kakehashi
PRO
2
600
なぜ私は自分が使わないサービスを作るのか? / Why would I create a service that I would not use?
aiandrox
0
880
人はなぜISUCONに夢中になるのか
kakehashi
PRO
6
1.7k
JEDAI Meetup! Databricks AI/BI概要
databricksjapan
0
280
Featured
See All Featured
Site-Speed That Sticks
csswizardry
4
390
Testing 201, or: Great Expectations
jmmastey
42
7.2k
How STYLIGHT went responsive
nonsquared
98
5.4k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
30
2.2k
The Cost Of JavaScript in 2023
addyosmani
47
7.3k
GitHub's CSS Performance
jonrohan
1030
460k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
45
9.4k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
366
25k
Practical Orchestrator
shlominoach
186
10k
Optimising Largest Contentful Paint
csswizardry
34
3.1k
Git: the NoSQL Database
bkeepers
PRO
427
64k
Designing Experiences People Love
moore
140
23k
Transcript
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 1/31 Kubernetes Logging Introduction 1
/ 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 2/31 Kyohei Mizumoto(@kyohmizu) C# Software
Engineer Interests Docker/Kubernetes Go Security whoami 2 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 3/31 Required Kubernetesの概要程度の知識 Targets Kubernetes
Logging未経験者 3 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 4/31 Contents 1. Logging Overview
2. Fluentd 3. Get Started with GKE 4. Demo 5. Other Services 4 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 5/31 Logging Overview 5 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 6/31 6 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 7/31 Logging 標準出⼒と標準エラー出⼒にログを出⼒ "kubectl logs"コマンドで表⽰
安定保存のため、ログを集約して外部に転送 7 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 8/31 kubectl logs $ kubectl
logs kube-dns-[num] -c kubedns -n kube-system 8 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 9/31 Landscape 9 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 10/31 Fluentd 10 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 11/31 CNCFがホストするプロジェクト DaemonSetを利⽤ 標準出⼒ログを読み出して転送 Fluentd
11 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 12/31 Before Fluentd 12 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 13/31 After Fluentd 13 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 14/31 Architecture Unified Logging with
JSON プロセス(収集、フィルタリング、出⼒)の統⼀ Pluggable Architecture フレキシブルな⼊出⼒プラグイン Minimum Resources Required Built-in Reliability バッファ、フェイルオーバーによるHA構成 14 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 15/31 Forward To CloudWatch Elasticsearch
Google Cloud Storage(GCS) Graylog Kafka Kinesis Amazon S3 Stackdriver Syslog etc... 15 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 16/31 Get Started 公式イメージ 16
/ 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 17/31 Get Started with GKE
17 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 18/31 Get Started with GKE
GKEではリソース作成済み $ kubectl get po -n kube-system | grep fluentd // 結果は⼀部省略 fluentd-gcp-scaler-8b674f786-jc4wk 1/1 Running fluentd-gcp-v3.2.0-4hqm6 2/2 Running fluentd-gcp-v3.2.0-m5p49 2/2 Running fluentd-gcp-v3.2.0-x6rlq 2/2 Running 18 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 19/31 Stackdriver Real-time Log Management
and Analysis Seamlessly Resolve Issues Scalable and Fully Managed All Your Cloud Logs In One Place Real Time Insights 19 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 20/31 Stackdriver Monitoring 20 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 21/31 Stackdriver Logs Viewer 21
/ 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 22/31 Demo 22 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 23/31 Other Services 23 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 24/31 SaaS型の監視&解析ツール 課⾦制 様々なサービスのメトリクスをシー ムレスに集約
Datadog 24 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 25/31 Log Explorer 25 /
31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 26/31 Log Management Datadog Agent
がログを収集 DaemonSet for Kubernetes 暗号化通信を使⽤してデータを送信 ログのFiltering、Monitoring、Alert機能 Custom Logs 26 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 27/31 Fluent Bit シンプルかつ軽量なFluentd 既存のプラグインは使⽤不可
27 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 28/31 Books 28 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 29/31 Links The Twelve-Factor App
https://12factor.net/ Fluentd https://www.fluentd.org/ Fluent Bit https://fluentbit.io/ Stackdriver Logging https://cloud.google.com/logging/ Datadog https://www.datadoghq.com/ 29 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 30/31 Others fluentd-gcp-scaler のコードについて調べたので、 Qiita記事を投稿しました。
https://qiita.com/kyohmizu/items/cbf9cca76a826d8eb130 30 / 31
2019/3/28 Kubernetes Logging Introduction 127.0.0.1:5500/#4 31/31 Thank you! 31 /
31