Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Search
Daichi Hirata
April 23, 2016
Technology
3
5.9k
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Daichi Hirata
April 23, 2016
Tweet
Share
More Decks by Daichi Hirata
See All by Daichi Hirata
GCPのネットワークでハマった話
daic_h
7
4k
Ruby
daic_h
0
110
Git workshop
daic_h
2
9.6k
Other Decks in Technology
See All in Technology
SRE × マネジメントレイヤーが挑戦した組織・会社のオブザーバビリティ改革 ― ビジネス価値と信頼性を両立するリアルな挑戦
coconala_engineer
0
290
コンパウンド組織のCRE #cre_meetup
layerx
PRO
1
280
Dify on AWS 環境構築手順
yosse95ai
0
150
様々なファイルシステム
sat
PRO
0
260
webpack依存からの脱却!快適フロントエンド開発をViteで実現する #vuefes
bengo4com
4
3.6k
現場の壁を乗り越えて、 「計装注入」が拓く オブザーバビリティ / Beyond the Field Barriers: Instrumentation Injection and the Future of Observability
aoto
PRO
1
650
ラスベガスの歩き方 2025年版(re:Invent 事前勉強会)
junjikoide
0
450
AIプロダクトのプロンプト実践テクニック / Practical Techniques for AI Product Prompts
saka2jp
0
120
MCP ✖️ Apps SDKを触ってみた
hisuzuya
0
390
ヘンリー会社紹介資料(エンジニア向け) / company deck for engineer
henryofficial
0
410
マルチエージェントのチームビルディング_2025-10-25
shinoyamada
0
200
AWSが好きすぎて、41歳でエンジニアになり、AAIを経由してAWSパートナー企業に入った話
yama3133
1
120
Featured
See All Featured
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
55
3k
Why You Should Never Use an ORM
jnunemaker
PRO
59
9.6k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
49
3.1k
RailsConf 2023
tenderlove
30
1.3k
KATA
mclloyd
PRO
32
15k
Making the Leap to Tech Lead
cromwellryan
135
9.6k
How to Ace a Technical Interview
jacobian
280
24k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.1k
Into the Great Unknown - MozCon
thekraken
40
2.1k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
34
2.5k
How STYLIGHT went responsive
nonsquared
100
5.9k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
31
2.7k
Transcript
&MBTUJD#FBUΛಋೖͯ͠Έͨ (P$POGFSFODF4QSJOH %BJDIJ)*3"5" $ZCFS"HFOU *OD
w גࣜձࣾαΠόʔΤʔδΣϯτ "EUFDI4UVEJP ॴଐ w %BJDIJ)*3"5"!EBJDIJME w (P 3VCZ ࣗݾհ
None
"HFOEB w &MBTUJD#FBUTʹ͍ͭͯ w #FBUTͷ࡞Γํ w ߏͱɺ,JCBOBʹදࣔ͢Δ·Ͱ
None
&MBTUJD#FBUT w %BUB4IJQQFSTGPS&MBTUJDTFBSDI w &MBTUJDTFBSDI͚ͷ+40/Λग़ྗ w (P #JOBSZ w
3VOUJNFͷґଘੑ͕ແ͍ w ܰྔͰγϯϓϧ
&MBTUJD#FBUT
0GGJDJBM#FBUT w 1BDLFUCFBU w 5PQCFBU w 'JMFCFBU w 8JOMPHCFBU
1BDLFUCFBU
1BDLFUCFBU • )551 • .Z42- • 1PTUHSF42- • 3FEJT •
5ISJGU31$ • .POHP%# • %/4 • .FNDBDIF
5PQCFBU
'JMFCFBU
8JOMPHCFBU
$PNNVOJUZ#FBUT w "QBDIFCFBU w /HJOYCFBU w %PDLFSCFBU w )551CFBU w
/BHJPTDIFDLCFBU w FUDʜ
࣮ࡍʹ͔ͭͬͯΈͨ
"QBDIF,BGLB • -JOLFE*O͔Βެ։͞Εͨࢄϝοηʔδϯά γεςϜ • #SPLFS $MVTUFS 1SPEVDFS $POTVNFSͷ ͭͷίϯϙʔωϯτͰߏ͞ΕΔ
"QBDIF,BGLB • ϦΞϧλΠϜʹॲཧΛߦ͏ετϦʔϜܥͷॲཧͱɺ େ͖ͳεύΠΫ͕ൃੜ͢ΔॲཧͷҰ࣍ड͚ͱͯ͠ ༻
1BSUJUJPO0GGTFU $POTVNFS(SPVQ
1BSUJUJPO0GGTFU -BH
ϞχλϦϯάπʔϧ • ZBIPPLBGLBNBOBHFS • RVBOUJpOE,BGLB0⒎TFU.POJUPS • MJOLFEJO#VSSPX
ϞχλϦϯάπʔϧ • WҎ߱ͷ৽͍͠0⒎TFU4UPSFͷରԠ͕· ͪ·ͪ • 0⒎TFUͷऔಘํ๏͕ͪΐͬͱඍົ • LJCBOBΛͬͨΞΫηεϩάͷࢹڥ͕ط ʹ͋ΔͷͰɺಉ͡ॴͰݟΕΔΑ͏ʹ͍ͨ͠
LBGLBCFBU
LBGLBCFBU • 4IPQJGZTBSBNBΛͬͯ#JOBSZ"1*Λ͋Ε ͜ΕݺΜͰ0⒎TFUΛऔಘ • +PMPLJB +.9XJUI+40/PWFS)551 ܦ༝Ͱ#SPLFS෦ͷใΛऔಘ
FMBTUJDCFBUHFOFSBUPS $ cookiecutter https://github.com/elastic/beat-generator.git
FMBTUJDCFBUHFOFSBUPS ɾbeater/kafkabeat.go ɾconfig/config.go ɾetc/beat.yml ͜ͷ̏ͭΛฤू͢Δ
FMBTUJDCFBUHFOFSBUPS ϥΠϒϥϦͷཧʹglide
Configuration Logging Daemon / Service Publisher Beat custom logic events
channel libbeat … MJCCFBU0WFSWJFX beater
#FBUFSJOUFSGBDF • #FBUFS͕Δ͖͜ͱ • 4USBUFHZύλʔϯ
$POGJH.FUIPE • ઃఆϑΝΠϧͷಡΈࠐΈ • $-*ϑϥάͷϋϯυϦϯά
$POGJH.FUIPE
$POGJH.FUIPE
4FUVQ.FUIPE • ϝΠϯϧʔϓલͷॳظԽॲཧ • ΫϥΠΞϯτͷଓͱ͔͜͜Ͱߦ͏
4FUVQ.FUIPE
3VO.FUIPE • ϝΠϯϧʔϓ • σʔλͷऩू • 1VCMJTIFSͷૹ৴ • γάφϧϋϯυϦϯάͳͲMJCCFBUʹ͓ͤ
3VO.FUIPE
None
$MFBOVQ.FUIPE • 3VOΛൈ͚ͨޙʹݺΕΔ • ֬อͨ͠Ϧιʔεͷ։์ͳͲΛߦ͏
4UPQ.FUIPE • 3VOͰγάφϧΛड͚ΔͱݺΕΔ • ϝΠϯϧʔϓΛࢭΊΔҝͷॲཧΛߦ͏ • ىಈͨ͠HPSPVUJOFͷఀࢭ
EFWUPPMT • JOEFYUFNQMBUFHFOFSBUPS • EPDVNFOUHFOFSBUPS • CFBUQBDLFS • %PDLFSΛͬͯDSPTTDPNQJMJOHͱQBDLBHJOH EFCɾSQNɾXJOɾPTY
• ,JCBOB%BTICPBSEFYQPSUJNQPSU • FUD
Kafka Consumer Log Store Kafka Broker Kafka Broker in_tail GCE
VPN elasticsearch elasticsearch kibana fluentd ߏ
,JCBOB%BTICPBSE
·ͱΊ • (PͷܰྔɾߴɾϙʔλϏϦςΟ#FBUͷΑ ͏ͳ"HFOUʹඇৗʹϚον͢Δ • &MBTUJDTFBSDI ,JCBOBͷڥ͕͋Ε͙͢ ʹͰ࢝ΊΒΕΔ͓खܰ͞ • ڞ௨෦Λ͏·͘Γग़͠γϯϓϧʹอͬͯ
͍ΔͨΊɺಠࣗͷ#FBUΛ࡞Δͷ͕؆୯
·ͱΊ • LBGLBCFBU044Խ༧ఆͰ͢ • ؒʹ߹͍·ͤΜͰͨ͠N @@ N
(P($1Λͬͨ։ൃ͕͍ͨ͠ਓʂ