Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Search
Daichi Hirata
April 23, 2016
Technology
3
5.9k
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Daichi Hirata
April 23, 2016
Tweet
Share
More Decks by Daichi Hirata
See All by Daichi Hirata
GCPのネットワークでハマった話
daic_h
7
4k
Ruby
daic_h
0
110
Git workshop
daic_h
2
9.5k
Other Decks in Technology
See All in Technology
Amazon ECS & AWS Fargate 運用アーキテクチャ2025 / Amazon ECS and AWS Fargate Ops Architecture 2025
iselegant
16
5.5k
Observability в PHP без боли. Олег Мифле, тимлид Altenar
lamodatech
0
340
地図も、未来も、オープンに。 〜OSGeo.JPとFOSS4Gのご紹介〜
wata909
0
110
変化する開発、進化する体系時代に適応するソフトウェアエンジニアの知識と考え方(JaSST'25 Kansai)
mizunori
1
210
SalesforceArchitectGroupOsaka#20_CNX'25_Report
atomica7sei
0
170
Navigation3でViewModelにデータを渡す方法
mikanichinose
0
220
Liquid Glass革新とSwiftUI/UIKit進化
fumiyasac0921
0
210
フィンテック養成勉強会#54
finengine
0
180
M3 Expressiveの思想に迫る
chnotchy
0
100
生成AI時代の開発組織・技術・プロセス 〜 ログラスの挑戦と考察 〜
itohiro73
0
130
Fabric + Databricks 2025.6 の最新情報ピックアップ
ryomaru0825
1
130
第9回情シス転職ミートアップ_テックタッチ株式会社
forester3003
0
230
Featured
See All Featured
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.5k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Writing Fast Ruby
sferik
628
61k
Making the Leap to Tech Lead
cromwellryan
134
9.3k
Faster Mobile Websites
deanohume
307
31k
Statistics for Hackers
jakevdp
799
220k
GraphQLとの向き合い方2022年版
quramy
48
14k
It's Worth the Effort
3n
185
28k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
35
2.3k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
10
930
Transcript
&MBTUJD#FBUΛಋೖͯ͠Έͨ (P$POGFSFODF4QSJOH %BJDIJ)*3"5" $ZCFS"HFOU *OD
w גࣜձࣾαΠόʔΤʔδΣϯτ "EUFDI4UVEJP ॴଐ w %BJDIJ)*3"5"!EBJDIJME w (P 3VCZ ࣗݾհ
None
"HFOEB w &MBTUJD#FBUTʹ͍ͭͯ w #FBUTͷ࡞Γํ w ߏͱɺ,JCBOBʹදࣔ͢Δ·Ͱ
None
&MBTUJD#FBUT w %BUB4IJQQFSTGPS&MBTUJDTFBSDI w &MBTUJDTFBSDI͚ͷ+40/Λग़ྗ w (P #JOBSZ w
3VOUJNFͷґଘੑ͕ແ͍ w ܰྔͰγϯϓϧ
&MBTUJD#FBUT
0GGJDJBM#FBUT w 1BDLFUCFBU w 5PQCFBU w 'JMFCFBU w 8JOMPHCFBU
1BDLFUCFBU
1BDLFUCFBU • )551 • .Z42- • 1PTUHSF42- • 3FEJT •
5ISJGU31$ • .POHP%# • %/4 • .FNDBDIF
5PQCFBU
'JMFCFBU
8JOMPHCFBU
$PNNVOJUZ#FBUT w "QBDIFCFBU w /HJOYCFBU w %PDLFSCFBU w )551CFBU w
/BHJPTDIFDLCFBU w FUDʜ
࣮ࡍʹ͔ͭͬͯΈͨ
"QBDIF,BGLB • -JOLFE*O͔Βެ։͞Εͨࢄϝοηʔδϯά γεςϜ • #SPLFS $MVTUFS 1SPEVDFS $POTVNFSͷ ͭͷίϯϙʔωϯτͰߏ͞ΕΔ
"QBDIF,BGLB • ϦΞϧλΠϜʹॲཧΛߦ͏ετϦʔϜܥͷॲཧͱɺ େ͖ͳεύΠΫ͕ൃੜ͢ΔॲཧͷҰ࣍ड͚ͱͯ͠ ༻
1BSUJUJPO0GGTFU $POTVNFS(SPVQ
1BSUJUJPO0GGTFU -BH
ϞχλϦϯάπʔϧ • ZBIPPLBGLBNBOBHFS • RVBOUJpOE,BGLB0⒎TFU.POJUPS • MJOLFEJO#VSSPX
ϞχλϦϯάπʔϧ • WҎ߱ͷ৽͍͠0⒎TFU4UPSFͷରԠ͕· ͪ·ͪ • 0⒎TFUͷऔಘํ๏͕ͪΐͬͱඍົ • LJCBOBΛͬͨΞΫηεϩάͷࢹڥ͕ط ʹ͋ΔͷͰɺಉ͡ॴͰݟΕΔΑ͏ʹ͍ͨ͠
LBGLBCFBU
LBGLBCFBU • 4IPQJGZTBSBNBΛͬͯ#JOBSZ"1*Λ͋Ε ͜ΕݺΜͰ0⒎TFUΛऔಘ • +PMPLJB +.9XJUI+40/PWFS)551 ܦ༝Ͱ#SPLFS෦ͷใΛऔಘ
FMBTUJDCFBUHFOFSBUPS $ cookiecutter https://github.com/elastic/beat-generator.git
FMBTUJDCFBUHFOFSBUPS ɾbeater/kafkabeat.go ɾconfig/config.go ɾetc/beat.yml ͜ͷ̏ͭΛฤू͢Δ
FMBTUJDCFBUHFOFSBUPS ϥΠϒϥϦͷཧʹglide
Configuration Logging Daemon / Service Publisher Beat custom logic events
channel libbeat … MJCCFBU0WFSWJFX beater
#FBUFSJOUFSGBDF • #FBUFS͕Δ͖͜ͱ • 4USBUFHZύλʔϯ
$POGJH.FUIPE • ઃఆϑΝΠϧͷಡΈࠐΈ • $-*ϑϥάͷϋϯυϦϯά
$POGJH.FUIPE
$POGJH.FUIPE
4FUVQ.FUIPE • ϝΠϯϧʔϓલͷॳظԽॲཧ • ΫϥΠΞϯτͷଓͱ͔͜͜Ͱߦ͏
4FUVQ.FUIPE
3VO.FUIPE • ϝΠϯϧʔϓ • σʔλͷऩू • 1VCMJTIFSͷૹ৴ • γάφϧϋϯυϦϯάͳͲMJCCFBUʹ͓ͤ
3VO.FUIPE
None
$MFBOVQ.FUIPE • 3VOΛൈ͚ͨޙʹݺΕΔ • ֬อͨ͠Ϧιʔεͷ։์ͳͲΛߦ͏
4UPQ.FUIPE • 3VOͰγάφϧΛड͚ΔͱݺΕΔ • ϝΠϯϧʔϓΛࢭΊΔҝͷॲཧΛߦ͏ • ىಈͨ͠HPSPVUJOFͷఀࢭ
EFWUPPMT • JOEFYUFNQMBUFHFOFSBUPS • EPDVNFOUHFOFSBUPS • CFBUQBDLFS • %PDLFSΛͬͯDSPTTDPNQJMJOHͱQBDLBHJOH EFCɾSQNɾXJOɾPTY
• ,JCBOB%BTICPBSEFYQPSUJNQPSU • FUD
Kafka Consumer Log Store Kafka Broker Kafka Broker in_tail GCE
VPN elasticsearch elasticsearch kibana fluentd ߏ
,JCBOB%BTICPBSE
·ͱΊ • (PͷܰྔɾߴɾϙʔλϏϦςΟ#FBUͷΑ ͏ͳ"HFOUʹඇৗʹϚον͢Δ • &MBTUJDTFBSDI ,JCBOBͷڥ͕͋Ε͙͢ ʹͰ࢝ΊΒΕΔ͓खܰ͞ • ڞ௨෦Λ͏·͘Γग़͠γϯϓϧʹอͬͯ
͍ΔͨΊɺಠࣗͷ#FBUΛ࡞Δͷ͕؆୯
·ͱΊ • LBGLBCFBU044Խ༧ఆͰ͢ • ؒʹ߹͍·ͤΜͰͨ͠N @@ N
(P($1Λͬͨ։ൃ͕͍ͨ͠ਓʂ