Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Search
Daichi Hirata
April 23, 2016
Technology
3
5.9k
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Daichi Hirata
April 23, 2016
Tweet
Share
More Decks by Daichi Hirata
See All by Daichi Hirata
GCPのネットワークでハマった話
daic_h
7
4k
Ruby
daic_h
0
110
Git workshop
daic_h
2
9.5k
Other Decks in Technology
See All in Technology
今日からあなたもGeminiを好きになる
subaruhello
1
640
大規模イベントを支える ABEMA の アーキテクチャ 変遷 2025
nagapad
3
300
ML Pipelineの開発と運用を OpenTelemetryで繋ぐ @ OpenTelemetry Meetup 2025-07
getty708
0
300
Recoil脱却の現状と挑戦
kirik
3
440
P2P ではじめる WebRTC のつまづきどころ
tnoho
1
250
Tiptapで実現する堅牢で柔軟なエディター開発
kirik
1
130
怖くない!GritQLでBiomeプラグインを作ろうよ
pal4de
1
130
AI時代の知識創造 ─GeminiとSECIモデルで読み解く “暗黙知”と創造の境界線
nyagasan
0
140
Semantic Machine Intelligence for Vision, Language, and Actions
keio_smilab
PRO
2
410
PHPからはじめるコンピュータアーキテクチャ / From Scripts to Silicon: A Journey Through the Layers of Computing
tomzoh
2
390
スプリントゴール未達症候群に送る処方箋
kakehashi
PRO
1
280
Jitera Company Deck / JP
jitera
0
200
Featured
See All Featured
StorybookのUI Testing Handbookを読んだ
zakiyama
30
5.9k
Speed Design
sergeychernyshev
32
1k
Code Review Best Practice
trishagee
69
19k
Product Roadmaps are Hard
iamctodd
PRO
54
11k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
35
2.5k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
8
720
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
Making Projects Easy
brettharned
116
6.3k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Faster Mobile Websites
deanohume
308
31k
How to Ace a Technical Interview
jacobian
278
23k
Practical Orchestrator
shlominoach
189
11k
Transcript
&MBTUJD#FBUΛಋೖͯ͠Έͨ (P$POGFSFODF4QSJOH %BJDIJ)*3"5" $ZCFS"HFOU *OD
w גࣜձࣾαΠόʔΤʔδΣϯτ "EUFDI4UVEJP ॴଐ w %BJDIJ)*3"5"!EBJDIJME w (P 3VCZ ࣗݾհ
None
"HFOEB w &MBTUJD#FBUTʹ͍ͭͯ w #FBUTͷ࡞Γํ w ߏͱɺ,JCBOBʹදࣔ͢Δ·Ͱ
None
&MBTUJD#FBUT w %BUB4IJQQFSTGPS&MBTUJDTFBSDI w &MBTUJDTFBSDI͚ͷ+40/Λग़ྗ w (P #JOBSZ w
3VOUJNFͷґଘੑ͕ແ͍ w ܰྔͰγϯϓϧ
&MBTUJD#FBUT
0GGJDJBM#FBUT w 1BDLFUCFBU w 5PQCFBU w 'JMFCFBU w 8JOMPHCFBU
1BDLFUCFBU
1BDLFUCFBU • )551 • .Z42- • 1PTUHSF42- • 3FEJT •
5ISJGU31$ • .POHP%# • %/4 • .FNDBDIF
5PQCFBU
'JMFCFBU
8JOMPHCFBU
$PNNVOJUZ#FBUT w "QBDIFCFBU w /HJOYCFBU w %PDLFSCFBU w )551CFBU w
/BHJPTDIFDLCFBU w FUDʜ
࣮ࡍʹ͔ͭͬͯΈͨ
"QBDIF,BGLB • -JOLFE*O͔Βެ։͞Εͨࢄϝοηʔδϯά γεςϜ • #SPLFS $MVTUFS 1SPEVDFS $POTVNFSͷ ͭͷίϯϙʔωϯτͰߏ͞ΕΔ
"QBDIF,BGLB • ϦΞϧλΠϜʹॲཧΛߦ͏ετϦʔϜܥͷॲཧͱɺ େ͖ͳεύΠΫ͕ൃੜ͢ΔॲཧͷҰ࣍ड͚ͱͯ͠ ༻
1BSUJUJPO0GGTFU $POTVNFS(SPVQ
1BSUJUJPO0GGTFU -BH
ϞχλϦϯάπʔϧ • ZBIPPLBGLBNBOBHFS • RVBOUJpOE,BGLB0⒎TFU.POJUPS • MJOLFEJO#VSSPX
ϞχλϦϯάπʔϧ • WҎ߱ͷ৽͍͠0⒎TFU4UPSFͷରԠ͕· ͪ·ͪ • 0⒎TFUͷऔಘํ๏͕ͪΐͬͱඍົ • LJCBOBΛͬͨΞΫηεϩάͷࢹڥ͕ط ʹ͋ΔͷͰɺಉ͡ॴͰݟΕΔΑ͏ʹ͍ͨ͠
LBGLBCFBU
LBGLBCFBU • 4IPQJGZTBSBNBΛͬͯ#JOBSZ"1*Λ͋Ε ͜ΕݺΜͰ0⒎TFUΛऔಘ • +PMPLJB +.9XJUI+40/PWFS)551 ܦ༝Ͱ#SPLFS෦ͷใΛऔಘ
FMBTUJDCFBUHFOFSBUPS $ cookiecutter https://github.com/elastic/beat-generator.git
FMBTUJDCFBUHFOFSBUPS ɾbeater/kafkabeat.go ɾconfig/config.go ɾetc/beat.yml ͜ͷ̏ͭΛฤू͢Δ
FMBTUJDCFBUHFOFSBUPS ϥΠϒϥϦͷཧʹglide
Configuration Logging Daemon / Service Publisher Beat custom logic events
channel libbeat … MJCCFBU0WFSWJFX beater
#FBUFSJOUFSGBDF • #FBUFS͕Δ͖͜ͱ • 4USBUFHZύλʔϯ
$POGJH.FUIPE • ઃఆϑΝΠϧͷಡΈࠐΈ • $-*ϑϥάͷϋϯυϦϯά
$POGJH.FUIPE
$POGJH.FUIPE
4FUVQ.FUIPE • ϝΠϯϧʔϓલͷॳظԽॲཧ • ΫϥΠΞϯτͷଓͱ͔͜͜Ͱߦ͏
4FUVQ.FUIPE
3VO.FUIPE • ϝΠϯϧʔϓ • σʔλͷऩू • 1VCMJTIFSͷૹ৴ • γάφϧϋϯυϦϯάͳͲMJCCFBUʹ͓ͤ
3VO.FUIPE
None
$MFBOVQ.FUIPE • 3VOΛൈ͚ͨޙʹݺΕΔ • ֬อͨ͠Ϧιʔεͷ։์ͳͲΛߦ͏
4UPQ.FUIPE • 3VOͰγάφϧΛड͚ΔͱݺΕΔ • ϝΠϯϧʔϓΛࢭΊΔҝͷॲཧΛߦ͏ • ىಈͨ͠HPSPVUJOFͷఀࢭ
EFWUPPMT • JOEFYUFNQMBUFHFOFSBUPS • EPDVNFOUHFOFSBUPS • CFBUQBDLFS • %PDLFSΛͬͯDSPTTDPNQJMJOHͱQBDLBHJOH EFCɾSQNɾXJOɾPTY
• ,JCBOB%BTICPBSEFYQPSUJNQPSU • FUD
Kafka Consumer Log Store Kafka Broker Kafka Broker in_tail GCE
VPN elasticsearch elasticsearch kibana fluentd ߏ
,JCBOB%BTICPBSE
·ͱΊ • (PͷܰྔɾߴɾϙʔλϏϦςΟ#FBUͷΑ ͏ͳ"HFOUʹඇৗʹϚον͢Δ • &MBTUJDTFBSDI ,JCBOBͷڥ͕͋Ε͙͢ ʹͰ࢝ΊΒΕΔ͓खܰ͞ • ڞ௨෦Λ͏·͘Γग़͠γϯϓϧʹอͬͯ
͍ΔͨΊɺಠࣗͷ#FBUΛ࡞Δͷ͕؆୯
·ͱΊ • LBGLBCFBU044Խ༧ఆͰ͢ • ؒʹ߹͍·ͤΜͰͨ͠N @@ N
(P($1Λͬͨ։ൃ͕͍ͨ͠ਓʂ