Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Search
Daichi Hirata
April 23, 2016
Technology
3
5.9k
ElasticBeatsを導入してみた話/Go Conference 2016 Spring
Daichi Hirata
April 23, 2016
Tweet
Share
More Decks by Daichi Hirata
See All by Daichi Hirata
GCPのネットワークでハマった話
daic_h
7
4k
Ruby
daic_h
0
110
Git workshop
daic_h
2
9.6k
Other Decks in Technology
See All in Technology
20201008_ファインディ_品質意識を育てる役目は人かAIか___2_.pdf
findy_eventslides
2
550
英語は話せません!それでも海外チームと信頼関係を作るため、対話を重ねた2ヶ月間のまなび
niioka_97
0
130
後進育成のしくじり〜任せるスキルとリーダーシップの両立〜
matsu0228
7
3.1k
Goに育てられ開発者向けセキュリティ事業を立ち上げた僕が今向き合う、AI × セキュリティの最前線 / Go Conference 2025
flatt_security
0
360
OpenAI gpt-oss ファインチューニング入門
kmotohas
2
1.1k
extension 現場で使えるXcodeショートカット一覧
ktombow
0
220
動画データのポテンシャルを引き出す! Databricks と AI活用への奮闘記(現在進行形)
databricksjapan
0
160
AWS IoT 超入門 2025
hattori
0
200
『OCI で学ぶクラウドネイティブ 実践 × 理論ガイド』 書籍概要
oracle4engineer
PRO
2
140
社内お問い合わせBotの仕組みと学び
nish01
1
490
プロポーザルのコツ ~ Kaigi on Rails 2025 初参加で3名の登壇を実現 ~
naro143
1
140
「AI駆動PO」を考えてみる - 作る速さから価値のスループットへ:検査・適応で未来を開発 / AI-driven product owner. scrummat2025
yosuke_nagai
3
730
Featured
See All Featured
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.5k
Music & Morning Musume
bryan
46
6.8k
Raft: Consensus for Rubyists
vanstee
139
7.1k
Become a Pro
speakerdeck
PRO
29
5.5k
A better future with KSS
kneath
239
17k
Why Our Code Smells
bkeepers
PRO
339
57k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6.1k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.7k
It's Worth the Effort
3n
187
28k
Producing Creativity
orderedlist
PRO
347
40k
The Language of Interfaces
destraynor
162
25k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Transcript
&MBTUJD#FBUΛಋೖͯ͠Έͨ (P$POGFSFODF4QSJOH %BJDIJ)*3"5" $ZCFS"HFOU *OD
w גࣜձࣾαΠόʔΤʔδΣϯτ "EUFDI4UVEJP ॴଐ w %BJDIJ)*3"5"!EBJDIJME w (P 3VCZ ࣗݾհ
None
"HFOEB w &MBTUJD#FBUTʹ͍ͭͯ w #FBUTͷ࡞Γํ w ߏͱɺ,JCBOBʹදࣔ͢Δ·Ͱ
None
&MBTUJD#FBUT w %BUB4IJQQFSTGPS&MBTUJDTFBSDI w &MBTUJDTFBSDI͚ͷ+40/Λग़ྗ w (P #JOBSZ w
3VOUJNFͷґଘੑ͕ແ͍ w ܰྔͰγϯϓϧ
&MBTUJD#FBUT
0GGJDJBM#FBUT w 1BDLFUCFBU w 5PQCFBU w 'JMFCFBU w 8JOMPHCFBU
1BDLFUCFBU
1BDLFUCFBU • )551 • .Z42- • 1PTUHSF42- • 3FEJT •
5ISJGU31$ • .POHP%# • %/4 • .FNDBDIF
5PQCFBU
'JMFCFBU
8JOMPHCFBU
$PNNVOJUZ#FBUT w "QBDIFCFBU w /HJOYCFBU w %PDLFSCFBU w )551CFBU w
/BHJPTDIFDLCFBU w FUDʜ
࣮ࡍʹ͔ͭͬͯΈͨ
"QBDIF,BGLB • -JOLFE*O͔Βެ։͞Εͨࢄϝοηʔδϯά γεςϜ • #SPLFS $MVTUFS 1SPEVDFS $POTVNFSͷ ͭͷίϯϙʔωϯτͰߏ͞ΕΔ
"QBDIF,BGLB • ϦΞϧλΠϜʹॲཧΛߦ͏ετϦʔϜܥͷॲཧͱɺ େ͖ͳεύΠΫ͕ൃੜ͢ΔॲཧͷҰ࣍ड͚ͱͯ͠ ༻
1BSUJUJPO0GGTFU $POTVNFS(SPVQ
1BSUJUJPO0GGTFU -BH
ϞχλϦϯάπʔϧ • ZBIPPLBGLBNBOBHFS • RVBOUJpOE,BGLB0⒎TFU.POJUPS • MJOLFEJO#VSSPX
ϞχλϦϯάπʔϧ • WҎ߱ͷ৽͍͠0⒎TFU4UPSFͷରԠ͕· ͪ·ͪ • 0⒎TFUͷऔಘํ๏͕ͪΐͬͱඍົ • LJCBOBΛͬͨΞΫηεϩάͷࢹڥ͕ط ʹ͋ΔͷͰɺಉ͡ॴͰݟΕΔΑ͏ʹ͍ͨ͠
LBGLBCFBU
LBGLBCFBU • 4IPQJGZTBSBNBΛͬͯ#JOBSZ"1*Λ͋Ε ͜ΕݺΜͰ0⒎TFUΛऔಘ • +PMPLJB +.9XJUI+40/PWFS)551 ܦ༝Ͱ#SPLFS෦ͷใΛऔಘ
FMBTUJDCFBUHFOFSBUPS $ cookiecutter https://github.com/elastic/beat-generator.git
FMBTUJDCFBUHFOFSBUPS ɾbeater/kafkabeat.go ɾconfig/config.go ɾetc/beat.yml ͜ͷ̏ͭΛฤू͢Δ
FMBTUJDCFBUHFOFSBUPS ϥΠϒϥϦͷཧʹglide
Configuration Logging Daemon / Service Publisher Beat custom logic events
channel libbeat … MJCCFBU0WFSWJFX beater
#FBUFSJOUFSGBDF • #FBUFS͕Δ͖͜ͱ • 4USBUFHZύλʔϯ
$POGJH.FUIPE • ઃఆϑΝΠϧͷಡΈࠐΈ • $-*ϑϥάͷϋϯυϦϯά
$POGJH.FUIPE
$POGJH.FUIPE
4FUVQ.FUIPE • ϝΠϯϧʔϓલͷॳظԽॲཧ • ΫϥΠΞϯτͷଓͱ͔͜͜Ͱߦ͏
4FUVQ.FUIPE
3VO.FUIPE • ϝΠϯϧʔϓ • σʔλͷऩू • 1VCMJTIFSͷૹ৴ • γάφϧϋϯυϦϯάͳͲMJCCFBUʹ͓ͤ
3VO.FUIPE
None
$MFBOVQ.FUIPE • 3VOΛൈ͚ͨޙʹݺΕΔ • ֬อͨ͠Ϧιʔεͷ։์ͳͲΛߦ͏
4UPQ.FUIPE • 3VOͰγάφϧΛड͚ΔͱݺΕΔ • ϝΠϯϧʔϓΛࢭΊΔҝͷॲཧΛߦ͏ • ىಈͨ͠HPSPVUJOFͷఀࢭ
EFWUPPMT • JOEFYUFNQMBUFHFOFSBUPS • EPDVNFOUHFOFSBUPS • CFBUQBDLFS • %PDLFSΛͬͯDSPTTDPNQJMJOHͱQBDLBHJOH EFCɾSQNɾXJOɾPTY
• ,JCBOB%BTICPBSEFYQPSUJNQPSU • FUD
Kafka Consumer Log Store Kafka Broker Kafka Broker in_tail GCE
VPN elasticsearch elasticsearch kibana fluentd ߏ
,JCBOB%BTICPBSE
·ͱΊ • (PͷܰྔɾߴɾϙʔλϏϦςΟ#FBUͷΑ ͏ͳ"HFOUʹඇৗʹϚον͢Δ • &MBTUJDTFBSDI ,JCBOBͷڥ͕͋Ε͙͢ ʹͰ࢝ΊΒΕΔ͓खܰ͞ • ڞ௨෦Λ͏·͘Γग़͠γϯϓϧʹอͬͯ
͍ΔͨΊɺಠࣗͷ#FBUΛ࡞Δͷ͕؆୯
·ͱΊ • LBGLBCFBU044Խ༧ఆͰ͢ • ؒʹ߹͍·ͤΜͰͨ͠N @@ N
(P($1Λͬͨ։ൃ͕͍ͨ͠ਓʂ