Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
推薦のためのdata pipelineのモニタリングとロギング
Hazumi Ichijo
April 16, 2019
Programming
3
4.2k
推薦のためのdata pipelineのモニタリングとロギング
Hazumi Ichijo
April 16, 2019
Tweet
Share
More Decks by Hazumi Ichijo
See All by Hazumi Ichijo
bqv速習会
hazumirr
6
3.4k
Protobuf on Rails Tips
hazumirr
1
600
Before Chaos Engineering
hazumirr
1
600
Goサーバをあえて不安定にするパッケージを作った話
hazumirr
1
1k
gRPC-webのここがすごい という話がしたかった
hazumirr
1
1.1k
rake db:test:prepare ができなかった話
hazumirr
2
830
The Go Playgoroundで 外部パッケージ使いたい
hazumirr
1
4.7k
Rails から Protobuf を使いたくなった話
hazumirr
1
1.3k
reading rails security guide
hazumirr
0
240
Other Decks in Programming
See All in Programming
Cross Deviceチームにおけるスマートテレビアプリ開発ってどんな感じ?
cokaholic
0
120
Branching out to Jetpack Compose
chrisbanes
4
1.2k
RFC 9111: HTTP Caching
jxck
0
160
Running Laravel/PHP on AWS (AWS Builders Day Taiwan 2022)
dwchiang
0
140
Meet Swift Regex
usamik26
0
330
What's new in Android development tools まとめ
mkeeda
0
310
Node.jsデザインパターンを読んで
mmmommm
0
2.5k
What's new in Jetpack / I/O Extended Japan 2022
star_zero
1
180
Value and Record Types
hschwentner
0
550
Terraform Plan/Apply結果の自動通知
ymmy02
0
280
Airflowはすごいぞ!
hankehly
0
370
"What's new in Swift"の要約 / swift_5_7_summary
uhooi
1
300
Featured
See All Featured
No one is an island. Learnings from fostering a developers community.
thoeni
9
1.3k
Visualization
eitanlees
124
11k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
349
27k
Debugging Ruby Performance
tmm1
65
10k
Building an army of robots
kneath
299
40k
How to Ace a Technical Interview
jacobian
265
21k
Designing on Purpose - Digital PM Summit 2013
jponch
106
5.6k
BBQ
matthewcrist
74
7.9k
From Idea to $5000 a Month in 5 Months
shpigford
373
44k
Designing Experiences People Love
moore
130
22k
A Philosophy of Restraint
colly
192
15k
Six Lessons from altMBA
skipperchong
14
1.4k
Transcript
©2019 Wantedly, Inc. ਪનͷͨΊͷdata pipelineͷ ϞχλϦϯάͱϩΪϯά Apr 16, 2019 -
Hazumi Ichijo Data Pipeline Casual Talk #2
©2018 Wantedly, Inc. ࣗݾհ Ұᑍ!IB[VNJSS!SFSPTU %BUB&OHJOFFSJO8BOUFEMZ (P 3BJMT 3FBDUʜ ւಓग़
©2019 Wantedly, Inc. ͳͥϞχλϦϯάɾϩΪϯά͢Δ͔ ԿΛϞχλϦϯάɾϩΪϯά͖͔͢ ͲΕ͘Β͍कΔ͖͔
ԿΛ͖͔͢
©2019 Wantedly, Inc. +PC +PC +PC +PC +PC σʔλ σʔλ
σʔλ αʔϏε
©2019 Wantedly, Inc. ͕ൃੜͨ͠ͱ͖Ͳ͏͠·͢ʁ
©2019 Wantedly, Inc. +PC +PC +PC +PC +PC +PC +PC
+PC σʔλ σʔλ σʔλ
©2019 Wantedly, Inc. +PC +PC +PC +PC +PC +PC +PC
+PC σʔλ σʔλ σʔλ
©2019 Wantedly, Inc. +PC +PC +PC +PC +PC +PC +PC
+PC σʔλ σʔλ σʔλ ʁ ʁ ʁ
©2019 Wantedly, Inc. ͦͦͳ͍ ζϨΔʢྫݹ͍σʔλΛݩʹͨ͠ਪન͕ग़Δʣ ग़ͯ͘Δঢ় ਪનͷͨΊͷσʔλ͕
©2019 Wantedly, Inc. ͦͦͳ͍ ζϨΔʢྫݹ͍σʔλΛݩʹͨ͠ਪન͕ग़Δʣ ग़ͯ͘Δঢ় ਪનͷͨΊͷσʔλ͕ ؾ͖ͮʹ͍͘
©2019 Wantedly, Inc. ͕ൃੜͨ͠ࡍʹؾ͖ͮʹ͍͘ ͕ൃੜͨ࣌͠ͷௐࠪํ๏͕໘ ͳͥϞχλϦϯάɾϩΪϯάΛ͢Δ͔ ਪનͷͨΊͷσʔλ
©2019 Wantedly, Inc. ͕ൃੜͨ͠ࡍʹؾ͖ͮʹ͍͘ ͕ൃੜͨ࣌͠ͷௐࠪํ๏͕໘ ͳͥϞχλϦϯάɾϩΪϯάΛ͢Δ͔ ਪનͷͨΊͷσʔλ ϞχλϦϯάɾϩΪϯάΛͯ͠ൃੜ࣌ʹඋ͑Δ
©2019 Wantedly, Inc. ԿΛϞχλϦϯάɾϩΪϯά͢Δʁ
©2019 Wantedly, Inc. ຖճܾΊΒΕͨॴʹσʔλ͕ग़ྗ͞ΕΔ͖ ग़ྗ͞ΕΔσʔλ͕ਖ਼͍͠ඞཁ͕͋Δ w ґଘ͢Δσʔλ͕࠷৽ͷঢ়ଶ w
ܾΊΒΕͨ࣌ࠁʹ࣮ߦ͞Εͯ΄͍͠ w FUD ԿΛϞχλϦϯάɾϩΪϯά͖͔͢ ਪનͷͨΊͷσʔλ
©2019 Wantedly, Inc. ຖճܾΊΒΕͨॴʹσʔλ͕ग़ྗ͞ΕΔ͖ ग़ྗ͞ΕΔσʔλ͕ਖ਼͍͠ඞཁ͕͋Δ w ґଘ͢Δσʔλ͕࠷৽ͷঢ়ଶ w
ܾΊΒΕͨ࣌ࠁʹ࣮ߦ͞Εͯ΄͍͠ w FUD ԿΛϞχλϦϯάɾϩΪϯά͖͔͢ ਪનͷͨΊͷσʔλ ϞχλϦϯάɾϩΪϯάΛͯ͠कΕΔΑ͏ʹ͢Δ
©2019 Wantedly, Inc. ΞϓϦέʔγϣϯ w δϣϒ࣮ߦ࣌ͷ࣮ߦঢ়گͷʢྫֶशʣ w ΦϯϥΠϯධՁͷ w
ॻ͖ग़͠ઌʹσʔλ͕ॻ͖ࠐ·Ε͔ͨ w Τϥʔ௨ w Կʹ͕͔͔࣌ؒΔ͔ Πϯϑϥ w δϣϒ͕ޭ͔ͨ͠ɾࣦഊ͔ͨ͠ɾ࣮ߦ͞Ε͔ͨ w ઃఆ͍ͯ͠Δ࣌ؒʹ࣮ߦ͞Ε͔ͨ ԿΛϞχλϦϯάɾϩΪϯά͖͔͢ ϞχλϦϯά
©2019 Wantedly, Inc. w ॲཧͷ༰͕Θ͔Δͷʢྫ42-ʣ w δϣϒͷ։࢝ɾऴྃ w ॻ͖ग़ͨ͠σʔλ w
FUD ԿΛϞχλϦϯάɾϩΪϯά͖͔͢ ϩΪϯά
©2019 Wantedly, Inc. ͲΕ͘Β͍कΒΕΔ͖ͷʁ
©2019 Wantedly, Inc. αʔϏεશମ͕͑ͳ͘ͳΔ ,1*ʹ99Өڹ͕ͰΔ Ұ෦ͷػೳ͕͑ͳ͘ͳΔ ͲΕ͘Β͍कΔ͖͔
͋Δਪનʹ͕͋Δͱɾɾɾ
©2019 Wantedly, Inc. αʔϏεશମ͕͑ͳ͘ͳΔ ,1*ʹ99Өڹ͕ͰΔ Ұ෦ͷػೳ͕͑ͳ͘ͳΔ ͲΕ͘Β͍कΔ͖͔
͋Δਪનʹ͕͋Δͱɾɾɾ ͦͦͦͷσʔλͷॏཁ͕Θ͔Δඞཁ͕͋Δ
©2019 Wantedly, Inc. ԿΛ͖͔͢
©2019 Wantedly, Inc. ॏཁΛͰ͖Δ͚ͩ໌֬ʹ͓ͯ͘͠ ϞχλϦϯάɾϩΪϯάͷ߲ચ͍ग़͠ ΠϯϑϥνʔϜͱڠྗͯ͠ɺ༧Ί w
ॏཁΛ͑Δ w ϞχλϦϯάɾϩΪϯάͷλεΫͷׂΓৼΓΛߦ͏ w ͕ൃੜͨ࣌͠ɺͲ͏͍ͬͨϑϩʔͰ֬ೝ͢Δ͔ɺͲ͏ରॲ ͢Δ͔Λ͑ΔඞཁͰ͋Ε࣮ࡍʹϦϋʔαϧΛߦ͏ ԿΛ͖͔͢