Upgrade to Pro — share decks privately, control downloads, hide ads and more …

推薦のためのdata pipelineのモニタリングとロギング

9ec2ceee3f782e64fd67fa7d82b6c1b4?s=47 Hazumi Ichijo
April 16, 2019
Programming
3
4.2k

推薦のためのdata pipelineのモニタリングとロギング

9ec2ceee3f782e64fd67fa7d82b6c1b4?s=128

Hazumi Ichijo

April 16, 2019
Tweet

More Decks by Hazumi Ichijo

See All by Hazumi Ichijo
bqv速習会
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
6
3.4k
Protobuf on Rails Tips
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
1
600
Before Chaos Engineering
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
1
600
Goサーバをあえて不安定にするパッケージを作った話
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
1
1k
gRPC-webのここがすごい という話がしたかった
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
1
1.1k
rake db:test:prepare ができなかった話
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
2
830
The Go Playgoroundで 外部パッケージ使いたい
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
1
4.7k
Rails から Protobuf を使いたくなった話
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
1
1.3k
reading rails security guide
9ec2ceee3f782e64fd67fa7d82b6c1b4?s=48 hazumirr
0
240

Other Decks in Programming

See All in Programming
Cross Deviceチームにおけるスマートテレビアプリ開発ってどんな感じ？
95f926465b1c71fbb49850c5b6223c4d?s=48 cokaholic
0
120
Branching out to Jetpack Compose
86f746f6c0c522ab2261bd55791d8a4a?s=48 chrisbanes
4
1.2k
RFC 9111: HTTP Caching
1ff811939fd0923df8321ec6d8bf9d4b?s=48 jxck
0
160
Running Laravel/PHP on AWS (AWS Builders Day Taiwan 2022)
2f42f32689c8244280dd01d864f92079?s=48 dwchiang
0
140
Meet Swift Regex
0b26590a0a8b0f1da140ed5de9b68379?s=48 usamik26
0
330
What's new in Android development tools まとめ
46b3bc302e3a40f8df60cfb60d59c313?s=48 mkeeda
0
310
Node.jsデザインパターンを読んで
3d06fa4b3230d37a8d940405cc4abcc6?s=48 mmmommm
0
2.5k
What's new in Jetpack / I/O Extended Japan 2022
80a3a3857a55f154d23acb705eff72cc?s=48 star_zero
1
180
Value and Record Types
575ca492bac55e895d0e1c86f7d709fe?s=48 hschwentner
0
550
Terraform Plan/Apply結果の自動通知
92a1e043fcefaed6e1b89182b1cd34a5?s=48 ymmy02
0
280
Airflowはすごいぞ！
65389cd2b6fdc531dcc4af999e864593?s=48 hankehly
0
370
"What's new in Swift"の要約 / swift_5_7_summary
42a6a049ac8f5265f31858a9509217fb?s=48 uhooi
1
300

Featured

See All Featured
No one is an island. Learnings from fostering a developers community.
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
9
1.3k
Visualization
170b760e0147792d0140e59ec78e9893?s=48 eitanlees
124
11k
CSS Pre-Processors: Stylus, Less & Sass
7559f6cff1f5efc2d210965febd4d71c?s=48 bermonpainter
349
27k
Debugging Ruby Performance
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
65
10k
Building an army of robots
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
299
40k
How to Ace a Technical Interview
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
265
21k
Designing on Purpose - Digital PM Summit 2013
7653c7c449918ff6542880a8c284f5e7?s=48 jponch
106
5.6k
BBQ
761be20b5ebd271008bcee1244fc5b52?s=48 matthewcrist
74
7.9k
From Idea to $5000 a Month in 5 Months
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
373
44k
Designing Experiences People Love
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
130
22k
A Philosophy of Restraint
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
192
15k
Six Lessons from altMBA
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
14
1.4k

Transcript

  1. ©2019 Wantedly, Inc. ਪનͷͨΊͷdata pipelineͷ ϞχλϦϯάͱϩΪϯά Apr 16, 2019 -

    Hazumi Ichijo Data Pipeline Casual Talk #2

  2. ©2018 Wantedly, Inc. ࣗݾ঺հ Ұᑍ୺੅!IB[VNJSS!SFSPTU %BUB&OHJOFFSJO8BOUFEMZ (P 3BJMT 3FBDUʜ ๺ւಓग़਎

  3. ©2019 Wantedly, Inc.  ͳͥϞχλϦϯάɾϩΪϯά͢Δ͔  ԿΛϞχλϦϯάɾϩΪϯά͢΂͖͔  ͲΕ͘Β͍कΔ΂͖͔ 

    ԿΛ͢΂͖͔

  4. ©2019 Wantedly, Inc. +PC +PC +PC +PC +PC σʔλ σʔλ

    σʔλ αʔϏε

  5. ©2019 Wantedly, Inc. ໰୊͕ൃੜͨ͠ͱ͖Ͳ͏͠·͢ʁ

  6. ©2019 Wantedly, Inc. +PC +PC +PC +PC +PC +PC +PC

    +PC σʔλ σʔλ σʔλ

  7. ©2019 Wantedly, Inc. +PC +PC +PC +PC +PC +PC +PC

    +PC σʔλ σʔλ σʔλ

  8. ©2019 Wantedly, Inc. +PC +PC +PC +PC +PC +PC +PC

    +PC σʔλ σʔλ σʔλ ʁ ʁ ʁ

  9. ©2019 Wantedly, Inc.  ͦ΋ͦ΋ͳ͍  ζϨΔʢྫݹ͍σʔλΛݩʹͨ͠ਪન͕ग़Δʣ ग़ͯ͘Δ঱ঢ় ਪનͷͨΊͷσʔλ͕

  10. ©2019 Wantedly, Inc.  ͦ΋ͦ΋ͳ͍  ζϨΔʢྫݹ͍σʔλΛݩʹͨ͠ਪન͕ग़Δʣ ग़ͯ͘Δ঱ঢ় ਪનͷͨΊͷσʔλ͕ ؾ͖ͮʹ͍͘

  11. ©2019 Wantedly, Inc.  ໰୊͕ൃੜͨ͠ࡍʹؾ͖ͮʹ͍͘  ໰୊͕ൃੜͨ࣌͠ͷௐࠪํ๏͕໘౗ ͳͥϞχλϦϯάɾϩΪϯάΛ͢Δ͔ ਪનͷͨΊͷσʔλ͸

  12. ©2019 Wantedly, Inc.  ໰୊͕ൃੜͨ͠ࡍʹؾ͖ͮʹ͍͘  ໰୊͕ൃੜͨ࣌͠ͷௐࠪํ๏͕໘౗ ͳͥϞχλϦϯάɾϩΪϯάΛ͢Δ͔ ਪનͷͨΊͷσʔλ͸ ϞχλϦϯάɾϩΪϯάΛͯ͠໰୊ൃੜ࣌ʹඋ͑Δ

  13. ©2019 Wantedly, Inc. ԿΛϞχλϦϯάɾϩΪϯά͢Δʁ

  14. ©2019 Wantedly, Inc.  ຖճܾΊΒΕͨ৔ॴʹσʔλ͕ग़ྗ͞ΕΔ΂͖  ग़ྗ͞ΕΔσʔλ͕ਖ਼͍͠ඞཁ͕͋Δ w ґଘ͢Δσʔλ͕࠷৽ͷঢ়ଶ w

    ܾΊΒΕͨ࣌ࠁʹ࣮ߦ͞Εͯ΄͍͠ w FUD ԿΛϞχλϦϯάɾϩΪϯά͢΂͖͔ ਪનͷͨΊͷσʔλ͸

  15. ©2019 Wantedly, Inc.  ຖճܾΊΒΕͨ৔ॴʹσʔλ͕ग़ྗ͞ΕΔ΂͖  ग़ྗ͞ΕΔσʔλ͕ਖ਼͍͠ඞཁ͕͋Δ w ґଘ͢Δσʔλ͕࠷৽ͷঢ়ଶ w

    ܾΊΒΕͨ࣌ࠁʹ࣮ߦ͞Εͯ΄͍͠ w FUD ԿΛϞχλϦϯάɾϩΪϯά͢΂͖͔ ਪનͷͨΊͷσʔλ͸ ϞχλϦϯάɾϩΪϯάΛͯ͠कΕΔΑ͏ʹ͢Δ

  16. ©2019 Wantedly, Inc.  ΞϓϦέʔγϣϯ w δϣϒ࣮ߦ࣌ͷ࣮ߦঢ়گͷ஋ʢྫֶश཰ʣ w ΦϯϥΠϯධՁͷ஋ w

    ॻ͖ग़͠ઌʹσʔλ͕ॻ͖ࠐ·Ε͔ͨ w Τϥʔ௨஌ w Կʹ͕͔͔࣌ؒΔ͔  Πϯϑϥ w δϣϒ͕੒ޭ͔ͨ͠ɾࣦഊ͔ͨ͠ɾ࣮ߦ͞Ε͔ͨ w ઃఆ͍ͯ͠Δ࣌ؒʹ࣮ߦ͞Ε͔ͨ ԿΛϞχλϦϯάɾϩΪϯά͢΂͖͔ ϞχλϦϯά

  17. ©2019 Wantedly, Inc. w ॲཧͷ಺༰͕Θ͔Δ΋ͷʢྫ42-ʣ w δϣϒͷ։࢝ɾऴྃ w ॻ͖ग़ͨ͠σʔλ w

    FUD ԿΛϞχλϦϯάɾϩΪϯά͢΂͖͔ ϩΪϯά

  18. ©2019 Wantedly, Inc. ͲΕ͘Β͍कΒΕΔ΂͖΋ͷʁ

  19. ©2019 Wantedly, Inc.  αʔϏεશମ͕࢖͑ͳ͘ͳΔ  ,1*ʹ99Өڹ͕ͰΔ  Ұ෦ͷػೳ͕࢖͑ͳ͘ͳΔ ͲΕ͘Β͍कΔ΂͖͔

    ͋Δਪનʹ໰୊͕͋Δͱɾɾɾ

  20. ©2019 Wantedly, Inc.  αʔϏεશମ͕࢖͑ͳ͘ͳΔ  ,1*ʹ99Өڹ͕ͰΔ  Ұ෦ͷػೳ͕࢖͑ͳ͘ͳΔ ͲΕ͘Β͍कΔ΂͖͔

    ͋Δਪનʹ໰୊͕͋Δͱɾɾɾ ͦ΋ͦ΋ͦͷσʔλͷॏཁ౓͕Θ͔Δඞཁ͕͋Δ

  21. ©2019 Wantedly, Inc. ԿΛ͢΂͖͔

  22. ©2019 Wantedly, Inc.  ॏཁ౓ΛͰ͖Δ͚ͩ໌֬ʹ͓ͯ͘͠  ϞχλϦϯάɾϩΪϯάͷ߲໨ચ͍ग़͠  ΠϯϑϥνʔϜͱڠྗͯ͠ɺ༧Ί w

    ॏཁ౓Λ఻͑Δ w ϞχλϦϯάɾϩΪϯάͷλεΫͷׂΓৼΓΛߦ͏ w ໰୊͕ൃੜͨ࣌͠ɺͲ͏͍ͬͨϑϩʔͰ֬ೝ͢Δ͔ɺͲ͏ରॲ ͢Δ͔Λ఻͑ΔඞཁͰ͋Ε͹࣮ࡍʹϦϋʔαϧΛߦ͏ ԿΛ͢΂͖͔