Upgrade to Pro — share decks privately, control downloads, hide ads and more …

楽してデータ分析したい / data engineering with oss

Avatar for Yuichi Takada Yuichi Takada
July 01, 2016
Technology
0
410

楽してデータ分析したい / data engineering with oss

2016/07/01(金) 20:00
#zohyomeetup
http://eventdots.jp/event/590958

Avatar for Yuichi Takada

Yuichi Takada

July 01, 2016
Tweet

More Decks by Yuichi Takada

See All by Yuichi Takada
取引ドメインでの取り組み / mercari transaction domain
Avatar for Yuichi Takada takady
0
97
isucon5 予選をどう惨敗したか / isucon5 qualifier
Avatar for Yuichi Takada takady
1
900

Other Decks in Technology

See All in Technology
コンテキストエンジニアリングとは? 考え方と応用方法
Avatar for ファインディ株式会社（イベント資料アップ用） findy_eventslides
4
880
成長自己責任時代のあるきかた/How to navigate the era of personal responsibility for growth
Avatar for Hiromu Shioya kwappa
3
250
Trust as Infrastructure
Avatar for Bryan Cantrill bcantrill
0
310
"複雑なデータ処理 × 静的サイト" を両立させる、楽をするRails運用 / A low-effort Rails workflow that combines “Complex Data Processing × Static Sites”
Avatar for hogelog hogelog
3
1.8k
OCI Network Firewall 概要
Avatar for oracle4engineer oracle4engineer
PRO
1
7.8k
o11yで育てる、強い内製開発組織
Avatar for _awache _awache
3
110
タスクって今どうなってるの？3.14の新機能 asyncio ps と pstree でasyncioのデバッグを (PyCon JP 2025)
Avatar for Junya Fukuda jrfk
1
250
それでも私はContextに値を詰めたい | Go Conference 2025 / go conference 2025 fill context
Avatar for Yoichiro Shimizu budougumi0617
4
1.2k
20250929_QaaS_vol20
Avatar for Shin Murakami mura_shin
0
110
GopherCon Tour 概略
Avatar for Takuto Nagami logica0419
2
170
SoccerNet GSRの紹介と技術応用：選手視点映像を提供するサッカー作戦盤ツール
Avatar for MIXI ENGINEERS mixi_engineers
PRO
1
160
ZOZOのAI活用実践〜社内基盤からサービス応用まで〜
Avatar for ZOZO Developers zozotech
PRO
0
160

Featured

See All Featured
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
431
66k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
54
3k
Making Projects Easy
Avatar for Brett Harned brettharned
119
6.4k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.1k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
28
4k
Designing for Performance
Avatar for Lara Hogan lara
610
69k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
285
14k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.4k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
30
2.9k

Transcript

  1. ָͯ͠σʔλ෼ੳ͍ͨ͠

  2. ࣗݾ঺հ • ruby, rails • αʔόαΠυΤϯδχΞ • twitter: @takady7 •

    github: @takady

  3. σʔλ෼ੳͷج൫

  4. ݱࡏͷߏ੒

  5. OLTP ͷ DB Ͱूܭ • ෛՙ΍ॲཧ࣌ؒͷ૿େ • DB ʹແ͍σʔλ͸औΕͳ͍

  6. εϓϨουγʔτ΁ͷग़ྗ • ೔࣍όον • εϓϨουγʔτͷؔ਺ʹΑΔຐվ଄ • ྻ͕ͣΕͨΒ #N/A

  7. εϓϨουγʔτͷෛՙ

  8. αʔϏε͕େ͖͘ͳͬͯɺ ͪΐͬͱͭΒ͘ͳ͖ͬͯͨ

  9. ͚ͩͲָͯ͠ࡁ·͍ͤͨ #

  10. ࣗલ࣮૷Λۃྗආ͚Δ

  11. ݱࡏͷߏ੒

  12. ߏ૝

  13. ࣗલ࣮૷Λۃྗආ͚Δ • αʔϏεͷίΞҎ֎ͷ։ൃʹίετΛ͔͚ͨ͘ͳ͍ • OSS ϓϩμΫτΛͳΔ΂͘࢖͏ • όά͸ੈքதͷΤϯδχΞ͕௚ͯ͘͠ΕΔ

  14. ࣗલ࣮૷Λۃྗආ͚Δ • log Λ Fluentd Ͱৗʹ Redshift ΁ྲྀ͢ • re:dash

    ͰΫΤϦΛεέδϡʔϦϯά • re:dash ͷ API Ͱ spreadsheet ʹ΋ import Ͱ͖Δ

  15. ߏ૝

  16. Ͳ͏ͳΔʁ • ·ͩݕূऴΘͬͨͱ͜Ζ • ਖ਼௚Ͳ͏ͳΔ͔Θ͔Βͳ͍ • EMR ΋ݕ౼͕ͨ͠ɺӡ༻ίετ͕ෆ҆ͩͬͨͷͰ΍Ίͨ

  17. ੋඇ஌ݟΛ͍ͩ͘͞ʂ • RDS - Redshift ςʔϒϧͷಉظํ๏ • re:dash ӡ༻ͷ஌ݟ •

    etc

  18. ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂʂ