$30 off During Our Annual Pro Sale. View Details »

楽してデータ分析したい / data engineering with oss

Avatar for Yuichi Takada Yuichi Takada
July 01, 2016
Technology
0
410

楽してデータ分析したい / data engineering with oss

2016/07/01(金) 20:00
#zohyomeetup
http://eventdots.jp/event/590958

Avatar for Yuichi Takada

Yuichi Takada

July 01, 2016
Tweet

More Decks by Yuichi Takada

See All by Yuichi Takada
取引ドメインでの取り組み / mercari transaction domain
Avatar for Yuichi Takada takady
0
100
isucon5 予選をどう惨敗したか / isucon5 qualifier
Avatar for Yuichi Takada takady
1
910

Other Decks in Technology

See All in Technology
プロンプトやエージェントを自動的に作る方法
Avatar for shibuiwilliam shibuiwilliam
15
15k
SQLだけでマイグレーションしたい！
Avatar for MakKi makki_d
0
1.1k
Lookerで実現するセキュアな外部データ提供
Avatar for ZOZO Developers zozotech
PRO
0
180
ペアーズにおけるAIエージェント 基盤とText to SQLツールの紹介
Avatar for Hikaru Sasamoto hisamouna
2
870
20251219 OpenIDファウンデーション・ジャパン紹介 / OpenID Foundation Japan Intro
Avatar for OpenID Foundation Japan oidfj
0
290
AgentCore BrowserとClaude Codeスキルを活用した 『初手AI』を実現する業務自動化AIエージェント基盤
Avatar for Hirokatsu Endo ruzia
4
110
Database イノベーショントークを振り返る/reinvent-2025-database-innovation-talk-recap
Avatar for emi emiki
0
240
AWS Security Agentの紹介/introducing-aws-security-agent
Avatar for tomoki10 tomoki10
0
340
1人1サービス開発しているチームでのClaudeCodeの使い方
Avatar for おーしろ noayaoshiro
2
500
エンジニアリングをやめたくないので問い続ける
Avatar for estie | エスティ estie
2
1.2k
re:Invent 2025 ~何をする者であり、どこへいくのか~
Avatar for tetutetu214 tetutetu214
0
230
ActiveJobUpdates
Avatar for Kuniaki IGARASHI igaiga
1
240

Featured

See All Featured
Utilizing Notion as your number one productivity tool
Avatar for Mfonobong Umondia mfonobong
2
180
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
57k
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
1
200
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
Avatar for Aleyda Solis aleyda
1
1k
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
Avatar for David Neal reverentgeek
1
280
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
400
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
130
Believing is Seeing
Avatar for Spiro Bolos oripsolob
0
10
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
26
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
29
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
170

Transcript

  1. ָͯ͠σʔλ෼ੳ͍ͨ͠

  2. ࣗݾ঺հ • ruby, rails • αʔόαΠυΤϯδχΞ • twitter: @takady7 •

    github: @takady

  3. σʔλ෼ੳͷج൫

  4. ݱࡏͷߏ੒

  5. OLTP ͷ DB Ͱूܭ • ෛՙ΍ॲཧ࣌ؒͷ૿େ • DB ʹແ͍σʔλ͸औΕͳ͍

  6. εϓϨουγʔτ΁ͷग़ྗ • ೔࣍όον • εϓϨουγʔτͷؔ਺ʹΑΔຐվ଄ • ྻ͕ͣΕͨΒ #N/A

  7. εϓϨουγʔτͷෛՙ

  8. αʔϏε͕େ͖͘ͳͬͯɺ ͪΐͬͱͭΒ͘ͳ͖ͬͯͨ

  9. ͚ͩͲָͯ͠ࡁ·͍ͤͨ #

  10. ࣗલ࣮૷Λۃྗආ͚Δ

  11. ݱࡏͷߏ੒

  12. ߏ૝

  13. ࣗલ࣮૷Λۃྗආ͚Δ • αʔϏεͷίΞҎ֎ͷ։ൃʹίετΛ͔͚ͨ͘ͳ͍ • OSS ϓϩμΫτΛͳΔ΂͘࢖͏ • όά͸ੈքதͷΤϯδχΞ͕௚ͯ͘͠ΕΔ

  14. ࣗલ࣮૷Λۃྗආ͚Δ • log Λ Fluentd Ͱৗʹ Redshift ΁ྲྀ͢ • re:dash

    ͰΫΤϦΛεέδϡʔϦϯά • re:dash ͷ API Ͱ spreadsheet ʹ΋ import Ͱ͖Δ

  15. ߏ૝

  16. Ͳ͏ͳΔʁ • ·ͩݕূऴΘͬͨͱ͜Ζ • ਖ਼௚Ͳ͏ͳΔ͔Θ͔Βͳ͍ • EMR ΋ݕ౼͕ͨ͠ɺӡ༻ίετ͕ෆ҆ͩͬͨͷͰ΍Ίͨ

  17. ੋඇ஌ݟΛ͍ͩ͘͞ʂ • RDS - Redshift ςʔϒϧͷಉظํ๏ • re:dash ӡ༻ͷ஌ݟ •

    etc

  18. ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂʂ