Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Growing Pains - Automating an ETL with Limited ...

Texas Natural Resources Information System
October 24, 2018
Technology
0
140

Growing Pains - Automating an ETL with Limited Resources

Texas Natural Resources Information System

October 24, 2018
Tweet

More Decks by Texas Natural Resources Information System

See All by Texas Natural Resources Information System
The 3rd Quarter GIS Community Meeting of 2020
texasnaturalresourcesinformationsytem
0
140
The 2nd Quarter GIS Community Meeting of 2020
texasnaturalresourcesinformationsytem
0
530
2020 1st Quarter GIS Community Meeting
texasnaturalresourcesinformationsytem
0
690
PLANET OVERVIEW for TNRIS first Quarter Meeting
texasnaturalresourcesinformationsytem
0
610
Hurricane Harvey H-E-B Disaster Response
texasnaturalresourcesinformationsytem
0
350
Improving Community Services by Helping Citizens Find Their Lost Pets
texasnaturalresourcesinformationsytem
0
260
National Address Database (NAD) and NG9-1-1
texasnaturalresourcesinformationsytem
0
130
StratMap Celebrating Successful Public and Private Partnerships
texasnaturalresourcesinformationsytem
1
260
2019 State of the State Town Hall Meeting
texasnaturalresourcesinformationsytem
1
250

Other Decks in Technology

See All in Technology
Yahoo! ズバトクにおけるフロントエンド開発
lycorptech_jp
PRO
0
100
生成AIのガバナンスの全体像と現実解
fnifni
1
220
日本版とグローバル版のモバイルアプリ統合の開発の裏側と今後の展望
miichan
1
140
開発生産性向上！ 育成を「改善」と捉えるエンジニア育成戦略
shoota
2
470
多様なメトリックとシステムの健全性維持
masaaki_k
0
120
Google Cloud で始める Cloud Run 〜AWSとの比較と実例デモで解説〜
risatube
PRO
0
120
APIとはなにか
mikanichinose
0
120
プロダクト組織で取り組むアドベントカレンダー/Advent Calendar in Product Teams
mixplace
0
110
サーバーなしでWordPress運用、できますよ。
sogaoh
PRO
0
130
あの日俺達が夢見たサーバレスアーキテクチャ/the-serverless-architecture-we-dreamed-of
tomoki10
0
510
DUSt3R, MASt3R, MASt3R-SfM にみる3D基盤モデル
spatial_ai_network
2
280
UI State設計とテスト方針
rmakiyama
3
810

Featured

See All Featured
Product Roadmaps are Hard
iamctodd
PRO
50
11k
Put a Button on it: Removing Barriers to Going Fast.
kastner
59
3.6k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
191
16k
It's Worth the Effort
3n
183
28k
Intergalactic Javascript Robots from Outer Space
tanoku
270
27k
Imperfection Machines: The Place of Print at Facebook
scottboms
266
13k
Raft: Consensus for Rubyists
vanstee
137
6.7k
Keith and Marios Guide to Fast Websites
keithpitt
410
22k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
2
290
Visualization
eitanlees
146
15k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
169
50k

Transcript

  1. Automating an ETL with Limited Resources

  2. None

  3. 1953

  4. 1968

  5. 1999

  6. 2007

  7. 2014

  8. 2018

  9. Scarcity

  10. Soft Skills

  11. Broader Context

  12. None
  13. None

  14. Database ETL Environment

  15. Environment

  16. None

  17. The Environment

  18. The Environment

  19. The Environment

  20. We could buy more. Clouds scale

  21. The Environment

  22. The Environment

  23. The Environment 1

  24. Total Security VS. Risk Mitigation Clouds cost money Use all

    the resources available

  25. Database

  26. The Database

  27. The Database

  28. None
  29. None
  30. None
  31. None

  32. Tables.

  33. The Database 2

  34. None

  35. The Database

  36. None

  37. Development Environments are isolated for a reason Maps are Helpful

    Nightly Data is usually OK

  38. ETL

  39. The ETL

  40. The ETL

  41. 3

  42. We thought that this runtime was great! Well, kind of.

  43. The ETL

  44. 4

  45. 5

  46. The ETL

  47. None
  48. None

  49. But it broke? Well, kind of.

  50. None
  51. None
  52. None
  53. None
  54. None
  55. None
  56. None

  57. I learned 6 ways to perform an ETL 10.5 |

    register view Rules can be broken

  58. Resources can constrain our options. Or spur creativity.

  59. Thanks! Contact: Jordan Carmona GIS Specialist City of McKinney linkedin.com/in/jordancarmona/

    [email protected]

  60. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  61. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  62. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  63. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]