Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Growing Pains - Automating an ETL with Limited ...

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Texas Natural Resources Information System Texas Natural Resources Information System
October 24, 2018
Technology
0
180

Growing Pains - Automating an ETL with Limited Resources

Avatar for Texas Natural Resources Information System

Texas Natural Resources Information System

October 24, 2018
Tweet

More Decks by Texas Natural Resources Information System

See All by Texas Natural Resources Information System
The 3rd Quarter GIS Community Meeting of 2020
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
180
The 2nd Quarter GIS Community Meeting of 2020
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
620
2020 1st Quarter GIS Community Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
740
PLANET OVERVIEW for TNRIS first Quarter Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
630
Hurricane Harvey H-E-B Disaster Response
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
470
Improving Community Services by Helping Citizens Find Their Lost Pets
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
330
National Address Database (NAD) and NG9-1-1
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
250
StratMap Celebrating Successful Public and Private Partnerships
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
1
340
2019 State of the State Town Hall Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
1
320

Other Decks in Technology

See All in Technology
Bill One急成長の舞台裏 開発組織が直面した失敗と教訓
Avatar for SansanTech sansantech
PRO
2
410
Oracle Base Database Service 技術詳細
Avatar for oracle4engineer oracle4engineer
PRO
15
93k
会社紹介資料 / Sansan Company Profile
Avatar for Sansan, Inc. sansan33
PRO
15
400k
Red Hat OpenStack Services on OpenShift
Avatar for Tatsuya Amemiya tamemiya
0
140
今日から始める Amazon Bedrock AgentCore
Avatar for Har1101 har1101
4
420
Kiro IDEのドキュメントを全部読んだので地味だけどちょっと嬉しい機能を紹介する
Avatar for khmoryz khmoryz
0
210
モダンUIでフルサーバーレスなAIエージェントをAmplifyとCDKでサクッとデプロイしよう
Avatar for みのるん minorun365
4
220
プロポーザルに込める段取り八分
Avatar for ShoheiMitani shoheimitani
1
660
Exadata Fleet Update
Avatar for oracle4engineer oracle4engineer
PRO
0
1.1k
広告の効果検証を題材にした因果推論の精度検証について
Avatar for ZOZO Developers zozotech
PRO
0
210
AIエージェントに必要なのはデータではなく文脈だった/ai-agent-context-graph-mybest
Avatar for Jun Naito jonnojun
1
250
SREチームをどう作り、どう育てるか ― Findy横断SREのマネジメント
Avatar for adachi.ryo rvirus0817
0
350

Featured

See All Featured
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.6k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
0
32k
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
Avatar for Mine Cetinkaya-Rundel minecr
0
160
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
430
How to make the Groovebox
Avatar for あそなす asonas
2
1.9k
The SEO identity crisis: Don't let AI make you average
Avatar for Varn varn
0
330
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.3k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
12
1k
Abbi's Birthday
Avatar for Violet Bock coloredviolet
1
4.8k
エンジニアに許された特別な時間の終わり
Avatar for watany watany
106
230k
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
170

Transcript

  1. Automating an ETL with Limited Resources

  2. None

  3. 1953

  4. 1968

  5. 1999

  6. 2007

  7. 2014

  8. 2018

  9. Scarcity

  10. Soft Skills

  11. Broader Context

  12. None
  13. None

  14. Database ETL Environment

  15. Environment

  16. None

  17. The Environment

  18. The Environment

  19. The Environment

  20. We could buy more. Clouds scale

  21. The Environment

  22. The Environment

  23. The Environment 1

  24. Total Security VS. Risk Mitigation Clouds cost money Use all

    the resources available

  25. Database

  26. The Database

  27. The Database

  28. None
  29. None
  30. None
  31. None

  32. Tables.

  33. The Database 2

  34. None

  35. The Database

  36. None

  37. Development Environments are isolated for a reason Maps are Helpful

    Nightly Data is usually OK

  38. ETL

  39. The ETL

  40. The ETL

  41. 3

  42. We thought that this runtime was great! Well, kind of.

  43. The ETL

  44. 4

  45. 5

  46. The ETL

  47. None
  48. None

  49. But it broke? Well, kind of.

  50. None
  51. None
  52. None
  53. None
  54. None
  55. None
  56. None

  57. I learned 6 ways to perform an ETL 10.5 |

    register view Rules can be broken

  58. Resources can constrain our options. Or spur creativity.

  59. Thanks! Contact: Jordan Carmona GIS Specialist City of McKinney linkedin.com/in/jordancarmona/

    [email protected]

  60. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  61. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  62. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  63. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]