Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Growing Pains - Automating an ETL with Limited ...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Texas Natural Resources Information System Texas Natural Resources Information System
October 24, 2018
Technology
0
180

Growing Pains - Automating an ETL with Limited Resources

Avatar for Texas Natural Resources Information System

Texas Natural Resources Information System

October 24, 2018
Tweet

More Decks by Texas Natural Resources Information System

See All by Texas Natural Resources Information System
The 3rd Quarter GIS Community Meeting of 2020
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
180
The 2nd Quarter GIS Community Meeting of 2020
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
620
2020 1st Quarter GIS Community Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
740
PLANET OVERVIEW for TNRIS first Quarter Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
630
Hurricane Harvey H-E-B Disaster Response
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
470
Improving Community Services by Helping Citizens Find Their Lost Pets
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
320
National Address Database (NAD) and NG9-1-1
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
250
StratMap Celebrating Successful Public and Private Partnerships
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
1
340
2019 State of the State Town Hall Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
1
320

Other Decks in Technology

See All in Technology
ドメイン駆動セキュリティへの道しるべ
Avatar for Aja9tochin pandayumi
0
180
全員が「作り手」になる。職能の壁を溶かすプロトタイプ開発。
Avatar for hokuto hokuo
1
590
AI推進者の視点で見る、Bill OneのAI活用の今
Avatar for SansanTech sansantech
PRO
1
130
BPaaSオペレーション・kubell社内 n8n活用による効率化検証事例紹介
Avatar for KentaroFujii kentarofujii
0
310
クラウドセキュリティの進化 — AWSの20年を振り返る
Avatar for kei4eva4 kei4eva4
0
160
エンジニアとマネジメントの距離/Engineering and Management
Avatar for 小田中育生 ikuodanaka
3
650
Git Training GitHub
Avatar for Yuki Hattori yuhattor
1
270
Azure SQL Databaseでベクター検索を活用しよう
Avatar for なかしょ nakasho
0
120
一番人に近いコードレビューア CodeRabbit
Avatar for kinopee kinopeee
0
110
AI開発をスケールさせるデータ中心の仕組みづくり
Avatar for Kazuyuki Miyazawa kzykmyzw
0
170
エンジニアとして長く走るために気づいた2つのこと_大賀愛一郎
Avatar for oga_aiichiro nanaism
1
250
Amazon Bedrock AgentCore 認証・認可入門
Avatar for iganin hironobuiga
1
240

Featured

See All Featured
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8.4k
Information Architects: The Missing Link in Design Systems
Avatar for Michelle Chin soysaucechin
0
750
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
61
49k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.8k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.5k
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.5k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
3.9k
Abbi's Birthday
Avatar for Violet Bock coloredviolet
1
4.5k
The Impact of AI in SEO - AI Overviews June 2024 Edition
Avatar for Aleyda Solis aleyda
5
710
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
9.8k
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
460

Transcript

  1. Automating an ETL with Limited Resources

  2. None

  3. 1953

  4. 1968

  5. 1999

  6. 2007

  7. 2014

  8. 2018

  9. Scarcity

  10. Soft Skills

  11. Broader Context

  12. None
  13. None

  14. Database ETL Environment

  15. Environment

  16. None

  17. The Environment

  18. The Environment

  19. The Environment

  20. We could buy more. Clouds scale

  21. The Environment

  22. The Environment

  23. The Environment 1

  24. Total Security VS. Risk Mitigation Clouds cost money Use all

    the resources available

  25. Database

  26. The Database

  27. The Database

  28. None
  29. None
  30. None
  31. None

  32. Tables.

  33. The Database 2

  34. None

  35. The Database

  36. None

  37. Development Environments are isolated for a reason Maps are Helpful

    Nightly Data is usually OK

  38. ETL

  39. The ETL

  40. The ETL

  41. 3

  42. We thought that this runtime was great! Well, kind of.

  43. The ETL

  44. 4

  45. 5

  46. The ETL

  47. None
  48. None

  49. But it broke? Well, kind of.

  50. None
  51. None
  52. None
  53. None
  54. None
  55. None
  56. None

  57. I learned 6 ways to perform an ETL 10.5 |

    register view Rules can be broken

  58. Resources can constrain our options. Or spur creativity.

  59. Thanks! Contact: Jordan Carmona GIS Specialist City of McKinney linkedin.com/in/jordancarmona/

    [email protected]

  60. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  61. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  62. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  63. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]