$30 off During Our Annual Pro Sale. View Details »

Growing Pains - Automating an ETL with Limited ...

Avatar for Texas Natural Resources Information System Texas Natural Resources Information System
October 24, 2018
Technology
0
170

Growing Pains - Automating an ETL with Limited Resources

Avatar for Texas Natural Resources Information System

Texas Natural Resources Information System

October 24, 2018
Tweet

More Decks by Texas Natural Resources Information System

See All by Texas Natural Resources Information System
The 3rd Quarter GIS Community Meeting of 2020
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
180
The 2nd Quarter GIS Community Meeting of 2020
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
610
2020 1st Quarter GIS Community Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
740
PLANET OVERVIEW for TNRIS first Quarter Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
630
Hurricane Harvey H-E-B Disaster Response
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
460
Improving Community Services by Helping Citizens Find Their Lost Pets
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
320
National Address Database (NAD) and NG9-1-1
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
0
240
StratMap Celebrating Successful Public and Private Partnerships
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
1
330
2019 State of the State Town Hall Meeting
Avatar for Texas Natural Resources Information System texasnaturalresourcesinformationsytem
1
320

Other Decks in Technology

See All in Technology
Introduce marp-ai-slide-generator
Avatar for Itaru Tomita itarutomy
0
110
ソフトウェアエンジニアとAIエンジニアの役割分担についてのある事例
Avatar for KNOWLEDGE WORK / 株式会社ナレッジワーク kworkdev
PRO
0
230
日本Rubyの会: これまでとこれから
Avatar for Koji SHIMADA snoozer05
PRO
6
230
MySQLとPostgreSQLのコレーション / Collation of MySQL and PostgreSQL
Avatar for とみたまさひろ tmtms
1
1.2k
AWSの新機能をフル活用した「re:Inventエージェント」開発秘話
Avatar for みのるん minorun365
2
440
『君の名は』と聞く君の名は。 / Your name, you who asks for mine.
Avatar for NTT docomo Business nttcom
1
120
事業の財務責任に向き合うリクルートデータプラットフォームのFinOps
Avatar for Recruit recruitengineers
PRO
2
200
re:Invent2025 3つの Frontier Agents を紹介 / introducing-3-frontier-agents
Avatar for tomoki10 tomoki10
0
410
「図面」から「法則」へ 〜メタ視点で読み解く現代のソフトウェアアーキテクチャ〜
Avatar for Satoshi Kobayashi scova0731
0
490
ペアーズにおけるAIエージェント 基盤とText to SQLツールの紹介
Avatar for Hikaru Sasamoto hisamouna
2
1.6k
Next.js 16の新機能 Cache Components について
Avatar for sutetotanuki sutetotanuki
0
180
AI with TiDD
Avatar for Shiraji shiraji
1
270

Featured

See All Featured
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
2.9k
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
6.8k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
698
190k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
127
17k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
200
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.5k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.7k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
57k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
550
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
5.8k

Transcript

  1. Automating an ETL with Limited Resources

  2. None

  3. 1953

  4. 1968

  5. 1999

  6. 2007

  7. 2014

  8. 2018

  9. Scarcity

  10. Soft Skills

  11. Broader Context

  12. None
  13. None

  14. Database ETL Environment

  15. Environment

  16. None

  17. The Environment

  18. The Environment

  19. The Environment

  20. We could buy more. Clouds scale

  21. The Environment

  22. The Environment

  23. The Environment 1

  24. Total Security VS. Risk Mitigation Clouds cost money Use all

    the resources available

  25. Database

  26. The Database

  27. The Database

  28. None
  29. None
  30. None
  31. None

  32. Tables.

  33. The Database 2

  34. None

  35. The Database

  36. None

  37. Development Environments are isolated for a reason Maps are Helpful

    Nightly Data is usually OK

  38. ETL

  39. The ETL

  40. The ETL

  41. 3

  42. We thought that this runtime was great! Well, kind of.

  43. The ETL

  44. 4

  45. 5

  46. The ETL

  47. None
  48. None

  49. But it broke? Well, kind of.

  50. None
  51. None
  52. None
  53. None
  54. None
  55. None
  56. None

  57. I learned 6 ways to perform an ETL 10.5 |

    register view Rules can be broken

  58. Resources can constrain our options. Or spur creativity.

  59. Thanks! Contact: Jordan Carmona GIS Specialist City of McKinney linkedin.com/in/jordancarmona/

    [email protected]

  60. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  61. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  62. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]

  63. Q & A Contact: Jordan Carmona GIS Specialist City of

    McKinney linkedin.com/in/jordancarmona/ [email protected]