Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Data Engineering?

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
Avatar for Kan Ouivirach Kan Ouivirach
February 27, 2019

What is Data Engineering?

Data Engineering helps make the world/organization a better place with "Open Data".

Avatar for Kan Ouivirach

Kan Ouivirach

February 27, 2019
Tweet

More Decks by Kan Ouivirach

Other Decks in Technology

Transcript

  1. K A N O U I V I R A

    C H W H AT I S D ATA E N G I N E E R I N G ?
  2. Photo by Frank Vex on Unsplash Companies use DATA to

    answer these business questions: • What is our churn rate? • Are we doing better? How can we improve our services? • Any recommendation to generate more revenue from repeated customers?
  3. M A K I N G D ATA S C

    I E N C E B E T T E R
  4. M A K I N G D ATA S C

    I E N C E B E T T E R
  5. M A K I N G D ATA S C

    I E N C E B E T T E R Data Engineering helps make the world/organization a better place with “Open Data”.
  6. Use programming languages to ensure clean, reliable, and performative access

    to data and databases D ATA E N G I N E E R https://medium.freecodecamp.com/the-rise-of-the-data-engineer-91be18f1e603 The Rise of the Data Engineer
  7. D ATA E N G I N E E R

    V S . D ATA S C I E N T I S T https://www.datacamp.com/community/blog/data-scientist-vs-data-engineer
  8. D ATA E N G I N E E R

    V S . D ATA S C I E N T I S T Updated Feb 25, 2019
  9. H O W M U C H D O E

    S A D ATA E N G I N E E R / S C I E N T I S T M A K E ? https://www.glassdoor.com/Salaries/index.htm
  10. H O W M U C H D O E

    S A S E N I O R D ATA E N G I N E E R / S C I E N T I S T M A K E ? https://www.glassdoor.com/Salaries/index.htm
  11. “In Data Engineering, if an expensive data scientist can’t work,

    it is an emergency.” https://blog.datasyndrome.com/rules-for-crash-course-data-engineering-d19bed5f277
  12. • Sanitize while processing data • Decouple components • Access

    data at multiple stages • Promote transparency • Automate! http://prismalytics.io/datapipeline/ Data Pipeline