Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What is Data Engineering?

Kan Ouivirach
February 27, 2019

What is Data Engineering?

Data Engineering helps make the world/organization a better place with "Open Data".

Kan Ouivirach

February 27, 2019
Tweet

More Decks by Kan Ouivirach

Other Decks in Technology

Transcript

  1. K A N O U I V I R A

    C H W H AT I S D ATA E N G I N E E R I N G ?
  2. Photo by Frank Vex on Unsplash Companies use DATA to

    answer these business questions: • What is our churn rate? • Are we doing better? How can we improve our services? • Any recommendation to generate more revenue from repeated customers?
  3. M A K I N G D ATA S C

    I E N C E B E T T E R
  4. M A K I N G D ATA S C

    I E N C E B E T T E R
  5. M A K I N G D ATA S C

    I E N C E B E T T E R Data Engineering helps make the world/organization a better place with “Open Data”.
  6. Use programming languages to ensure clean, reliable, and performative access

    to data and databases D ATA E N G I N E E R https://medium.freecodecamp.com/the-rise-of-the-data-engineer-91be18f1e603 The Rise of the Data Engineer
  7. D ATA E N G I N E E R

    V S . D ATA S C I E N T I S T https://www.datacamp.com/community/blog/data-scientist-vs-data-engineer
  8. D ATA E N G I N E E R

    V S . D ATA S C I E N T I S T Updated Feb 25, 2019
  9. H O W M U C H D O E

    S A D ATA E N G I N E E R / S C I E N T I S T M A K E ? https://www.glassdoor.com/Salaries/index.htm
  10. H O W M U C H D O E

    S A S E N I O R D ATA E N G I N E E R / S C I E N T I S T M A K E ? https://www.glassdoor.com/Salaries/index.htm
  11. “In Data Engineering, if an expensive data scientist can’t work,

    it is an emergency.” https://blog.datasyndrome.com/rules-for-crash-course-data-engineering-d19bed5f277
  12. • Sanitize while processing data • Decouple components • Access

    data at multiple stages • Promote transparency • Automate! http://prismalytics.io/datapipeline/ Data Pipeline