2019_11_14_NDE_Meetup_Slides.pdf

Transcript

1. NOVA Data Engineering November 14, 2019 1
2. Agenda • Upcoming Events and Announcements • Introduction of NOVA Data Engineering and who is this guy! • Planning NOVA Data Engineering • Social Media for NOVA Data Engineering • Resources of Data Engineering • Background of Data Engineering • Videos • What is Plumbers of Data Science (Video 3 minutes) • The Right Path to Becoming a Data Engineer (Video 30 minutes) 2
3. Thank You!!! • A huge thanks for Jacobs hosting this event and providing the food and drinks! • Thanks to you for attending tonight! 3
4. Upcoming Events And Announcements • AWS re:Invent | December 2-6, 2019 | Las Vegas, NV • PyCon | April 15-23, 2020 | Pittsburgh, PA • Data Council | April 2020 | San Francisco • Others • O’Reilly - AI, Strata Data, TensorFlow • Databricks – Spark Summit • Programming – Python, Scala, Java, Go • Sponsors (Facility and/or Food) • Jobs (Hiring/Looking) 4
5. Introduction of NOVA Data Engineering and who is this guy! • Bill Glennon • Data Engineer at KeyW Acquired by Jacobs • AWS Solutions Architect Certified and Big Data Specialty Certified • Security background CISSP • RDBMS and NOSQL • Love to learn!!! • Why did I start it? • Experience in leading meetups • NOVA Data Science • NOVA Deep Learning 5
6. Planning of NOVA Data Engineering • Some ideas • Speakers (Any recommendations for speakers?) Frequency – Every 3 months? • Kafka (Udemy) • 7.5 hours of video / 2 Meetups • Rock the JVM! Scala and Functional Programming for Beginners (Udemy) • 15.5 Hours / 3 Meetups • Apache Spark 2 with Scala - Hands on with Big Data (Udemy) • 7.5 hours / 2 Meetups • Docker/Kubernetes (2 Books) • Docker Deep Dive by Nigel Poulton/The Kubernetes Book by Nigel Poulton / 3 meetups • Apache Spark (1 Book) • Apache Spark: The Definitive Guide / 4 Meetups • Your thoughts? 6
7. Social Media for NOVA Data Engineering • Twitter @NOVADATAENG • Slack novadataengineering.slack.com 7
8. Resources for Data Engineering • Plumbers of Data Science • Data Engineering Cookbook • Online Learning • Udacity – Data Engineering Nanodegree • Dataquest – Data Engineering Certification • AWS Big Data Specialty (Changing names soon) • Not sure what Azure and GCP have? • Udemy, Udacity, Rock the JVM, Linux Academy, A Cloud Guru, edX, etc… for a variety of areas – Spark, Java, Python, Scala, Kafka, Databases, Docker, AWS … 8
9. Resources for Data Engineering Continued • Newsletters • Data Eng Weekly - Your weekly Data Engineering news • SF Data Weekly - A weekly email of useful links for people interested in building data platforms • Data Elixir - Data Elixir is an email newsletter that keeps you on top of the tools and trends in Data Science. • Podcasts • Data Engineering Podcast 9
10. Background of Data Engineering • From Data Engineering Introduction and Epochs (panoply.io) • https://bit.ly/2NBhh2N • The 50s and 60s: Business Intelligence is (re)Born • The 70s and 80s: Information Engineering Comes to Life • The 1990s: The Rise of the Internet and the Democratization of Data • The 2000s to Today: The Emergence and Mainstreaming of Big Data 10
11. Background of Data Engineering Continued 11 https://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007
12. Videos • What is Plumbers of Data Science (Video 3 minutes) • https://www.youtube.com/watch?v=gJJg0hcTgjM • The Right Path to Becoming a Data Engineer (Video 30 minutes) • https://www.youtube.com/watch?v=wlWLBJukhj0 12