ISI Programming Course - 05 - Python Data Science Libraries

Github: https://github.com/thejungwon/ISI-programming-class/tree/master/exercises/week-05

Transcript

1. ISI Programming Class Python Data Science Libraries Jungwon Seo | University of Stavanger
2. It’s all about using libraries
3. Anyone who can code Matlab?
4. Anyone who can code R?
5. NumPy • Support for large, multi-dimensional arrays and matrices. • High-level mathematical functions for those arrays. • https://github.com/numpy/numpy
6. Do you remember this question?
7. If you use NumPy You can code like Matlab or R.
8. Are you an Excel genius?
9. Pandas?
10. Pandas • Data manipulation and analysis • Data structure and operations for numerical tables and time series. • The name is derived from the term "panel data” • https://github.com/pandas-dev/pandas
11. Question #1 • You have data with 10,000 rows, however, many of them consist of empty cells (missing data). How can you remove the rows where more than half of the cells are empty?
12. Question #2 • You want to merge two randomly sorted student information data sets. • One table has the course grades and the other has personal information. • How will you match the pair? • Imagine “Copy and Paste” after sorting in the Excel sheet.
13. Question #3 • You need to calculate the count, mean, std, min, 25%, 50%, 75%, and max values in the specific row. • You need to figure out the number of unique values, the most frequent value, and the frequency.
14. You can solve these tasks using Pandas without having a bunch of ‘if-else’ and ‘for’.
15. One picture is worth a thousand words
16. Matplotlib • Plotting library • Designed to closely resemble that of MATLAB • https://github.com/matplotlib/matplotlib
17. You can find most types of charts https://matplotlib.org/gallery/index.html
18. Imagine. You are the boss. Your employees prepare a report with no chart.
19. Let’s get started!
20. 1. NumPy • Scalar, Vector, Matrix, (Tensor) • Array creation • Array selection • Array operation Source Code
21. 2. Pandas • DataFrame basic • Data handling • Data Input and Output Source Code
22. • Basic plotting • Trying different types of charts 3. Matplotlib Source Code
23. Thank you