When to use Machine Learning: Tips, Tricks and Warnings

Artificial Intelligence, and machine learning in particular, is one of the hottest topics in tech/business. I will explain the core of machine learning, and the main goal of this talk will be to help you judge the success whenever someone yells “I know! let’s solve this using machine learning!”. I will also provide tips and tricks on how to increase the success of such projects. The second part of the talk will be about 2 open-source python projects I’ve created, as well as a project I’m working on regarding the trading of cryptocurrency… and their relation to machine learning. Specifically, the challenges and findings in making these cases work will be explored.

Transcript

1. When to use Machine Learning Tips, Tricks and Warnings Pascal van Kooten
2. whoami - MSc Methods & Statistics - Intel AI Innovator - Loves: - Open-source - Innovation - Human & Machine Interaction - Senior Data Scientist @ Jibes Data Analytics - 35 data scientists - 4 years and ~15 different companies - Worked on blockchain, social robots, NLP, ML/DL
3. Projects github.com/kootenpv kootenpv.github.io Gartner’s Hype Cycle
4. Today - What is Machine Learning exactly?* - When to use Machine Learning?* - Example driven * Might contain traces of code
5. What is machine learning exactly?
6. Learning what Machine Learning is (by data) age income 20 20000 30 30000 40 40000 50 50000 60 ?????
7. Learning what Machine Learning is (by data) age income 20 20000 30 30000 40 40000 50 50000 60 60000
8. Learning what Machine Learning is (by data) age income 20 20000 30 30000 40 40000 50 50000 60 60000
9. Decision Tree Source: SimaFore
10. Machine Learning - Predict whether email is spam or not: email spam/not spam Hi John, how are you? not spam* Click link for FREE … !! spam - Rather than write a lot of if/else statements - Learn logic based on existing input/output examples
11. Learning what Machine Learning is (by data) 1. Find a problem (X, y) 2. Preprocess 3. Find model(s) 4. Use best model in Prod
12. The Significance of Machine Learning Machine Learning AI Automation
13. The Significance of Machine Learning Machine Learning AI Automation
14. When to use Machine Learning
15. brightml Convenient Machine-Learned Automatic Brightness DEMO https://github.com/kootenpv/brightml
16. brightml
17. brightml - Feedback loop not noticeable - Zero config while still personalized - Are all features available that I want to use?
18. whereami Uses wifi signal and machine learning to predict where you are DEMO https://github.com/kootenpv/whereami
19. whereami - Pluggability is key - Easier to learn from observation vs coding rules vs config
20. Computer Vision X (image) y (dog) 80x80x3px 0 80x80x3px 1
21. Insurance company - Large broad insurance company - Investigate what Computer Vision could do for them - Task: predict damage $$$ from damaged car pictures
22. Insurance company
23. Insurance company
24. Insurance company: transfer learning
25. Insurance company - Strict rules already in place - Transfer learning can help - But…due to complexity... data...data...data…
26. Insurance company
27. Neural Complete https://github.com/kootenpv/neural_complete
28. Cryptocurrency Trading
29. Cryptocurrency Trading
30. Cryptocurrency - Don’t underestimate the work necessary next to machine learning - Analysis vs machine learning - Simple is better than complex
31. xtoy (automated machine learning) It does: - Variable prep - Clever missing values - Model selection (few models) & evolutionary param search
32. xtoy
33. xtoy - The pattern is all the same (X to y) - Though there are differences: - Images - Time series - Text data - *Look up “Data Science Machine”*
34. Automated machine learning - Make domain specific ML platform - pre-processing - cross-validation - anomaly detection - Deal with your core domain features - Only the final step is actually the models (most discussed with ML) - And then there is production
35. Conclusion - Machine learning is just a tool - But can be really powerful under the right circumstances - Can you easily create a feedback loop? - Don’t forget to think ahead: what could be useful features? - Pluggability is key - Don’t try to solve the most complex problems! - Don’t do it when many strict rules are already in place - Optimizing model is fun, but usually not the best option - Never underestimate the work required besides machine learning - Build a framework (for your company) to handle your usual data
36. Questions?