Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Rage Against The Learning of the Machine
Errazudin Ishak
August 27, 2017
Technology
0
120
Rage Against The Learning of the Machine
Talk presented at Pycon APAC 2017, Kuala Lumpur, Malaysia.
Errazudin Ishak
August 27, 2017
Tweet
Share
More Decks by Errazudin Ishak
See All by Errazudin Ishak
The Spock Guide To Think Out of The Vagrant Box
errazudin
0
96
Develop and Deploy your Mobile API with Ruby on Rails, Nginx, Unicorn and Capistrano
errazudin
1
550
Rediscover Speed with Redis(and PHP)
errazudin
1
210
Other Decks in Technology
See All in Technology
暗号資産ウォレット入門(MetaMaskの入門~NFTの購入~詐欺の注意事項など)
kayato
2
140
220510 プロセスマイニングを学ぶ PLAY与田さん
comucal
PRO
0
370
組織でPower Virtual Agentsを導入するために知っておきたいこと
miyakemito
0
1.4k
tfcon-2022-cpp
cpp
5
4.4k
1年間のポストモーテム運用とそこから生まれたツール sre-advisor / SRE NEXT 2022
fujiwara3
5
2.6k
220428event_overview
caddi_eng
2
200
LINEのData Platform室が実践する大規模分散環境のCapacity Planning
line_developers
PRO
0
200
Power Query 日時の変換でちょっと焦ったケース +1 / Power Query Some cases
ishiayaya
0
140
エンジニアインターンの採用〜実際の開発への関与について for EM meetup#10
dmiyamoto
1
250
成長を続ける組織でのSRE戦略:プレモーテムによる信頼性の認識共有 SRE Next 2022
niwatakeru
7
2k
Power BI ”を” 可視化しよう!
hanaseleb
0
140
ITエンジニアを取り巻く環境とキャリアパス / A career path for Japanese IT engineers
takatama
0
550
Featured
See All Featured
What's new in Ruby 2.0
geeforr
336
30k
The Cult of Friendly URLs
andyhume
68
4.7k
GraphQLの誤解/rethinking-graphql
sonatard
24
6.1k
Practical Orchestrator
shlominoach
178
8.6k
Large-scale JavaScript Application Architecture
addyosmani
499
110k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
3
420
Making the Leap to Tech Lead
cromwellryan
113
6.9k
The Invisible Customer
myddelton
110
11k
Facilitating Awesome Meetings
lara
29
3.9k
Navigating Team Friction
lara
175
11k
Testing 201, or: Great Expectations
jmmastey
21
5.4k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
268
11k
Transcript
RAGE AGAINST THE LEARNING OF THE MACHINE ERRAZUDIN ISHAK
PYCON APAC 2017
AGENDA ABOUT ME WHAT ON EARTH FOR WHAT REASON SO
HOW TO DO THAT SUMMARY PYCON APAC 2017
ABOUT ME Data Masseuse Solutions Architect DevOps Freak Bitcoin Farmer
:) PYCON APAC 2017
I WAS HERE 2009: foss.my, MyGOSSCON 2010: PHP North West
(UK), Entp. PHP Techtalk, BarcampKL, MOSC.my, MyGOSSCON 2011: Wordpress Conf. Asia, Joomla! Day KL, MOSC.my, OWASP Day KL PYCON APAC 2017
I WAS HERE 2012: OWASP AppSec APAC (Sydney), MOSC.my 2013:
OSDC (Auckland), MOSC.my 2016: SCM Workshop UMP PYCON APAC 2017
WHAT ON EARTH? PYCON APAC 2017
WHAT ON EARTH? PYCON APAC 2017 ML
–Tom M.Mitchell, CMU “A computer program is said to learn
from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E.” TYPICAL EXPLANATION…..
WHAT ON EARTH? PYCON APAC 2017 Source : NVIDIA
FOR WHAT REASON PYCON APAC 2017 “…it is now the
golden age of Machine Learning” –Random guy “… because big guys (Google and Facebook) work on it” –Another random guy
FOR WHAT REASON PYCON APAC 2017
FOR WHAT REASON Web Search & Recommendation Engines Finance :
Stock, Fraud, Credit Check Healthcare : Drug Discovery, Computational Biology Text, Speech, Object Recognition Space, Astronomy PYCON APAC 2017
FOR WHAT REASON PYCON APAC 2017 “Drawing lines through data”
FOR WHAT REASON PYCON APAC 2017
FOR WHAT REASON PYCON APAC 2017 Classification : “Draw lines
to separate data” Source : ML Berkeley Labelled Data Decision Boundary (D.B.) More complicated algo, More complicated D.B. FOR WHAT REASON
FOR WHAT REASON PYCON APAC 2017 Regression : “Draw lines
to describe data” Source : ML Berkeley Labelled Data Probability Predictor FOR WHAT REASON
FOR WHAT REASON PYCON APAC 2017 Source : Brown EDU
SO HOW TO DO THAT Formulate the problem Design the
solution Bring up the data Technology to master Build ML model Evaluate, fine tune the quality Package it nicely PYCON APAC 2017
FORMULATE YOUR PROBLEM What : Describe it Why : Benefits
How : The flow (step-by-step) PYCON APAC 2017
BRING UP THE DATA Prepare (the right) Data Identify Outliers
Data Pre-Processing PYCON APAC 2017
TECHNOLOGIES “Right tools for the right job” PYCON APAC 2017
BUILD THE MODEL PYCON APAC 2017 The most challenging part
Build, Train, Test, Repeat
FINE TUNING Test harness Measuring the performance Datasets (Test, Training)
PYCON APAC 2017
FINE TUNING “If You Knew Which Algorithm or Algorithm Configuration
To Use, You Would Not Need To Use Machine Learning” - Jason Brownlee, PhD PYCON APAC 2017
PRESENTATION PYCON APAC 2017
SAMPLE #1 PYCON APAC 2017
FORMULATE YOUR PROBLEM PYCON APAC 2017 Toyota’s stock price on
January 6th 2017
FORMULATE YOUR PROBLEM PYCON APAC 2017 Ford’s stock price on
January 4th 2017
DESIGN THE SOLUTION PYCON APAC 2017 trump2cash Python Google Cloud
Natural Language API Wikidata Query Service Tradeking API
BUILD (PLAY WITH) THE MODEL PYCON APAC 2017
PRESENTATION PYCON APAC 2017
PRESENTATION PYCON APAC 2017
SAMPLE #2 : SPAM DETECTION PYCON APAC 2017 ML problem:
text classification Algorithms: naive bayes, linear classifiers, tree classifiers, all-you-want classifiers Technologies: sklearn, nltk, scrapy Data: sms spam dataset, e-mail spam dataset , youtube comments spam dataset
SUMMARY PYCON APAC 2017 Source : Google Cloud Next 2017
THANK YOU We’re Hiring errazudin.ishak@gmail.com PYCON APAC 2017