jgs Definition § Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. § Classification – approximating a mapping function (f) from input variables (X) to discrete output variables (y). § Regression – approximating a mapping function (f) from input variables (X) to a continuous output variable (y). § Discretization – convert a regression problem to a classification problem
jgs Naïve Bayes § It is one of the most popular and simple machine learning classification algorithms § based on the Bayes Theorem for calculating probabilities and conditional probabilities § It can be extremely fast relative to other classification algorithms § It is easy to build and particularly useful for very large data sets § The name naive is used because it assumes the features that go into the model is independent of each other. That is changing the value of one feature, does not directly influence or change the value of any of the other features used in the algorithm.
jgs Outlook Temperat ure Humidity Windy Play Golf 0 Rainy Hot High False No 1 Rainy Hot High True No 2 Overcast Hot High False Yes 3 Sunny Mild High False Yes 4 Sunny Cool Normal False Yes 5 Sunny Cool Normal True No 6 Overcast Cool Normal True Yes 7 Rainy Mild High False No 8 Rainy Cool Normal False Yes 9 Sunny Mild Normal False Yes 10 Rainy Mild Normal True Yes 11 Overcast Mild High True Yes 12 Overcast Hot Normal False Yes 13 Sunny Mild High True No X1 X2 X3 X4 Y Frequency Table