Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Artificial Intelligence Beyond

Karol Przystalski
May 19, 2018
87

Artificial Intelligence Beyond

This presentation was held during LDI conference in May 2018.

Karol Przystalski

May 19, 2018
Tweet

Transcript

  1. What is machine learning? "A computer program is said to

    learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." — Tom M. Mitchell
  2. What is machine learning? "A computer program is said to

    learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." — Tom M. Mitchell "Machine learning is the training of a model from data that generalizes a decision against a performance measure." — Jason Brownlee
  3. What is machine learning? "A computer program is said to

    learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." — Tom M. Mitchell "Machine learning is the training of a model from data that generalizes a decision against a performance measure." — Jason Brownlee "A branch of artificial intelligence in which a computer generates rules underlying or based on raw data that has been fed into it." — Dictionary.com
  4. What is machine learning? "A computer program is said to

    learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." — Tom M. Mitchell "Machine learning is the training of a model from data that generalizes a decision against a performance measure." — Jason Brownlee Source: Practical Machine Learning, S. Gollapudi, Packt 2016 "A branch of artificial intelligence in which a computer generates rules underlying or based on raw data that has been fed into it." — Dictionary.com "Machine learning is a scientific discipline that is concerned with the design and development of algorithms that allow computers to evolve behaviors based on empirical data, such as from sensor data or databases." — Wikipedia
  5. Short history 1950 Bayes theorem, Markov chains, (...) 1957 Rosenblatt’s

    Perceptron 1967 Nearest Neighbor 1985 Sejnowski’s NetTalk 1986 Backpropagation 1989 Reinforcement learning 1995 Random forest 1995 SVM Before
  6. Short history 1950 Bayes theorem, Markov chains, (...) 1957 Rosenblatt’s

    Perceptron 1967 Nearest Neighbor 1985 Sejnowski’s NetTalk 1986 Backpropagation 1989 Reinforcement learning 1995 Random forest 1995 SVM Before 1997 Deep Blue beats Kasparov 1998 MNIST database 2006 Deep learning 2006 Netflix challenge 2010 Kaggle 2011 Watson beats Jeopardy competitors 2012 Google Xlab 2015 Stephen Hawking, Elon Musk and al. letter Source: Forbes
  7. Taxonomy Supervised - labeled data set; method is learning based

    on labeled data and assign a label when classifying 1.
  8. Taxonomy Supervised - labeled data set; method is learning based

    on labeled data and assign a label when classifying Unsupervised - unlabeled data set; also known as clustering; method is trained and tested on unlabeled data sets 1. 2.
  9. Taxonomy Supervised - labeled data set; method is learning based

    on labeled data and assign a label when classifying Unsupervised - unlabeled data set; also known as clustering; method is trained and tested on unlabeled data sets Reinforcement learning - the method is learning on unlabeled data sets, but got penalties or reward - depends on the classification result 1. 2. 3.
  10. Taxonomy Supervised - labeled data set; method is learning based

    on labeled data and assign a label when classifying Unsupervised - unlabeled data set; also known as clustering; method is trained and tested on unlabeled data sets Reinforcement learning - the method is learning on unlabeled data sets, but got penalties or reward - depends on the classification result Deep learning - a group of methods that are based on deep neural networks 1. 2. 3. 4.
  11. Taxonomy - 5 fundamental questions 1. Is this A or

    B? Classification 2. Is this weird? Anomaly detection
  12. Taxonomy - 5 fundamental questions 1. Is this A or

    B? Classification 2. Is this weird? Anomaly detection 3. How much / how many ? Regression
  13. Taxonomy - 5 fundamental questions 1. Is this A or

    B? Classification 2. Is this weird? Anomaly detection 3. How much / how many ? Regression 4. How is this organized? Clustering
  14. Taxonomy - 5 fundamental questions 1. Is this A or

    B? Classification 2. Is this weird? Anomaly detection 3. How much / how many ? Regression 4. How is this organized? Clustering 5. What should I do next? Reinforcement learning
  15. The process It consist of few steps: 1. Assemble data

    2. Preprocessing 3. Feature extraction 4. Feature selection 5. Training 6. Prediction 7. Validation
  16. Applications → security, → medical diagnosis, → customer service, →

    financial analytics - i.e. risk management, insurance prediction, → blockchain, → self-driving cars, → test automation, → and many more
  17. Medical diagnosis Skin cancer diagnostic tool that consist of a

    device and machine learning methods that is used for melanoma pattern recognition. This solution is dedicated for General Practicioners
  18. Sentiment Analysis Sentiment Analysis can be used for analysing customer

    satisfaction to be better informed about our customer service. Another use case is company sentiment. It measures how is the market reacting on news related the company. We have proven some advantages of building your own sentiment analysis compared to the commonly used libraries like CoreNLP: https://codete.com/blog/real-time-sentiment-analysis-with-machine-learning/ Find our recent training on Sentiment Analysis: https://www.safaribooksonline.com/live-training/
  19. Sentiment Analysis Sentiment analysis is also a crucial part of

    each chatbot. Our solution is open source and available at: https://github.com/codete/sentiment-analysis-rd
  20. Chatbots AI can be used to automate some processes. One

    of such process is customer service replaced with chatbots. There are three chatbots generations: 1. Rule-based 2. Retrieval-based 3. Generative-based A teaser of our bot workshops can be found on Github: https://github.com/codete/bots Microsoft Tay
  21. Financial analytics TalkingData AdTracking Fraud Detection Challenge The Big Data

    Combine Engineered by BattleFin - Sentiment analysis for stock prediction Allianz Actuarial Kaggle Competition #1 - Motor insurance prediction Allstate Purchase Prediction Challenge - Predict a purchased policy based on transaction history Risky Business - Predict the risk of customer credit default Liberty Mutual Group - Fire Peril Loss Cost - Predict expected fire losses for insurance policies AXA Driver Telematics Analysis - Use telematic data to identify a driver signature Prudential Life Insurance Assessment - Can you make buying life insurance easier? BNP Paribas Cardif Claims Management - Can you accelerate BNP Paribas Cardif's claims management process?
  22. Financial analytics Santander Customer Satisfaction - Which customers are happy

    customers? Santander Product Recommendation - Can you pair products with people? Two Sigma Financial Modeling Challenge - Can you uncover predictive value in an uncertain world? Transfer Learning on Stack Exchange Tags - Predict tags from models trained on unrelated topics Two Sigma Connect: Rental Listing Inquiries - How much interest will a new rental listing on RentHop receive? Sberbank Russian Housing Market - Can you predict realty price fluctuations in Russia’s volatile economy? Algorithmic Trading Challenge - Develop new models to accurately predict the market response to large trades. Will I Stay or Will I Go? - Predict which of our current customers will stay insured with us for an entire policy term.
  23. Blockchain AI is connected in many articles as potential usage

    of AI and Blockchain as a distributed AI. From our experience AI is used more as a part of the process rather than used within Blockchain directly.
  24. Buzzwords, buzzwords everywhere ... There are many mature companies and

    startups that can be sometimes buzzword oriented. It means that they want to use a technology at any costs, just because it is the current trend. Unfortunately, developers do sometimes the same.
  25. Trends for next years - NIPS Mastering Games with Deep

    Reinforcement Learning Preventing Gradient Explosions in Gated Recurrent Units Deep Exploration Via Randomized Value Functions Fast-Slow Recurrent Neural Networks Artificial Intelligence Goes All-In Regularizing Deep Neural Networks by Noise: Its Interpretation and Optimization Interpolated Policy Gradient: Merging On-Policy and Off-Policy Gradient Estimation for Deep Reinforcement Learning Train Longer, Generalize Better: Closing the Generalization Gap in Large Batch Training of Neural Networks Self-Normalizing Neural Networks
  26. Trends for next years - NIPS Deep Reinforcement Learning with

    Subgoals Meta-Learning Shared Hierarchies On Quadratic Convergence of DC Proximal Newton Algorithm in Nonconvex Sparse Learning Robust Optimization for Non-Convex Objectives Variance-based Regularization with Convex Objectives The Marginal Value of Adaptive Gradient Methods in Machine Learning Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models Harmonica
  27. Trends for next years - NIPS Soft-DTW, a Differentiable Loss

    for Time-Series A Unified Approach to Interpreting Model Predictions Learning Linear Dynamical Systems via Spectral Filtering Stochastic and Adversarial Online Learning without Hyperparameters A New Theory for Matrix Completion Generalization Properties of Learning with Random Features Approximation and Convergence Properties of Generative Adversarial Learning Spectrally-normalized Margin Bounds for Neural Networks
  28. Trends for next years - NIPS Soft-DTW, a Differentiable Loss

    for Time-Series A Unified Approach to Interpreting Model Predictions Learning Linear Dynamical Systems via Spectral Filtering Stochastic and Adversarial Online Learning without Hyperparameters A New Theory for Matrix Completion Generalization Properties of Learning with Random Features Approximation and Convergence Properties of Generative Adversarial Learning Spectrally-normalized Margin Bounds for Neural Networks
  29. Trends for next years - Strata Hadoop under attack: Securing

    data in a banking domain Deep learning for recommender systems Advanced data science with Spark Streaming Designing ethical artificial intelligence Improving DevOps and QA efficiency using machine learning and NLP methods Blind men and elephants: What’s missing from your big data? Machine-learned model quality monitoring in fast data and streaming applications Model parallelism in Spark ML cross-validation Using Python to analyze financial markets Deep learning with TensorFlow and Spark using GPUs and Docker containers
  30. Internships and PoC for students We would like to invite

    join our Data Science internship. It consists of two paths: • Data Engineer • Data Analyst Feel free to apply for our Data Science PoC program for MSc and PhD students.