Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Better than Deep Learning: Gradient Boosting Machines (GBM) / 2019 edition - LA R Meetup - Santa Monica, May 2019

szilard
May 29, 2019
18

Better than Deep Learning: Gradient Boosting Machines (GBM) / 2019 edition - LA R Meetup - Santa Monica, May 2019

szilard

May 29, 2019
Tweet

More Decks by szilard

Transcript

  1. Better than Deep Learning: Gradient
    Boosting Machines (GBM) - 2019 edition
    Szilard Pafka, PhD
    Chief Scientist, Epoch
    LA West R Meetup, Santa Monica
    May 2019

    View full-size slide

  2. Disclaimer:
    I am not representing my employer (Epoch) in this talk
    I cannot confirm nor deny if Epoch is using any of the methods, tools,
    results etc. mentioned in this talk

    View full-size slide

  3. Source: Andrew Ng

    View full-size slide

  4. Source: Andrew Ng

    View full-size slide

  5. Source: Andrew Ng

    View full-size slide

  6. Source: https://twitter.com/iamdevloper/

    View full-size slide

  7. http://lowrank.net/nikos/pubs/empirical.pdf
    http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf

    View full-size slide

  8. http://lowrank.net/nikos/pubs/empirical.pdf
    http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf

    View full-size slide

  9. Source: Hastie etal, ESL 2ed

    View full-size slide

  10. Source: Hastie etal, ESL 2ed

    View full-size slide

  11. Source: Hastie etal, ESL 2ed

    View full-size slide

  12. Source: Hastie etal, ESL 2ed

    View full-size slide

  13. http://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf

    View full-size slide

  14. http://www.argmin.net/2016/06/20/hypertuning/

    View full-size slide

  15. no-one is using this crap

    View full-size slide

  16. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View full-size slide

  17. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View full-size slide

  18. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View full-size slide

  19. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View full-size slide

  20. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View full-size slide

  21. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View full-size slide