Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Better than Deep Learning: Gradient Boosting Machines (GBM) / 2019 edition - LA R Meetup - Santa Monica, May 2019

szilard
May 29, 2019
15

Better than Deep Learning: Gradient Boosting Machines (GBM) / 2019 edition - LA R Meetup - Santa Monica, May 2019

szilard

May 29, 2019
Tweet

More Decks by szilard

Transcript

  1. Better than Deep Learning: Gradient
    Boosting Machines (GBM) - 2019 edition
    Szilard Pafka, PhD
    Chief Scientist, Epoch
    LA West R Meetup, Santa Monica
    May 2019

    View Slide

  2. View Slide

  3. Disclaimer:
    I am not representing my employer (Epoch) in this talk
    I cannot confirm nor deny if Epoch is using any of the methods, tools,
    results etc. mentioned in this talk

    View Slide

  4. Source: Andrew Ng

    View Slide

  5. Source: Andrew Ng

    View Slide

  6. Source: Andrew Ng

    View Slide

  7. View Slide

  8. View Slide

  9. View Slide

  10. View Slide

  11. Source: https://twitter.com/iamdevloper/

    View Slide

  12. View Slide

  13. View Slide

  14. ...

    View Slide

  15. View Slide

  16. View Slide

  17. View Slide

  18. http://lowrank.net/nikos/pubs/empirical.pdf
    http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf

    View Slide

  19. http://lowrank.net/nikos/pubs/empirical.pdf
    http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf

    View Slide

  20. View Slide

  21. View Slide

  22. View Slide

  23. View Slide

  24. View Slide

  25. View Slide

  26. View Slide

  27. View Slide

  28. View Slide

  29. View Slide

  30. View Slide

  31. View Slide

  32. View Slide

  33. View Slide

  34. View Slide

  35. View Slide

  36. Source: Hastie etal, ESL 2ed

    View Slide

  37. Source: Hastie etal, ESL 2ed

    View Slide

  38. Source: Hastie etal, ESL 2ed

    View Slide

  39. Source: Hastie etal, ESL 2ed

    View Slide

  40. View Slide

  41. View Slide

  42. View Slide

  43. View Slide

  44. View Slide

  45. View Slide

  46. 10x

    View Slide

  47. View Slide

  48. View Slide

  49. View Slide

  50. 10x

    View Slide

  51. 10x

    View Slide

  52. View Slide

  53. View Slide

  54. View Slide

  55. View Slide

  56. View Slide

  57. View Slide

  58. View Slide

  59. View Slide

  60. View Slide

  61. View Slide

  62. View Slide

  63. View Slide

  64. View Slide

  65. View Slide

  66. View Slide

  67. View Slide

  68. View Slide

  69. View Slide

  70. View Slide

  71. View Slide

  72. View Slide

  73. View Slide

  74. View Slide

  75. View Slide

  76. View Slide

  77. View Slide

  78. View Slide

  79. View Slide

  80. View Slide

  81. View Slide

  82. View Slide

  83. View Slide

  84. View Slide

  85. View Slide

  86. View Slide

  87. View Slide

  88. View Slide

  89. View Slide

  90. View Slide

  91. View Slide

  92. http://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf

    View Slide

  93. http://www.argmin.net/2016/06/20/hypertuning/

    View Slide

  94. View Slide

  95. View Slide

  96. View Slide

  97. View Slide

  98. View Slide

  99. View Slide

  100. View Slide

  101. View Slide

  102. View Slide

  103. View Slide

  104. View Slide

  105. View Slide

  106. View Slide

  107. View Slide

  108. View Slide

  109. View Slide

  110. *

    View Slide

  111. View Slide

  112. no-one is using this crap

    View Slide

  113. (2018)

    View Slide

  114. (2018)

    View Slide

  115. View Slide

  116. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View Slide

  117. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View Slide

  118. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View Slide

  119. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View Slide

  120. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View Slide

  121. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/

    View Slide

  122. View Slide

  123. More:

    View Slide

  124. View Slide