Better than Deep Learning: Gradient Boosting Machines (GBM) / 2019 edition - LA R Meetup - Santa Monica, May 2019

Transcript

1. Better than Deep Learning: Gradient
   Boosting Machines (GBM) - 2019 edition
   Szilard Pafka, PhD
   Chief Scientist, Epoch
   LA West R Meetup, Santa Monica
   May 2019
   

   View Slide

2. View Slide

3. Disclaimer:
   I am not representing my employer (Epoch) in this talk
   I cannot confirm nor deny if Epoch is using any of the methods, tools,
   results etc. mentioned in this talk
   

   View Slide

4. Source: Andrew Ng
   

   View Slide

5. Source: Andrew Ng
   

   View Slide

6. Source: Andrew Ng
   

   View Slide

7. View Slide

8. View Slide

9. View Slide

10. View Slide

11. Source: https://twitter.com/iamdevloper/
    

    View Slide

12. View Slide

13. View Slide

14. ...
    

    View Slide

15. View Slide

16. View Slide

17. View Slide

18. http://lowrank.net/nikos/pubs/empirical.pdf
    http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf
    

    View Slide

19. http://lowrank.net/nikos/pubs/empirical.pdf
    http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf
    

    View Slide

20. View Slide

21. View Slide

22. View Slide

23. View Slide

24. View Slide

25. View Slide

26. View Slide

27. View Slide

28. View Slide

29. View Slide

30. View Slide

31. View Slide

32. View Slide

33. View Slide

34. View Slide

35. View Slide

36. Source: Hastie etal, ESL 2ed
    

    View Slide

37. Source: Hastie etal, ESL 2ed
    

    View Slide

38. Source: Hastie etal, ESL 2ed
    

    View Slide

39. Source: Hastie etal, ESL 2ed
    

    View Slide

40. View Slide

41. View Slide

42. View Slide

43. View Slide

44. View Slide

45. View Slide

46. 10x
    

    View Slide

47. View Slide

48. View Slide

49. View Slide

50. 10x
    

    View Slide

51. 10x
    

    View Slide

52. View Slide

53. View Slide

54. View Slide

55. View Slide

56. View Slide

57. View Slide

58. View Slide

59. View Slide

60. View Slide

61. View Slide

62. View Slide

63. View Slide

64. View Slide

65. View Slide

66. View Slide

67. View Slide

68. View Slide

69. View Slide

70. View Slide

71. View Slide

72. View Slide

73. View Slide

74. View Slide

75. View Slide

76. View Slide

77. View Slide

78. View Slide

79. View Slide

80. View Slide

81. View Slide

82. View Slide

83. View Slide

84. View Slide

85. View Slide

86. View Slide

87. View Slide

88. View Slide

89. View Slide

90. View Slide

91. View Slide

92. http://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf
    

    View Slide

93. http://www.argmin.net/2016/06/20/hypertuning/
    

    View Slide

94. View Slide

95. View Slide

96. View Slide

97. View Slide

98. View Slide

99. View Slide

100. View Slide

101. View Slide

102. View Slide

103. View Slide

104. View Slide

105. View Slide

106. View Slide

107. View Slide

108. View Slide

109. View Slide

110. *
     

     View Slide

111. View Slide

112. no-one is using this crap
     

     View Slide

113. (2018)
     

     View Slide

114. (2018)
     

     View Slide

115. View Slide

116. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/
     

     View Slide

117. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/
     

     View Slide

118. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/
     

     View Slide

119. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/
     

     View Slide

120. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/
     

     View Slide

121. Source: https://www.linkedin.com/pulse/winning-solution-kaggledays-2019-competition-san-francisco-mark-peng/
     

     View Slide

122. View Slide

123. More:
     

     View Slide

124. View Slide