Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Benchmark of Open Source Tools for Machine Le...

Avatar for szilard szilard
July 02, 2017
1
330

A Benchmark of Open Source Tools for Machine Learning from R - UseR! 2017 Conference - Brussels, July, 2007

Avatar for szilard

szilard

July 02, 2017
Tweet

More Decks by szilard

See All by szilard
Gradient Boosting Machines (GBM): From Zero to Hero (with R and Python Code) - Data Con LA - Oct 2020
Avatar for szilard szilard
0
210
Make Machine Learning Boring Again: Best Practices for Using Machine Learning in Businesses - Albuquerque Machine Learning Meetup (Online) - Aug 2020
Avatar for szilard szilard
0
160
Better than Deep Learning: Gradient Boosting Machines (GBM) - eRum conference - invited talk - June 2020
Avatar for szilard szilard
0
140
Gradient Boosting Machines (GBM): From Zero to Hero (with R and Python Code) - LA Data Science Meetup - February 2020
Avatar for szilard szilard
0
130
A Random Walk in Data Science and Machine Learning in Practice - CEU, Business Analytics Masters - Budapest, Febr 2020
Avatar for szilard szilard
0
320
Better than My Meetup/Conference Talks: Going Deeper in Various GBM Topics - GBM Advanced Workshop - Budapest, Nov 2019
Avatar for szilard szilard
0
97
Gradient Boosting Machines (GBM): From Zero to Hero (with R and Python Code) - Budapest BI Forum, Budapest, Nov 2019
Avatar for szilard szilard
0
150
Make Machine Learning Boring Again: Best Practices for Using Machine Learning in Businesses - LA Data Science Meetup - Playa Vista, August 2019
Avatar for szilard szilard
0
140
Better than Deep Learning: Gradient Boosting Machines (GBM) / 2019 edition - Budapest R and Data Science Meetups - Budapest, June 2019
Avatar for szilard szilard
0
120

Featured

See All Featured
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
220
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
34k
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
200
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
230
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
1
110
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.1k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
62
50k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
750
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
9.7k
How to Align SEO within the Product Triangle To Get 
Buy-In & Support - #RIMC
Avatar for Aleyda Solis aleyda
1
1.4k

Transcript

  1. A Benchmark of Open Source Tools for Machine Learning from

    R Szilárd Pafka, PhD Chief Scientist, Epoch useR! 2017 Conference Brussels, July 2017
  2. None

  3. Disclaimer: I am not representing my employer (Epoch) in this

    talk I cannot confirm nor deny if Epoch is using any of the methods, tools, results etc. mentioned in this talk
  4. None
  5. None
  6. None
  7. None
  8. None
  9. None
  10. None

  11. binary classification, 10M records numeric & categorical features, non-sparse

  12. http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf http://lowrank.net/nikos/pubs/empirical.pdf

  13. http://www.cs.cornell.edu/~alexn/papers/empirical.icml06.pdf http://lowrank.net/nikos/pubs/empirical.pdf

  14. None
  15. None
  16. None
  17. None

  18. EC2

  19. n = 10K, 100K, 1M, 10M, 100M Training time RAM

    usage AUC CPU % by core read data, pre-process, score test data

  20. n = 10K, 100K, 1M, 10M, 100M Training time RAM

    usage AUC CPU % by core read data, pre-process, score test data
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None

  28. 10x

  29. None
  30. None
  31. None
  32. None
  33. None

  34. http://datascience.la/benchmarking-random-forest-implementations/#comment-53599

  35. None
  36. None
  37. None
  38. None
  39. None
  40. None

  41. Best linear: 71.1

  42. None
  43. None

  44. learn_rate = 0.1, max_depth = 6, n_trees = 300 learn_rate

    = 0.01, max_depth = 16, n_trees = 1000
  45. None
  46. None
  47. None
  48. None
  49. None
  50. None
  51. None

  52. ...

  53. None
  54. None
  55. None
  56. None
  57. None
  58. None
  59. None
  60. None
  61. None
  62. None
  63. None

  64. R++

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None
  73. None
  74. None
  75. None
  76. None