Software engineering practices applied to ML

Software engineering practices applied to ML

PyData London Meetup - April 2018 (https://www.meetup.com/PyData-London-Meetup/events/248973985/)

Stefano and Pavlos are engineers at HomeAway, and they'll talk about the benefits of applying good engineering practices when building ML-powered systems. The agenda will include:
- Feature engineering: does it have the same behaviour in training and prediction phases?
- CI/CD: are you checking for performance regressions in an automated fashion?
- Monitoring of your ML pipeline: are you sure your ML model works in production?

9a8cf536a1568332247e4ba0074558ab?s=128

Stefano Bonetti

April 03, 2018
Tweet

Transcript

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 15.
  13. 18.
  14. 19.
  15. 20.
  16. 21.
  17. 22.
  18. 23.
  19. 26.
  20. 27.
  21. 28.
  22. 29.
  23. 30.
  24. 31.
  25. 32.
  26. 33.
  27. 34.
  28. 35.

    def test_ml_models(hold_out_data_set): # For Baseline Model baseline_mae, baseline_rmse = _calculate_error_for_baseline_model(

    hold_out_data_set ) # For New Model new_model_mae, new_model_rmse = _calculate_error_for_new_model( hold_out_data_set ) assert new_model_mae < baseline_mae assert new_model_rmse < baseline_rmse
  29. 36.
  30. 37.
  31. 40.
  32. 41.
  33. 42.
  34. 43.
  35. 44.
  36. 45.
  37. 46.
  38. 47.
  39. 48.
  40. 49.
  41. 50.
  42. 55.
  43. 56.
  44. 57.