Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Add more intelligence to your processes, Evgeny Vinogradov, Yandex.Money, CEE-SECR 2017

CEE-SECR
October 20, 2017

Add more intelligence to your processes, Evgeny Vinogradov, Yandex.Money, CEE-SECR 2017

My talk will sum up some of our experience in modifications of existing processes with machine learning. I will briefly describe challenges that we face when trying to add more intelligence to static rules, what technologies was employing for that aim, and give a few clues how to solve conflicts between different result obtained on single transaction and make final decision. Talk will be interesting among architects, PM, and all that are interested in data science.

CEE-SECR

October 20, 2017
Tweet

More Decks by CEE-SECR

Other Decks in Technology

Transcript

  1. Add more intelligence to your processes Evgeny Vinogradov, Head of

    BI Dev
  2. Areas › Suggestions

  3. Areas › Suggestions › Ranking › Scoring › Anomaly Detection

  4. Where 5

  5. Initial process Get Data Static decision Profit!

  6. Initial process

  7. Initial process Get Data Static decision Profit!

  8. Where › Replace? › Or Add?

  9. Desired process Get Data Intellectual decision Result

  10. Desired process Get Data Static Result Intellectual decision

  11. Evaluation

  12. Desired process Get Data Static Aggregation Result Intellectual decision

  13. How

  14. Components Process start Result Static

  15. Components Process start Result Static

  16. Dispatcher Process start Result Dispatcher Models Aggregation

  17. Dispatcher Process start Result Dispatcher Models Aggregation

  18. Models

  19. ML-specific stuff › Single model

  20. Ensembling › Bagging

  21. Ensembling › Bagging › Boosting › …

  22. Static rules

  23. What else?

  24. Feedback loop is very important ›Metrics Everywhere ›Repeat Training phase

  25. Dispatcher Process start Result Dispatcher Models Aggregation Fit Metrics Updates

  26. Moreover, realtime intelligence › Sigma › Iterative methods

  27. Key takeaways › Prepare aggregation/ensembling module › Implement Feedback loop

    › Make training faster
  28. Контакты +7(906)249-68-42 [email protected] Questions? Evgeny Vinogradov Head of BI Dev

    29