What Benz: picking up the best Mercedes for yourself and other coolstories

My talk on Munich ODS meetup
https://www.meetup.com/Munich-Data-Science/events/266659553/

Transcript

1. What Benz: picking up the best Mercedes for yourself and other cool stories Alex Tselikov Engineering Lead Data @ KI labs GmbH
2. | 2 © KI labs GmbH - All Rights Reserved. Who Am I • Ph.D. in computer science, specialization data analysis • Data Science & Data Analysis background in industry and academia • Engineering Lead Data, KI labs GmbH, Munich • Data engineering at scale • Data team lead (data scientists/engineers)
3. | 3 © KI labs GmbH - All Rights Reserved. Intro
4. | 4 © KI labs GmbH - All Rights Reserved. Intro
5. | 5 © KI labs GmbH - All Rights Reserved. What is WhatBenz about? • getting car’s details info and store the history of models • getting info about car’s availability on the market • get the closest car (e.g. take picture of Tesla and get a closest model from Mercedes Benz’s model range) • getting closest car’s availability info on the market * This project is not affilitated with Daimler, and uses dummy data
6. | 6 © KI labs GmbH - All Rights Reserved. Architecture
7. | 7 © KI labs GmbH - All Rights Reserved. How we collected data ["Mercedes Benz", "S", ["coupe", "sedan", "cabriolet"], 2018, ["", "AMG"]], ["Mercedes Benz", "S", "sedan", 2018, "Maybach"], ["Mercedes Benz", "CLA", ["coupe", "shooting-brake"], 2018, ["", "AMG"]], ["Mercedes Benz", "CLS", "sedan", 2019, ["", "AMG"]], ["Mercedes Benz", "GLA", "SUV", 2018, "AMG"], ["Mercedes Benz", "GLC", ["coupe", "SUV"], 2018, ["", "AMG"]], ["Mercedes Benz", "GLE", ["coupe", "SUV"], 2019], ["Mercedes Benz", "GLE", "coupe", 2019, "AMG"], ["Mercedes Benz", "GLS", ["SUV"], 2019], ["Mercedes Benz", "EQC", ["SUV"], 2019], ["Mercedes Benz", "G", "SUV", 2018, ["", "AMG"]], ["Mercedes Benz", "X", "pickup", 2018], ["Mercedes Benz", "V", "van", 2018], ["Mercedes Benz", "SL", "roadster", 2018], ["Mercedes Benz", "SLC", "roadster", 2018, ["", "AMG"]], ["Mercedes Benz", "GT", ["coupe", "roadster", "4-door coupe"], 2018, "AMG"] Image scraping with selenium and Imgscrape to automate web browser interaction
8. | 8 © KI labs GmbH - All Rights Reserved. The hardest job in Data Science: Data cleaning!
9. | 9 © KI labs GmbH - All Rights Reserved. Model training Pre-trained & finetuned resnet34 (pytorch)
10. | 10 © KI labs GmbH - All Rights Reserved. How model works Top losses: ('S_cabriolet_2018‘, 'C_cabriolet_2018', 11), ('C_coupe_2018‘, 'S_coupe_2018', 10), ('A_sedan_2019‘, 'A_hatchback_2019', 9), ('E_cabriolet_2018‘, 'S_cabriolet_2018', 8),
11. | 11 © KI labs GmbH - All Rights Reserved. Model serving with Azure ML services (ps. it’s hard!) https://docs.microsoft.com/en- us/azure/machine-learning/service/how- to-deploy-and-where https://github.com/KI-labs/what-benz- showcase/blob/master/car-recognition- backend/notebooks/what_benz_classifier.i pynb
12. | 12 © KI labs GmbH - All Rights Reserved. Meet KAOS: serve your models with ease
13. | 13 © KI labs GmbH - All Rights Reserved. What benz use-case: KAOS https://ki-labs.com/kaos/
14. | 14 © KI labs GmbH - All Rights Reserved. We need an API
15. | 15 © KI labs GmbH - All Rights Reserved. First MVP!
16. | 16 © KI labs GmbH - All Rights Reserved. • iOS, Android Apps (Possibility of a Web version) • Flutter Framework • Master Data Integration via API • Beta build distribution via Testflight & Google Play Mobile stack: Web is cool, but people carry Smartphones around
17. | 17 © KI labs GmbH - All Rights Reserved. More examples
18. | 18 © KI labs GmbH - All Rights Reserved. What could we do more in future? Ideas welcome! • recommend a specific car based on a history of taken pictures • predict car availability and inform the user about it • inform the user about changing a price or discounts for certain car or similar models • getting the nearest dealer with available cars of this type based on the user’s location • What Tires extension: recommend accessories.
19. | 19 © KI labs GmbH - All Rights Reserved. Personalized model recommendation
20. BeerBot Thank you! Questions? https://ki-labs.com/kaos/
21. Future of Mobility Data science and data engineering are backbone of future services around connected mobility 6. Dezember 2019
22. | 22 © KI labs GmbH - All Rights Reserved. KI labs + Cars + Data Science = : Project 1 Matching car sales agents to the prospect who is perfectly matched to the agent
23. | 23 © KI labs GmbH - All Rights Reserved. KI labs + Cars + Data Science = : Project 2 A mobile solution capable to - understand user’s behavior by collecting data via mobile App sensors and - make predictions and interact with Connected Cars to automatically execute commands COLLECT DATA ANALYSE / PREDICT AUTOMATE ACTIONS - Activities - GPS - Bluetooth - WiFi - Detect POI’s - Identify Routines - Make Predictions - Turn ON/OFF AC system - Turn ON/OFF Seat Heating/Cooling - Seat adjustments