Building a Real-World Pipeline for Image-Classification

How we've build image-classification real-time at heycar. From building the model, up to creating the architecture.

This is the short version, high-overview.

Transcript

1. IMAGE-CLASSIFICATION Building a Real-World Pipeline for
2. IMAGE-CLASSIFICATION Building a Real-World Pipeline for
3. Jonathan Greve Machine Learning Engineer Marcelo Boeira Platform Engineer
5. User Experience
6. User Experience
7. User Experience
8. User Experience
9. User Experience
10. User Experience
11. User Experience
12. User Experience
13. User Experience WHY?
14. User Experience
15. User Experience
16. Problem
18. ?
19. People
22. 500k cars
23. 500k cars * ~12 img
24. 500k cars * ~12 img = 6M
25. ~2 years for 1 person that tags 6 images per minute
26. ~2 years for 1 person that tags 6 images per minute impacts too much on time-to-market
27. Science
29. interior text content not a car watermark logo brand car
30. text content car
31. car text content
32. 840 341 269 873 289 269 192 291 465 269 910 748 289 269 840 341 car text content
33. 840 341 269 873 289 269 192 291 465 269 910 748 289 269 840 341 car text content ?
34. 840 341 269 873 289 269 192 291 465 269 910 748 289 269 840 341 car text content Tensor Flow
35. Data
36. How to collect Data?
37. Inception V3 MVP ~0.05s /image *6M images
38. Inception V3 MVP ~83 hours
39. Custom Model ~0.02s /image *6M images
40. Custom Model ~33 hours
41. Custom Model
42. Analysis
43. Model
44. Classification Error
45. Engineering
47. Ingestion image-ingestion-api
48. Ingestion image-ingestion-api file-storage
49. Ingestion image-ingestion-api image-database file-storage
50. Ingestion image-ingestion-api image-database file-storage
51. Ingestion image-ingestion-api image-database file-storage
52. Ingestion image-ingestion-api image-database image-stream file-storage
53. file-storage image-stream Processing image-classifcation-worker
54. file-storage image-stream Processing image-classifcation-worker
55. file-storage image-stream Processing image-classifcation-worker Tensor Flow 840 341 269 873 289 269 192 291 465 269 910 748 289 269 840 341
56. file-storage image-stream Processing image-classifcation-worker Tensor Flow 840 341 269 873 289 269 192 291 465 269 910 748 289 269 840 341 car: true text_content: false
57. file-storage image-stream Processing image-classifcation-worker Tensor Flow 840 341 269 873 289 269 192 291 465 269 910 748 289 269 840 341 image-classification-database car: true text_content: false
58. image-classification-database image-classification—stream Serving
59. image-classification-database image-classification—stream Serving indexing listing-stream image-stream
60. image-classification-database search filtering ranking image-classification—stream Serving indexing listing-stream image-stream recommendation
61. search Serving web-app https://hey.car
62. Results
63. Partner Feed Integration
64. Website
65. Website
66. What’s next?
67. Position
68. Thanks medium.com/heycar
69. Thanks
70. Questions?
71. TEXT