Upgrade to Pro — share decks privately, control downloads, hide ads and more …

PicCell : Flooding your service with AI

PicCell : Flooding your service with AI

Joonsik Baek
LINE Plus LPE4 MediaPlatform Software Engineer
https://linedevday.linecorp.com/jp/2019/sessions/F1-6

LINE DevDay 2019

November 20, 2019
Tweet

More Decks by LINE DevDay 2019

Other Decks in Technology

Transcript

  1. 2019 DevDay PicCell : Flooding Your Service With AI >

    Joonsik Baek > LINE Plus LPE4 MediaPlatform Software Engineer
  2. 4

  3. 5 ?

  4. 6 !

  5. 21 Media Platform Video Image Audio File Who Is Qualified

    OBSObject Storage - More Than 80 Services
  6. 22 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services
  7. 23 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services - MAX 1.5 Tbps Traffic - 100 PB Storage
  8. 24 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services - MAX 1.5 Tbps Traffic - 100 PB Storage
  9. 25 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services - MAX 1.5 Tbps Traffic - 100 PB Storage
  10. > 0.9 F1 Score 3.5M
 Training Samples ResNet 50
 Based

    31 Adult Content Filter 3 Classes
 (Adult, Sexy, Normal) 1.1M Test Set
  11. 300ms
 Processing Time > 0.9 F1 Score 3.5M
 Training Samples

    ResNet 50
 Based 32 Adult Content Filter 3 Classes
 (Adult, Sexy, Normal) 1.1M Test Set
  12. 40 Req. #1 Req. #2 Req. #3 Callback. #1 Callback.

    #3 Guaranteed Callback Callback. #2
  13. 41 Req. #1 Req. #2 Req. #3 Callback. #1 Callback.

    #2 Callback. #3 Guaranteed Callback
  14. 42 Req. #1 Req. #2 Req. #3 Callback. #1 Callback.

    #2 Callback. #3 Guaranteed Callback #
  15. 48 Result
 Message Queue Dead-Letter Queue
 With TTL Nack Guaranteed

    Callback Pacman Spiderman $ Guaranteed
 Callback
  16. 55 Gateway DLQ Search Result Write Request … Search Result

    Process Write Result Req. For Req. For … Deliver Result Deliver Result
  17. 74 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag Illegal
 Ad.
  18. 75 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag Illegal
 Ad.
  19. 76 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag ✅ QR Code Reader - URL Extraction Illegal
 Ad.
  20. 77 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag ✅ QR Code Reader - URL Extraction ✅ OCR (Optical Character Recognition) Illegal
 Ad.
  21. 78 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag ✅ QR Code Reader - URL Extraction ✅ OCR (Optical Character Recognition) - JP / KR / EN / TH / TW / CN / ID Illegal
 Ad.
  22. 18 83 Trial and Error via LINE LIVE - Gun

    - Knife - Cigarette - Electric Cigarette - Sensitive Symbols
  23. 84 Trial and Error via LINE LIVE - Gun -

    Knife - Cigarette - Electric Cigarette - Sensitive Symbols + 18
  24. 85 18 ?? Trial and Error via LINE LIVE +

    - Gun - Knife - Cigarette - Electric Cigarette - Sensitive Symbols
  25. 86 18 ?? Trial and Error via LINE LIVE +

    - Gun - Knife - Cigarette - Electric Cigarette - Sensitive Symbols F1 Score 0.9 0.3
  26. 90 JPG JPG JPG JPG JSON JSON JSON JSON -

    User Consent - Disciplined Service Specific Training
  27. 91 JPG JPG JPG JPG JSON JSON JSON JSON Content

    Deep-Learning Engineer Service Specific Training Training Sample
 Gateway Legal Review +
  28. 92 JPG JPG JPG JPG JSON JSON JSON JSON Content

    DL Engineer Access-Token Service Specific Training Training Sample
 Gateway
  29. 94 18 Sync Async ' ( ⌚ * Gateway Spiderman

    $ Timberman DLQ + Pacman Librarian Access
 Token
  30. Back-Office Support Adult Content Filter Object Detection 15M / Day

    … OCR - JP/EN/CN/TW/ID/KR AD Detection 97 …
  31. Back-Office Support Adult Content Filter Object Detection 15M / Day

    1.3M / Day 15M / Day 3.5M / Day … OCR - JP/EN/CN/TW/ID/KR AD Detection 98 …
  32. 99 0 80000 160000 240000 320000 400000 2017 2018 2019

    Daily Monitored Images by Operators Monitoring Cost Reduction
  33. 100 0 80000 160000 240000 320000 400000 2017 2018 2019

    Daily Monitored Images by Operators Monitoring Cost Reduction
  34. 108 Closing the Distance , 2 1 0 . -

    1 1 —
 2 1 —
 3 1 —
 2 -
  35. 114 18 Sync Async ' ( ⌚ * Gateway Librarian

    Spiderman $ Timberman DLQ + Pacman Access
 Token
  36. ID card Recognition Face Verification 124 - Jane Doe 5

    + Expansion Into Finance LINE FINANCE eKYC
  37. ID card Recognition Face Verification 125 - Jane Doe 5

    + Expansion Into Finance x 0.5 Speed LINE FINANCE eKYC
  38. ID card Recognition Face Verification Secured Infra. (JP) 126 -

    Jane Doe 5 + Expansion Into Finance LINE FINANCE eKYC
  39. ID card Recognition Face Verification Secured Infra. (JP) 127 -

    Jane Doe 5 + Expansion Into Finance LINE FINANCE eKYC
  40. Deep-Learning Training Sample Portal 130 JPG JPG JPG JPG JSON

    JSON JSON JSON Normal
 Librarian Deep-Learning Engineers
  41. Deep-Learning Training Sample Portal 131 JPG JPG JPG JPG JSON

    JSON JSON JSON Normal
 Librarian Deep-Learning Engineers Refine Training Sample With Correction API 
 Adult Correction API
  42. 132 Only Corrected Samples Only Samples From JP Training Sample

    Portal Deep-Learning Training Sample Portal Librarian
  43. 133 Only Corrected Samples Only Samples From JP Samples
 From


    JP Corrected
 Samples Training Sample Portal Deep-Learning Training Sample Portal Librarian
  44. 138

  45. 139