PicCell : Flooding your service with AI

PicCell : Flooding your service with AI

Joonsik Baek
LINE Plus LPE4 MediaPlatform Software Engineer
https://linedevday.linecorp.com/jp/2019/sessions/F1-6

Be4518b119b8eb017625e0ead20f8fe7?s=128

LINE DevDay 2019

November 20, 2019
Tweet

Transcript

  1. 1.

    2019 DevDay PicCell : Flooding Your Service With AI >

    Joonsik Baek > LINE Plus LPE4 MediaPlatform Software Engineer
  2. 4.

    4

  3. 5.

    5 ?

  4. 6.

    6 !

  5. 21.

    21 Media Platform Video Image Audio File Who Is Qualified

    OBSObject Storage - More Than 80 Services
  6. 22.

    22 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services
  7. 23.

    23 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services - MAX 1.5 Tbps Traffic - 100 PB Storage
  8. 24.

    24 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services - MAX 1.5 Tbps Traffic - 100 PB Storage
  9. 25.

    25 Media Platform Video Image Audio File Storage Delivery Processing

    Who Is Qualified OBSObject Storage - More Than 80 Services - MAX 1.5 Tbps Traffic - 100 PB Storage
  10. 26.
  11. 31.

    > 0.9 F1 Score 3.5M
 Training Samples ResNet 50
 Based

    31 Adult Content Filter 3 Classes
 (Adult, Sexy, Normal) 1.1M Test Set
  12. 32.

    300ms
 Processing Time > 0.9 F1 Score 3.5M
 Training Samples

    ResNet 50
 Based 32 Adult Content Filter 3 Classes
 (Adult, Sexy, Normal) 1.1M Test Set
  13. 35.
  14. 36.
  15. 40.

    40 Req. #1 Req. #2 Req. #3 Callback. #1 Callback.

    #3 Guaranteed Callback Callback. #2
  16. 41.

    41 Req. #1 Req. #2 Req. #3 Callback. #1 Callback.

    #2 Callback. #3 Guaranteed Callback
  17. 42.

    42 Req. #1 Req. #2 Req. #3 Callback. #1 Callback.

    #2 Callback. #3 Guaranteed Callback #
  18. 48.

    48 Result
 Message Queue Dead-Letter Queue
 With TTL Nack Guaranteed

    Callback Pacman Spiderman $ Guaranteed
 Callback
  19. 55.

    55 Gateway DLQ Search Result Write Request … Search Result

    Process Write Result Req. For Req. For … Deliver Result Deliver Result
  20. 74.

    74 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag Illegal
 Ad.
  21. 75.

    75 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag Illegal
 Ad.
  22. 76.

    76 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag ✅ QR Code Reader - URL Extraction Illegal
 Ad.
  23. 77.

    77 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag ✅ QR Code Reader - URL Extraction ✅ OCR (Optical Character Recognition) Illegal
 Ad.
  24. 78.

    78 Illegal Advertisements in Timeline Imitation Product QR Code Advertising

    Text on Image ✅ Product Classification - Sunglasses, Shoes, Watch or Handbag ✅ QR Code Reader - URL Extraction ✅ OCR (Optical Character Recognition) - JP / KR / EN / TH / TW / CN / ID Illegal
 Ad.
  25. 79.
  26. 83.

    18 83 Trial and Error via LINE LIVE - Gun

    - Knife - Cigarette - Electric Cigarette - Sensitive Symbols
  27. 84.

    84 Trial and Error via LINE LIVE - Gun -

    Knife - Cigarette - Electric Cigarette - Sensitive Symbols + 18
  28. 85.

    85 18 ?? Trial and Error via LINE LIVE +

    - Gun - Knife - Cigarette - Electric Cigarette - Sensitive Symbols
  29. 86.

    86 18 ?? Trial and Error via LINE LIVE +

    - Gun - Knife - Cigarette - Electric Cigarette - Sensitive Symbols F1 Score 0.9 0.3
  30. 90.

    90 JPG JPG JPG JPG JSON JSON JSON JSON -

    User Consent - Disciplined Service Specific Training
  31. 91.

    91 JPG JPG JPG JPG JSON JSON JSON JSON Content

    Deep-Learning Engineer Service Specific Training Training Sample
 Gateway Legal Review +
  32. 92.

    92 JPG JPG JPG JPG JSON JSON JSON JSON Content

    DL Engineer Access-Token Service Specific Training Training Sample
 Gateway
  33. 94.

    94 18 Sync Async ' ( ⌚ * Gateway Spiderman

    $ Timberman DLQ + Pacman Librarian Access
 Token
  34. 97.

    Back-Office Support Adult Content Filter Object Detection 15M / Day

    … OCR - JP/EN/CN/TW/ID/KR AD Detection 97 …
  35. 98.

    Back-Office Support Adult Content Filter Object Detection 15M / Day

    1.3M / Day 15M / Day 3.5M / Day … OCR - JP/EN/CN/TW/ID/KR AD Detection 98 …
  36. 99.

    99 0 80000 160000 240000 320000 400000 2017 2018 2019

    Daily Monitored Images by Operators Monitoring Cost Reduction
  37. 100.

    100 0 80000 160000 240000 320000 400000 2017 2018 2019

    Daily Monitored Images by Operators Monitoring Cost Reduction
  38. 108.

    108 Closing the Distance , 2 1 0 . -

    1 1 —
 2 1 —
 3 1 —
 2 -
  39. 114.

    114 18 Sync Async ' ( ⌚ * Gateway Librarian

    Spiderman $ Timberman DLQ + Pacman Access
 Token
  40. 124.

    ID card Recognition Face Verification 124 - Jane Doe 5

    + Expansion Into Finance LINE FINANCE eKYC
  41. 125.

    ID card Recognition Face Verification 125 - Jane Doe 5

    + Expansion Into Finance x 0.5 Speed LINE FINANCE eKYC
  42. 126.

    ID card Recognition Face Verification Secured Infra. (JP) 126 -

    Jane Doe 5 + Expansion Into Finance LINE FINANCE eKYC
  43. 127.

    ID card Recognition Face Verification Secured Infra. (JP) 127 -

    Jane Doe 5 + Expansion Into Finance LINE FINANCE eKYC
  44. 130.

    Deep-Learning Training Sample Portal 130 JPG JPG JPG JPG JSON

    JSON JSON JSON Normal
 Librarian Deep-Learning Engineers
  45. 131.

    Deep-Learning Training Sample Portal 131 JPG JPG JPG JPG JSON

    JSON JSON JSON Normal
 Librarian Deep-Learning Engineers Refine Training Sample With Correction API 
 Adult Correction API
  46. 132.

    132 Only Corrected Samples Only Samples From JP Training Sample

    Portal Deep-Learning Training Sample Portal Librarian
  47. 133.

    133 Only Corrected Samples Only Samples From JP Samples
 From


    JP Corrected
 Samples Training Sample Portal Deep-Learning Training Sample Portal Librarian
  48. 138.

    138

  49. 139.

    139