$30 off During Our Annual Pro Sale. View Details »

Cooking with Food Photos

Leszek Rybicki
November 02, 2017

Cooking with Food Photos

From a food/non-food classifier to multi-class semantic segmentation from partially labeled data.

Leszek Rybicki

November 02, 2017
Tweet

More Decks by Leszek Rybicki

Other Decks in Research

Transcript

  1. $PPLJOHXJUI 'PPE1IPUPT 5PLZP.-,JUDIFO  -FT[FL3ZCJDLJ

  2. *OUSP • Leszek Rybicki • github: @lunardog • from Poland

    • 2016 Cookpad R&D • really bad at selfies
  3. $)"--&/(& *TJUGPPE

  4. http://techlife.cookpad.com/entry/2017/09/14/161756

  5. 'PPE/POGPPE twitter: @teenybiscuit

  6. 'PPE

  7. w QFPQMFBSFOPUGPPE w QFUTBSFOPUGPPE w QPUUFEQMBOUTBSFOPUGPPE w FWJMBMJFOTBSFOPUGPPE w JGJUIBTUFYUPOJU

    
 JU`TQSPCBCMZOPUGPPE /PUGPPE
  8. DCNN global pooling fully connected RGB x 240 x 240

    pixels 2048 features x 8 x 8 one-hot class vector 2048 features food plant person pet other
  9. None
  10. GPPEOPOGPPEBDDVSBDZ  QSFDJTJPOSFDBMM

  11. None
  12.  

  13. None
  14. *."(*/"5*0/

  15. 3&"-*5:

  16. 0OUIFGFODF w GPPEXJUIPUIFSJUFNT w GPPEXJUIUFYU w GPPE CVUTNBMMJOUIF QIPUP w

    FEJCMFQMBOUT w QFPQMFXJUIGPPE
  17. 'PPEJTTPDJBM w 8FDPPLBOEFBUXJUIPVS GBNJMZBOEGSJFOET w 'PPEJTBUUIFDFOUFSPG JNQPSUBOUFWFOUT w 8IFOXFVTFBCJOBSZ DMBTTJpFSGPSGPPEQIPUPT

     BSFO`UXFMPTJOHUIF IVNBODPOOFDUJPO https://pixabay.com/
  18. None
  19. 3VMF "QIPUPUIBU
 DBOCFDSPQQFEUP DPOUBJONPTUMZGPPE
 JTBQIPUPPGGPPE

  20. 1BUDIJU

  21. None
  22. GPPE OPOGPPE

  23. DCNN global pooling fully connected RGB x 240 x 240

    pixels 2048 features x 8 x 8 one-hot class vector 2048 features DCNN global pooling 1x1 convo layer RGB x 240 x 240 pixels 2048 features x 8 x 8 one-hot class vector food not food not
  24. w %$//*ODFQUJPO7 w USBJOFEPOBMMGPPEBOE BMMOPOGPPEQIPUPT
 USBJOJOHJTSFBMMZGBTU  w BWFSBHFQPPMJOH w

    IFBWZESPQPVU   w OPHMPCBMQPPMJOHMBZFS BGUFSUSBJOJOH w VTFSFTVMUJOHIFBUNBQ GPSDMBTTJpDBUJPO DCNN global pooling 1x1 convo layer RGB x 512 x 512 pixels 2048 features x 14 x 14 one-hot class vector food not
  25. GPPEOPOGPPEBDDVSBDZ  QSFDJTJPOSFDBMM

  26. GPPEOPOGPPEBDDVSBDZ  QSFDJTJPOSFDBMM

  27. None
  28. http://techlife.cookpad.com/entry/2017/09/14/161756 https://storialaw.jp/blog/3420

  29. test images from https://snappygoat.com/ food person

  30. food person test images from https://snappygoat.com/

  31. $)"--&/(& *OHSFEJFOUT

  32. $-"44*':5)*4

  33. None
  34. None
  35. None
  36. None
  37. test images from https://snappygoat.com/

  38. test images from https://snappygoat.com/

  39. %&.0

  40. None
  41. None