Learning  Cross-modal Embeddings  for Cooking Recipes  and Food Images

-FBSOJOH  $SPTTNPEBM&NCFEEJOHT  GPS$PPLJOH3FDJQFT  BOE'PPE*NBHFT 2017.08.06 KantoCV #41

w -FT[FL ϨγΣοΫ w ϙʔϥϯυग़਎ w ΫοΫύουͷݚڀ։ൃ෦ w ը૾ղੳ
w ϙʔϥϯυͷΫοΫύου Ͱˌ̍ͷϨγϐɿ  ๻ͷϐΤϩΪ ࣗݾ঺հ

A D G J B E H K C I
F

C B A 1 2 3

A B C D E F G

w $MBTTJpDBUJPOPGSFDJQFT JT)"3% w *NBHFSFDPHOJUJPOPO GPPEJT)"3% w JOUSBDMBTTWBSJFUZ w JOUFSDMBTTTJNJMBSJUZ
w 5IFFYJTUJOHEBUBTFUT BSF4."-- w 5PPNBOZJOHSFEJFOUT w $VMUVSBMCJBTFT w &YJTUJOHTPMVUJPOTIBWF MPXBDDVSBDZ http://www.robotshop.com/

July 20, 2017

3FDJQF. %BUBTFU

https://cookpad.com/recipe/1758645

%BUBTFU w EJ⒎FSFOUTJUFTBTTPVSDF JODM$PPLQBE w NSFDJQFTBOELJNBHFT w PGSFDJQFUJUMFTBSFOPUVOJRVF w
BWFSBHFSFDJQFIBTJOHSFEJFOUT w PGJOHSFEJFOUT JOSFDJQFT w TPNFSFDJQFTBSFPOFTUFQ   TPNFDPOUBJOTVCSFDJQFT w TPNFGPPEUZQFTBSFWFSZQPQVMBS  DIPDPMBUFDIJQDPPLJFT

&NCFEEJOH

TGEKRGURCEG KOCIGURCEG LQKPVGODGFFKPIURCEG UOQQVJKGU ITCVKPU UWUJK JCODWTIGTU */56*5*0/

.PEFM0WFSWJFX

w XPSEWFDPOJOHSFEJFOUT w UCTQPGPMJWFPJM w PMJWF@PJM CFMM@QFQQFS CMBDL@QFQQFS w CJEJSFDUJPOBM-45.

w TLJQJOTUSVDUJPOT-45.PO-45. w SFDJQFTUBSUBOEFOENBSLFST w DPODBUFOBUFpOBMFODPEJOHXJUIUIF JOHSFEJFOUFODPEJOH

w UFTUFE7((BOE3FT/FU w DMBTTJpDBUJPOˠFNCFEEJOHMBZFS w *NBHF/FUQSFUSBJOFE pOFUVOFE w USBJOFETFQBSBUFMZGSPNUFYU

w NBUDIJOHQBJSTNJYFEQBJST w

w 'PPEDBUFHPSJFTHVFTTFEGSPNSFDJQFUJUMF w FNCFEEJOHˠDBUFHPSZDMBTTJpFS w JGTBNFDBUFHPSZLreg w λ

5PUBMMPTTGVODUJPO

&YQFSJNFOUT

JNBHFˠSFDJQF

SFDJQFˠJNBHF

#FUUFSUIBO)VNBO

%&.0 http://wednesday.csail.mit.edu: 4242/

6OJU"DUJWBUJPOT

XPSEWFDNBUI http://www.samyzaf.com/ML/nlp/nlp.html

XPSEWFDNBUI man - king + woman = queen cats -
cat + dog = dogs France - Paris + England = London London - England + Italy = Rome Italy - Rome + Paris = France

.BUIPO3FDJQFT

.BUIPO*NBHFT

$SPTTNPEBM

w 3FDJQF.EBUBTFU w JNBHFˠSFDJQF w SFDJQFˠJNBHF w CFUUFSUIBOIVNBO w JOHSFEJFOUEFUFDUJPO
w SFDJQFBSJUINFUJD http://www.robotshop.com/ ·ͱΊ

Learning Cross-modal Embeddings for Cooking R...

Learning Cross-modal Embeddings for Cooking Recipes and Food Images

More Decks by Leszek Rybicki

Other Decks in Research

Featured

Transcript

Learning  Cross-modal Embeddings  for Cooking R...

Learning  Cross-modal Embeddings  for Cooking Recipes  and Food Images