Save 37% off PRO during our Black Friday Sale! »

Calorie Estimation in a Real-World Recipe Service/iaai-20

558ffd4e5cf6c95e60c91333677b93c4?s=47 j.harashima
February 09, 2020
0
8.2k

Calorie Estimation in a Real-World Recipe Service/iaai-20

558ffd4e5cf6c95e60c91333677b93c4?s=128

j.harashima

February 09, 2020
Tweet

More Decks by j.harashima

See All by j.harashima
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
300
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
3.3k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
2.4k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
55
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
5.2k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
10k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
3.7k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
5.5k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
59

Featured

See All Featured
E9221b172e78e888355fa2fe4541b595?s=48 mclloyd
PRO
7
7.7k
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
75
3.8k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
195
9.1k
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
167
19k
C157b16234f1e75e8eac3698c1d4414a?s=48 ddemaree
272
32k
1b8ad785acdd1ce1c99914b1c2a4e10e?s=48 sugarenia
236
980k
E195ae45320d9202eaa01c9f1d31a416?s=48 marktimemedia
15
750
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
780
240k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
85
8.2k
39488f9d172ab92fd352f2cd7b73258d?s=48 mza
82
4.4k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
208
20k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1352
200k

Transcript

  1. $BMPSJF&TUJNBUJPO JOB3FBM8PSME3FDJQF4FSWJDF +VO)BSBTIJNB .BLPUP)JSBNBUTV 4BUPTIJ4BOKP $PPLQBE*OD

  2. 4VNNBSZ 8FIBWFJOUSPEVDFEUIFGPMMPXJOHUISFFUBTLT JOUP$PPLQBE $BMPSJFFTUJNBUJPO NBJOUBTL 
 *OHSFEJFOUOPSNBMJ[BUJPO TVCUBTL 
 4FSWJOHFTUJNBUJPO

    TVCUBTL  8FIBWFBQQMJFENBDIJOFMFBSOJOH .- CBTFE NFUIPETGPSUIFTFUBTLTBOEEFQMPZFEUIFNJO PVSSFBMXPSMESFDJQFTFSWJDF

  3. $PPLQBE 1MBUGPSNGPSQFPQMFUPTIBSF
 SFDJQFJEFBTBOEDPPLJOHUJQT NJMMJPOVTFSTJODPVOUSJFT
 NJMMJPOSFDJQFT IBMGBSFJO+BQBOFTF

  4. $BMPSJF&TUJNBUJPO  &TUJNBUFUIFOVNCFSPGDBMPSJFT
 QFSTFSWJOHJOBSFDJQF DBMPSJF XIPMF
 BNPVOU

  5. 6TFJOHSFEJFOUTBOEBNPVOU TVNPGUIFDBMPSJFTJOUIFJOHSFEJFOUT OVNCFSPGTFSWJOHTPGUIFSFDJQF $BMPSJF&TUJNBUJPO  c(r) = ∑ i∈Ir c(i)

    ⋅ q(i)/100 s(r)

  6. HSBNTPGUIFJOHSFEJFOU
 JOUIFSFDJQF )PXEPXFPCUBJOc(i) γϝδ
 TIJNFKJNVTISPPN  χϯδϯ
 DBSSPU  ʜ

    ʜ ✕ JOHSFEJFOUEJDUJPOBSZ ͠Ί͡ TIJNFKJNVTISPPN ͠Ί͡JTO`UUIFTBNF
 BTγϝδ c(r) = ∑ i∈Ir c(i) ⋅ q(i)/100 s(r) *OHSFEJFOU/PSNBMJ[BUJPO  DBMPSJFTQFSHSBNT
 PGBOJOHSFEJFOU

  7. 4FWFSBMJTTVFTNVTUCFTPMWFE 1FPQMFDBOEFTDSJCFUIFJOHSFEJFOUTJOUIFJSSFDJQFTGSFFMZ JONBOZEJ⒎FSFOU
 XBZT FH ͠ΐ͏Ώ TPZTBVDF IBTNPSFUIBOFYQSFTTJPOTJO$PPLQBE TVDIBT γϣ΢Ϣ

    ͠ΐ͏༉ ͓ে༉ BOEὑ͠ΐ͏༉ *OHSFEJFOU/PSNBMJ[BUJPO  0SJHJOBMGPSN $BOPOJDBMGPSN 0SUIPHSBQIJD WBSJBOUT ਓࢀ DBSSPU ʹΜ͡Μ DBSSPU "CCSFWJBUJPOT ৽ͨ· TQSJOHPOJPO ৽ͨ·Ͷ͗ TQSJOHPOJPO 4QFMMJOH NJTUBLFT ΞϘΨυ BWPDBEP ΞϘΧυ BWPDBEP 0UIFS അླḕ QPUBUP ͡Ό͕͍΋ QPUBUP 0SJHJOBMGPSN $BOPOJDBMGPSN 4ZNCPMT ὑຯḩ ὑNJTP ຯḩ NJTP 1BSFOUIFTFT ༉ ᖱΊ༻  PJM GPSGSZJOH ༉ PJM 1SFpY ͓࠭౶ TVHBS ࠭౶ TVHBS 0UIFS ͋Ε͹ϩʔζϚϦʔ SPTFNBSZ JGBOZ ϩʔζϚϦʔ
 SPTFNBSZ &YBNQMFTPGJOHSFEJFOUOPSNBMJ[BUJPO

  8. "QQMZBOFODPEFSEFDPEFSNPEFM 5IFFODPEFSUBLFTUIFPSJHJOBMJOHSFEJFOUOBNFBTBOJOQVU
 5IFEFDPEFSHFOFSBUFTBDBOPOJDBMGPSNBTBOPVUQVU %PO`UVTFBUUFOUJPONFDIBOJTNTCFDBVTFUIFJOHSFEJFOUOBNFTBSFTIPSUTP
 UIFNFUIPEXPVMEOPUCFF⒎FDUJWF *OHSFEJFOU/PSNBMJ[BUJPO  y1 yJ y2

    … canonical form of the ingredient decoder original string of an ingredient encoder x1 x2 xI … softmax softmax softmax …

  9. )PXEPXFPCUBJOs(r) ✕ OVNCFSPGTFSWJOHTPGUIFSFDJQF খുݸ෼ TNBMMCPXMT IPXNBOZQFPQMFJT UIJTSFDJQFGPS c(r) = ∑

    i∈Ir c(i) ⋅ q(i)/100 s(r) 4FSWJOH&TUJNBUJPO 

  10. 4FSWJOH&TUJNBUJPO  4FWFSBMJTTVFTNVTUCFTPMWFE 1FPQMFBMTPGSFFMZFYQSFTTBOBNPVOUJOUIFJSSFDJQFT 5JUMF "NPVOU PGTFSWJOHT ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ 4QJOBDI$VSSZXJUI$PDPOVU0JM ࡼ෼

    QMBUFT  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ .JYFE3JDFXJUI,PNCVɾ)JKJLJɾ4DBMMPQ ߹෼ HP  άϥϊʔϥΫοΩʔ (SBOPMB$PPLJFT ຕ QJFDFT  ύϯϓΩϯλϧτ 1VNQLJO5BSU DNλϧτܕ DNUBSUNPME  &YBNQMFTPGTFSWJOHFTUJNBUJPO "MUIPVHIUIFSFBSFTFWFSBMBOTXFSTGPSTPNFSFDJQFT XFEPOPUQVSTVFUIJTJTTVFJOPVSTFSWJDF

  11. 4FSWJOH&TUJNBUJPO  "QQMZUXPOFVSBMDMBTTJpDBUJPONPEFMT 5IFFODPEFSUBLFTBUJUMFBOEPSBNPVOUJOBSFDJQFBTBOJOQVU
 5IFEFOTFMBZFSTUSBOTGPSNUIFPVUQVUPGUIFFODPEFS T JOUPUIFOVNCFSPG
 TFSWJOHT dense title

    or amount encoder xa1 xa2 xaI … softmax y serving dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving 4JOHMFTPVSDFNPEFM .VMUJTPVSDFNPEFM

  12. &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO %BUB 8FDPMMFDUFE EJTUJODUJOHSFEJFOUTGSPN$PPLQBE OPSNBMJ[FEUIFN
 NBOVBMMZ UIFOSFNPWFE XIPTFOPSNBMJ[FEWFSTJPOTXFSFUIFTBNFBT
 UIFJSPSJHJOBMTUSJOHT 8FVTFEUIFSFNBJOJOH

    JOHSFEJFOUT .FUIPET 3&SFHVMBSFYQSFTTJPOCBTFENFUIPEXIJDISFNPWFTTZNCPMTBOE
 QBSFOUIFTFTGSPNUIFPSJHJOBMTUSJOHT .-PVS.-CBTFENFUIPE

  13. &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO 3FTVMUT 5IF.-CBTFENFUIPETVDDFTTGVMMZOPSNBMJ[FENPSF
 UIBOPGUIFJOHSFEJFOUT 0SJHJOBMGPSN $BOPOJDBMGPSN 0SUIPHSBQIJD WBSJBOUT ͔ͨ͘Γค QPUBUPTUBSDI

    ย܀ค QPUBUPTUBSDI "CCSFWJBUJPOT ڇͻ͖ HSPVOECFFG ڇͻ͖೑ HSPVOECFFG 4QFMMJOH NJTUBLFT ਫ໊ NJ[VOB ਫࡊ NJ[VOB 0UIFS ࢳ͏Γ TQBHIFUUJTRVBTI ͦ͏ΊΜ͔΅ͪΌ TQBHIFUUJTRVBTI 0SJHJOBMGPSN $BOPOJDBMGPSN 4ZNCPMT ˑখഴค ˑqPVS খഴค qPVS 1BSFOUIFTFT Ϩʔζϯ ͓޷ΈͰ  SBJTJO BTZPVMJLF Ϩʔζϯ SBJTJO 1SFpY ͓౾෗ UPGV ౾෗ UPGV 0UIFS ྫྷ͑ͨτϚτ DIJMMFEUPNBUP τϚτ UPNBUP 4VDDFTTGVMFYBNQMFTPGJOHSFEJFOUOPSNBMJ[BUJPO "DDVSBDZ 3&  .- 

  14. 5XPUZQFTPGOPSNBMJ[BUJPOFSSPS 8SPOHMZHFOFSBUJOHOPOFYJTUFOUJOHSFEJFOUT 8SPOHMZHFOFSBUJOHEJ⒎FSFOUJOHSFEJFOUT 'VUVSFXPSLSFRVJSFE 5PDPOTJEFSUIFFYJTUFODFPGUIFPVUQVUBOEJUTTJNJMBSJUZUPUIFJOQVU
  )BSBTIJNBBOE:BNBEB 
 5PFYQBOEUIFUSBJOJOHTFU &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO

    *OQVU )VNBOPVUQVU 4ZTUFNPVUQVU χΨ΢Ϧ CJUUFSNFMPO ΰʔϠ CJUUFSNFMPO ʹ͕͕Γ OPOFYJTUFOUXPSE ḕᤸ ZBN ࢁҶ ZBN ͡Ό͕͍΋ QPUBUP

  15. &YQFSJNFOU4FSWJOH&TUJNBUJPO %BUB 8FDPMMFDUFE SFDJQFTGSPN$PPLQBEUIFOFTUJNBUFEUIFOVNCFSPG
 TFSWJOHTGSPNUIFNNBOVBMMZ .FUIPET 3&SFHVMBSFYQSFTTJPOCBTFENFUIPEXIJDIFYUSBDUTBWBMVFGSPNUIF
 BNPVOUJOFBDISFDJQF .-PVS.-CBTFENFUIPEXIJDIVTFTDBUFHPSJFT GPSQFSTPO

    ʜ VQUP
 QFPQMF

  16. &YQFSJNFOU4FSWJOH&TUJNBUJPO 3FTVMUT 5IF.-CBTFENFUIPEBDIJFWFEBOBDDVSBDZPGNPSFUIBO 5IFTJOHMFTPVSDFNPEFMTMJHIUMZPVUQFSGPSNFEUIFNVMUJTPVSDFNPEFM
 &TTFOUJBMMZ UIFOVNCFSPGTFSWJOHTGPSBSFDJQFDBOOPUCFFTUJNBUFEXJUIPVU
 JUTUJUMFJOGPSNBUJPO
 5IFOVNCFSPGFYBNQMFTJOPVSUSBJOJOHTFUXBTUPPTNBMMUPUSBJOUXP
 FODPEFSTTPXFXJMMFYQBOEUIFUSBJOJOHTFUJOGVUVSFXPSL 4PVSDF

    5JUMF "NPVOU "DDVSBDZ 3& TJOHMF 㾎  .- TJOHMF 㾎  TJOHMF 㾎  NVMUJ 㾎 㾎 

  17. &YQFSJNFOU4FSWJOH&TUJNBUJPO ✕'BJMFECZVTJOHUIFUJUMFJOGPSNBUJPO
 0VSUSBJOJOHTFUDPOUBJOFETPNFSFDJQFTJOXIJDIPOF,PSFBOQBODBLFTFSWFEUXPQFPQMF
 ✕'BJMFECZOPUVTJOHUIFUJUMFJOGPSNBUJPO
 0OFTNBMMDSPRVFUUFJTHFOFSBMMZOPUTV⒏DJFOUGPSPOFQFSTPO
 ✕'BJMFECZOPUVTJOHUIFRVBOUJUZJOGPSNBUJPOPOUIFJOHSFEJFOUT
 'VUVSFXPSLXJMMCFOFFEFE 5JUMF "NPVOU )VNBO

    4ZTUFN TJOHMF 4ZTUFN NVMUJ γϡΨʔύϯ 4VHBS#SFBE ݸ QJFDFT    ૉ๿ͳϨʔζϯύϯ 4JNQMF3BJTJO#SFBE ی MPBG    ΋ͪ΋ͪ໺ࡊνξϛ $IFXZ,PSFBO7FHFUBCMF1BODBLF ϑϥΠύϯຕ෼ GSZJOHQBOT    πφϙςτͷϛχίϩοέˑ͓ห౰ʹ΋ 4NBMM5VOBBOE1PUBUP$SPRVFUUFTˑBMTPGPS-VODI#PY ݸ෼ QJFDFT    ؁͞߇͑ΊͷΫοΩʔ $PPLJFTXJUI-FTT4VHBS మ൘ຕ෼ JSPOQMBUF    4VDDFTTGVMBOEGBJMFEFYBNQMFTPGTFSWJOHFTUJNBUJPO ✕ ✕ ✕ ✕

  18. %FQMPZ "TBSJ$MBN3JDF HP ɹɹɹɹɹΞαϦɹ ɹɹɹɹɹถɹɹɹ ɹɹɹɹɹԘɹɹɹ ɹɹɹɹɹञɹɹɹ ɹɹɹɹɹ͠ΐ͏Ώ ɹɹɹɹɹΈΓΜɹ SJDF

    BTBSJDMBN TBMU TBLF TPZTBVDF TXFFUTBLF 㾎 㾎 㾎 㾎 㾎 㾎 8FIBWFFTUJNBUFEUIFOVNCFSPGDBMPSJFTJOPWFS  SFDJQFTBOEBDUVBMMZVTFUIFNJOPVSSFDJQFTFSWJDF 6TFUIFTJOHMFTPVSDFNPEFMGPSTFSWJOHFTUJNBUJPO  c(r) = ∑ i∈Ir c(i) ⋅ q(i)/100 s(r) = 306.6 㾎 *OHSFEJFOU

  19. 4VNNBSZ 8FIBWFJOUSPEVDFEUIFGPMMPXJOHUISFFUBTLT
 JOUP$PPLQBE $BMPSJFFTUJNBUJPO NBJOUBTL 
 *OHSFEJFOUOPSNBMJ[BUJPO TVCUBTL 
 4FSWJOHFTUJNBUJPO

    TVCUBTL  8FIBWFBQQMJFE.-CBTFENFUIPETGPSUIFTF UBTLTBOEEFQMPZFEUIFNJOPVSSFBMXPSMESFDJQF TFSWJDF 5IFNFUIPETQFSGPSNFETV⒏DJFOUMZXFMMUPCFVTFEJOPVSTFSWJDF 'VUVSFXPSL 5PFYQBOEUIFOVNCFSPGJOHSFEJFOUTBOESFDJQFTUPXIJDIPVSNFUIPETDBOCF
 BQQMJFE

  20. 5IBOLZPV