Calorie Estimation in a Real-World Recipe Service/iaai-20

558ffd4e5cf6c95e60c91333677b93c4?s=47 j.harashima
February 09, 2020
0
5.2k

Calorie Estimation in a Real-World Recipe Service/iaai-20

558ffd4e5cf6c95e60c91333677b93c4?s=128

j.harashima

February 09, 2020
Tweet

More Decks by j.harashima

See All by j.harashima
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
1.6k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
43
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
2.6k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
8.2k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
1.7k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
5.5k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
51
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
4
3.4k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
4
17k

Featured

See All Featured
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
356
62k
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
224
8.3k
2bb923c57a1fdc3a2eb484bb8d565fd2?s=48 ufuk
55
5.2k
44b54d2ffcb7857004071cc6795dde11?s=48 cassininazir
345
20k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
142
19k
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
69
1.3k
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
436
28k
B47b288784fda77a94aeb234ca743c24?s=48 keavy
104
14k
9952dfcd5d338f8a8e7175c8a8f65fb5?s=48 wjessup
334
15k
9128d500301ae51524e887bb680f471d?s=48 caitiem20
304
16k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
100
11k
E76911cbe088e5b850d966de3fc7435b?s=48 robhawkes
52
2.7k

Transcript

  1. $BMPSJF&TUJNBUJPO JOB3FBM8PSME3FDJQF4FSWJDF +VO)BSBTIJNB .BLPUP)JSBNBUTV 4BUPTIJ4BOKP $PPLQBE*OD

  2. 4VNNBSZ 8FIBWFJOUSPEVDFEUIFGPMMPXJOHUISFFUBTLT JOUP$PPLQBE $BMPSJFFTUJNBUJPO NBJOUBTL 
 *OHSFEJFOUOPSNBMJ[BUJPO TVCUBTL 
 4FSWJOHFTUJNBUJPO

    TVCUBTL  8FIBWFBQQMJFENBDIJOFMFBSOJOH .- CBTFE NFUIPETGPSUIFTFUBTLTBOEEFQMPZFEUIFNJO PVSSFBMXPSMESFDJQFTFSWJDF

  3. $PPLQBE 1MBUGPSNGPSQFPQMFUPTIBSF
 SFDJQFJEFBTBOEDPPLJOHUJQT NJMMJPOVTFSTJODPVOUSJFT
 NJMMJPOSFDJQFT IBMGBSFJO+BQBOFTF

  4. $BMPSJF&TUJNBUJPO  &TUJNBUFUIFOVNCFSPGDBMPSJFT
 QFSTFSWJOHJOBSFDJQF DBMPSJF XIPMF
 BNPVOU

  5. 6TFJOHSFEJFOUTBOEBNPVOU TVNPGUIFDBMPSJFTJOUIFJOHSFEJFOUT OVNCFSPGTFSWJOHTPGUIFSFDJQF $BMPSJF&TUJNBUJPO  c(r) = ∑ i∈Ir c(i)

    ⋅ q(i)/100 s(r)

  6. HSBNTPGUIFJOHSFEJFOU
 JOUIFSFDJQF )PXEPXFPCUBJOc(i) γϝδ
 TIJNFKJNVTISPPN  χϯδϯ
 DBSSPU  ʜ

    ʜ ✕ JOHSFEJFOUEJDUJPOBSZ ͠Ί͡ TIJNFKJNVTISPPN ͠Ί͡JTO`UUIFTBNF
 BTγϝδ c(r) = ∑ i∈Ir c(i) ⋅ q(i)/100 s(r) *OHSFEJFOU/PSNBMJ[BUJPO  DBMPSJFTQFSHSBNT
 PGBOJOHSFEJFOU

  7. 4FWFSBMJTTVFTNVTUCFTPMWFE 1FPQMFDBOEFTDSJCFUIFJOHSFEJFOUTJOUIFJSSFDJQFTGSFFMZ JONBOZEJ⒎FSFOU
 XBZT FH ͠ΐ͏Ώ TPZTBVDF IBTNPSFUIBOFYQSFTTJPOTJO$PPLQBE TVDIBT γϣ΢Ϣ

    ͠ΐ͏༉ ͓ে༉ BOEὑ͠ΐ͏༉ *OHSFEJFOU/PSNBMJ[BUJPO  0SJHJOBMGPSN $BOPOJDBMGPSN 0SUIPHSBQIJD WBSJBOUT ਓࢀ DBSSPU ʹΜ͡Μ DBSSPU "CCSFWJBUJPOT ৽ͨ· TQSJOHPOJPO ৽ͨ·Ͷ͗ TQSJOHPOJPO 4QFMMJOH NJTUBLFT ΞϘΨυ BWPDBEP ΞϘΧυ BWPDBEP 0UIFS അླḕ QPUBUP ͡Ό͕͍΋ QPUBUP 0SJHJOBMGPSN $BOPOJDBMGPSN 4ZNCPMT ὑຯḩ ὑNJTP ຯḩ NJTP 1BSFOUIFTFT ༉ ᖱΊ༻  PJM GPSGSZJOH ༉ PJM 1SFpY ͓࠭౶ TVHBS ࠭౶ TVHBS 0UIFS ͋Ε͹ϩʔζϚϦʔ SPTFNBSZ JGBOZ ϩʔζϚϦʔ
 SPTFNBSZ &YBNQMFTPGJOHSFEJFOUOPSNBMJ[BUJPO

  8. "QQMZBOFODPEFSEFDPEFSNPEFM 5IFFODPEFSUBLFTUIFPSJHJOBMJOHSFEJFOUOBNFBTBOJOQVU
 5IFEFDPEFSHFOFSBUFTBDBOPOJDBMGPSNBTBOPVUQVU %PO`UVTFBUUFOUJPONFDIBOJTNTCFDBVTFUIFJOHSFEJFOUOBNFTBSFTIPSUTP
 UIFNFUIPEXPVMEOPUCFF⒎FDUJWF *OHSFEJFOU/PSNBMJ[BUJPO  y1 yJ y2

    … canonical form of the ingredient decoder original string of an ingredient encoder x1 x2 xI … softmax softmax softmax …

  9. )PXEPXFPCUBJOs(r) ✕ OVNCFSPGTFSWJOHTPGUIFSFDJQF খുݸ෼ TNBMMCPXMT IPXNBOZQFPQMFJT UIJTSFDJQFGPS c(r) = ∑

    i∈Ir c(i) ⋅ q(i)/100 s(r) 4FSWJOH&TUJNBUJPO 

  10. 4FSWJOH&TUJNBUJPO  4FWFSBMJTTVFTNVTUCFTPMWFE 1FPQMFBMTPGSFFMZFYQSFTTBOBNPVOUJOUIFJSSFDJQFT 5JUMF "NPVOU PGTFSWJOHT ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ 4QJOBDI$VSSZXJUI$PDPOVU0JM ࡼ෼

    QMBUFT  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ .JYFE3JDFXJUI,PNCVɾ)JKJLJɾ4DBMMPQ ߹෼ HP  άϥϊʔϥΫοΩʔ (SBOPMB$PPLJFT ຕ QJFDFT  ύϯϓΩϯλϧτ 1VNQLJO5BSU DNλϧτܕ DNUBSUNPME  &YBNQMFTPGTFSWJOHFTUJNBUJPO "MUIPVHIUIFSFBSFTFWFSBMBOTXFSTGPSTPNFSFDJQFT XFEPOPUQVSTVFUIJTJTTVFJOPVSTFSWJDF

  11. 4FSWJOH&TUJNBUJPO  "QQMZUXPOFVSBMDMBTTJpDBUJPONPEFMT 5IFFODPEFSUBLFTBUJUMFBOEPSBNPVOUJOBSFDJQFBTBOJOQVU
 5IFEFOTFMBZFSTUSBOTGPSNUIFPVUQVUPGUIFFODPEFS T JOUPUIFOVNCFSPG
 TFSWJOHT dense title

    or amount encoder xa1 xa2 xaI … softmax y serving dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving 4JOHMFTPVSDFNPEFM .VMUJTPVSDFNPEFM

  12. &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO %BUB 8FDPMMFDUFE EJTUJODUJOHSFEJFOUTGSPN$PPLQBE OPSNBMJ[FEUIFN
 NBOVBMMZ UIFOSFNPWFE XIPTFOPSNBMJ[FEWFSTJPOTXFSFUIFTBNFBT
 UIFJSPSJHJOBMTUSJOHT 8FVTFEUIFSFNBJOJOH

    JOHSFEJFOUT .FUIPET 3&SFHVMBSFYQSFTTJPOCBTFENFUIPEXIJDISFNPWFTTZNCPMTBOE
 QBSFOUIFTFTGSPNUIFPSJHJOBMTUSJOHT .-PVS.-CBTFENFUIPE

  13. &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO 3FTVMUT 5IF.-CBTFENFUIPETVDDFTTGVMMZOPSNBMJ[FENPSF
 UIBOPGUIFJOHSFEJFOUT 0SJHJOBMGPSN $BOPOJDBMGPSN 0SUIPHSBQIJD WBSJBOUT ͔ͨ͘Γค QPUBUPTUBSDI

    ย܀ค QPUBUPTUBSDI "CCSFWJBUJPOT ڇͻ͖ HSPVOECFFG ڇͻ͖೑ HSPVOECFFG 4QFMMJOH NJTUBLFT ਫ໊ NJ[VOB ਫࡊ NJ[VOB 0UIFS ࢳ͏Γ TQBHIFUUJTRVBTI ͦ͏ΊΜ͔΅ͪΌ TQBHIFUUJTRVBTI 0SJHJOBMGPSN $BOPOJDBMGPSN 4ZNCPMT ˑখഴค ˑqPVS খഴค qPVS 1BSFOUIFTFT Ϩʔζϯ ͓޷ΈͰ  SBJTJO BTZPVMJLF Ϩʔζϯ SBJTJO 1SFpY ͓౾෗ UPGV ౾෗ UPGV 0UIFS ྫྷ͑ͨτϚτ DIJMMFEUPNBUP τϚτ UPNBUP 4VDDFTTGVMFYBNQMFTPGJOHSFEJFOUOPSNBMJ[BUJPO "DDVSBDZ 3&  .- 

  14. 5XPUZQFTPGOPSNBMJ[BUJPOFSSPS 8SPOHMZHFOFSBUJOHOPOFYJTUFOUJOHSFEJFOUT 8SPOHMZHFOFSBUJOHEJ⒎FSFOUJOHSFEJFOUT 'VUVSFXPSLSFRVJSFE 5PDPOTJEFSUIFFYJTUFODFPGUIFPVUQVUBOEJUTTJNJMBSJUZUPUIFJOQVU
  )BSBTIJNBBOE:BNBEB 
 5PFYQBOEUIFUSBJOJOHTFU &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO

    *OQVU )VNBOPVUQVU 4ZTUFNPVUQVU χΨ΢Ϧ CJUUFSNFMPO ΰʔϠ CJUUFSNFMPO ʹ͕͕Γ OPOFYJTUFOUXPSE ḕᤸ ZBN ࢁҶ ZBN ͡Ό͕͍΋ QPUBUP

  15. &YQFSJNFOU4FSWJOH&TUJNBUJPO %BUB 8FDPMMFDUFE SFDJQFTGSPN$PPLQBEUIFOFTUJNBUFEUIFOVNCFSPG
 TFSWJOHTGSPNUIFNNBOVBMMZ .FUIPET 3&SFHVMBSFYQSFTTJPOCBTFENFUIPEXIJDIFYUSBDUTBWBMVFGSPNUIF
 BNPVOUJOFBDISFDJQF .-PVS.-CBTFENFUIPEXIJDIVTFTDBUFHPSJFT GPSQFSTPO

    ʜ VQUP
 QFPQMF

  16. &YQFSJNFOU4FSWJOH&TUJNBUJPO 3FTVMUT 5IF.-CBTFENFUIPEBDIJFWFEBOBDDVSBDZPGNPSFUIBO 5IFTJOHMFTPVSDFNPEFMTMJHIUMZPVUQFSGPSNFEUIFNVMUJTPVSDFNPEFM
 &TTFOUJBMMZ UIFOVNCFSPGTFSWJOHTGPSBSFDJQFDBOOPUCFFTUJNBUFEXJUIPVU
 JUTUJUMFJOGPSNBUJPO
 5IFOVNCFSPGFYBNQMFTJOPVSUSBJOJOHTFUXBTUPPTNBMMUPUSBJOUXP
 FODPEFSTTPXFXJMMFYQBOEUIFUSBJOJOHTFUJOGVUVSFXPSL 4PVSDF

    5JUMF "NPVOU "DDVSBDZ 3& TJOHMF 㾎  .- TJOHMF 㾎  TJOHMF 㾎  NVMUJ 㾎 㾎 

  17. &YQFSJNFOU4FSWJOH&TUJNBUJPO ✕'BJMFECZVTJOHUIFUJUMFJOGPSNBUJPO
 0VSUSBJOJOHTFUDPOUBJOFETPNFSFDJQFTJOXIJDIPOF,PSFBOQBODBLFTFSWFEUXPQFPQMF
 ✕'BJMFECZOPUVTJOHUIFUJUMFJOGPSNBUJPO
 0OFTNBMMDSPRVFUUFJTHFOFSBMMZOPUTV⒏DJFOUGPSPOFQFSTPO
 ✕'BJMFECZOPUVTJOHUIFRVBOUJUZJOGPSNBUJPOPOUIFJOHSFEJFOUT
 'VUVSFXPSLXJMMCFOFFEFE 5JUMF "NPVOU )VNBO

    4ZTUFN TJOHMF 4ZTUFN NVMUJ γϡΨʔύϯ 4VHBS#SFBE ݸ QJFDFT    ૉ๿ͳϨʔζϯύϯ 4JNQMF3BJTJO#SFBE ی MPBG    ΋ͪ΋ͪ໺ࡊνξϛ $IFXZ,PSFBO7FHFUBCMF1BODBLF ϑϥΠύϯຕ෼ GSZJOHQBOT    πφϙςτͷϛχίϩοέˑ͓ห౰ʹ΋ 4NBMM5VOBBOE1PUBUP$SPRVFUUFTˑBMTPGPS-VODI#PY ݸ෼ QJFDFT    ؁͞߇͑ΊͷΫοΩʔ $PPLJFTXJUI-FTT4VHBS మ൘ຕ෼ JSPOQMBUF    4VDDFTTGVMBOEGBJMFEFYBNQMFTPGTFSWJOHFTUJNBUJPO ✕ ✕ ✕ ✕

  18. %FQMPZ "TBSJ$MBN3JDF HP ɹɹɹɹɹΞαϦɹ ɹɹɹɹɹถɹɹɹ ɹɹɹɹɹԘɹɹɹ ɹɹɹɹɹञɹɹɹ ɹɹɹɹɹ͠ΐ͏Ώ ɹɹɹɹɹΈΓΜɹ SJDF

    BTBSJDMBN TBMU TBLF TPZTBVDF TXFFUTBLF 㾎 㾎 㾎 㾎 㾎 㾎 8FIBWFFTUJNBUFEUIFOVNCFSPGDBMPSJFTJOPWFS  SFDJQFTBOEBDUVBMMZVTFUIFNJOPVSSFDJQFTFSWJDF 6TFUIFTJOHMFTPVSDFNPEFMGPSTFSWJOHFTUJNBUJPO  c(r) = ∑ i∈Ir c(i) ⋅ q(i)/100 s(r) = 306.6 㾎 *OHSFEJFOU

  19. 4VNNBSZ 8FIBWFJOUSPEVDFEUIFGPMMPXJOHUISFFUBTLT
 JOUP$PPLQBE $BMPSJFFTUJNBUJPO NBJOUBTL 
 *OHSFEJFOUOPSNBMJ[BUJPO TVCUBTL 
 4FSWJOHFTUJNBUJPO

    TVCUBTL  8FIBWFBQQMJFE.-CBTFENFUIPETGPSUIFTF UBTLTBOEEFQMPZFEUIFNJOPVSSFBMXPSMESFDJQF TFSWJDF 5IFNFUIPETQFSGPSNFETV⒏DJFOUMZXFMMUPCFVTFEJOPVSTFSWJDF 'VUVSFXPSL 5PFYQBOEUIFOVNCFSPGJOHSFEJFOUTBOESFDJQFTUPXIJDIPVSNFUIPETDBOCF
 BQQMJFE

  20. 5IBOLZPV