Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Calorie Estimation in a Real-World Recipe Service/iaai-20

558ffd4e5cf6c95e60c91333677b93c4?s=47 j.harashima
February 09, 2020
0
6.7k

Calorie Estimation in a Real-World Recipe Service/iaai-20

558ffd4e5cf6c95e60c91333677b93c4?s=128

j.harashima

February 09, 2020
Tweet

More Decks by j.harashima

See All by j.harashima
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
470
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
1.9k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
44
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
3.6k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
9k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
2.5k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
0
5.5k
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
1
55
558ffd4e5cf6c95e60c91333677b93c4?s=48 junharashima
4
3.5k

Featured

See All Featured
E76911cbe088e5b850d966de3fc7435b?s=48 robhawkes
52
2.8k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
775
200k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
656
54k
170b760e0147792d0140e59ec78e9893?s=48 eitanlees
112
10k
Ded01cdab114abe4ec13511e4c25b9bb?s=48 andyhume
63
3.7k
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
237
23k
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
118
7.9k
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
272
16k
8ec1383b240b5ba15ffb9743fceb3c0e?s=48 philnash
9
590
5b6a2bd86ef643786a381a212e0ef2f1?s=48 geoffreycrofte
21
930
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
294
39k
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
70
3.6k

Transcript

  1. $BMPSJF&TUJNBUJPO JOB3FBM8PSME3FDJQF4FSWJDF +VO)BSBTIJNB .BLPUP)JSBNBUTV 4BUPTIJ4BOKP $PPLQBE*OD

  2. 4VNNBSZ 8FIBWFJOUSPEVDFEUIFGPMMPXJOHUISFFUBTLT JOUP$PPLQBE $BMPSJFFTUJNBUJPO NBJOUBTL 
 *OHSFEJFOUOPSNBMJ[BUJPO TVCUBTL 
 4FSWJOHFTUJNBUJPO

    TVCUBTL  8FIBWFBQQMJFENBDIJOFMFBSOJOH .- CBTFE NFUIPETGPSUIFTFUBTLTBOEEFQMPZFEUIFNJO PVSSFBMXPSMESFDJQFTFSWJDF

  3. $PPLQBE 1MBUGPSNGPSQFPQMFUPTIBSF
 SFDJQFJEFBTBOEDPPLJOHUJQT NJMMJPOVTFSTJODPVOUSJFT
 NJMMJPOSFDJQFT IBMGBSFJO+BQBOFTF

  4. $BMPSJF&TUJNBUJPO  &TUJNBUFUIFOVNCFSPGDBMPSJFT
 QFSTFSWJOHJOBSFDJQF DBMPSJF XIPMF
 BNPVOU

  5. 6TFJOHSFEJFOUTBOEBNPVOU TVNPGUIFDBMPSJFTJOUIFJOHSFEJFOUT OVNCFSPGTFSWJOHTPGUIFSFDJQF $BMPSJF&TUJNBUJPO  c(r) = ∑ i∈Ir c(i)

    ⋅ q(i)/100 s(r)

  6. HSBNTPGUIFJOHSFEJFOU
 JOUIFSFDJQF )PXEPXFPCUBJOc(i) γϝδ
 TIJNFKJNVTISPPN  χϯδϯ
 DBSSPU  ʜ

    ʜ ✕ JOHSFEJFOUEJDUJPOBSZ ͠Ί͡ TIJNFKJNVTISPPN ͠Ί͡JTO`UUIFTBNF
 BTγϝδ c(r) = ∑ i∈Ir c(i) ⋅ q(i)/100 s(r) *OHSFEJFOU/PSNBMJ[BUJPO  DBMPSJFTQFSHSBNT
 PGBOJOHSFEJFOU

  7. 4FWFSBMJTTVFTNVTUCFTPMWFE 1FPQMFDBOEFTDSJCFUIFJOHSFEJFOUTJOUIFJSSFDJQFTGSFFMZ JONBOZEJ⒎FSFOU
 XBZT FH ͠ΐ͏Ώ TPZTBVDF IBTNPSFUIBOFYQSFTTJPOTJO$PPLQBE TVDIBT γϣ΢Ϣ

    ͠ΐ͏༉ ͓ে༉ BOEὑ͠ΐ͏༉ *OHSFEJFOU/PSNBMJ[BUJPO  0SJHJOBMGPSN $BOPOJDBMGPSN 0SUIPHSBQIJD WBSJBOUT ਓࢀ DBSSPU ʹΜ͡Μ DBSSPU "CCSFWJBUJPOT ৽ͨ· TQSJOHPOJPO ৽ͨ·Ͷ͗ TQSJOHPOJPO 4QFMMJOH NJTUBLFT ΞϘΨυ BWPDBEP ΞϘΧυ BWPDBEP 0UIFS അླḕ QPUBUP ͡Ό͕͍΋ QPUBUP 0SJHJOBMGPSN $BOPOJDBMGPSN 4ZNCPMT ὑຯḩ ὑNJTP ຯḩ NJTP 1BSFOUIFTFT ༉ ᖱΊ༻  PJM GPSGSZJOH ༉ PJM 1SFpY ͓࠭౶ TVHBS ࠭౶ TVHBS 0UIFS ͋Ε͹ϩʔζϚϦʔ SPTFNBSZ JGBOZ ϩʔζϚϦʔ
 SPTFNBSZ &YBNQMFTPGJOHSFEJFOUOPSNBMJ[BUJPO

  8. "QQMZBOFODPEFSEFDPEFSNPEFM 5IFFODPEFSUBLFTUIFPSJHJOBMJOHSFEJFOUOBNFBTBOJOQVU
 5IFEFDPEFSHFOFSBUFTBDBOPOJDBMGPSNBTBOPVUQVU %PO`UVTFBUUFOUJPONFDIBOJTNTCFDBVTFUIFJOHSFEJFOUOBNFTBSFTIPSUTP
 UIFNFUIPEXPVMEOPUCFF⒎FDUJWF *OHSFEJFOU/PSNBMJ[BUJPO  y1 yJ y2

    … canonical form of the ingredient decoder original string of an ingredient encoder x1 x2 xI … softmax softmax softmax …

  9. )PXEPXFPCUBJOs(r) ✕ OVNCFSPGTFSWJOHTPGUIFSFDJQF খുݸ෼ TNBMMCPXMT IPXNBOZQFPQMFJT UIJTSFDJQFGPS c(r) = ∑

    i∈Ir c(i) ⋅ q(i)/100 s(r) 4FSWJOH&TUJNBUJPO 

  10. 4FSWJOH&TUJNBUJPO  4FWFSBMJTTVFTNVTUCFTPMWFE 1FPQMFBMTPGSFFMZFYQSFTTBOBNPVOUJOUIFJSSFDJQFT 5JUMF "NPVOU PGTFSWJOHT ίίφοπΦΠϧೖΓ΄͏ΕΜ૲ΧϨʔ 4QJOBDI$VSSZXJUI$PDPOVU0JM ࡼ෼

    QMBUFT  ͜ΜͿɾͻ͖͡ɾ΄ͨͯ͝͸Μ .JYFE3JDFXJUI,PNCVɾ)JKJLJɾ4DBMMPQ ߹෼ HP  άϥϊʔϥΫοΩʔ (SBOPMB$PPLJFT ຕ QJFDFT  ύϯϓΩϯλϧτ 1VNQLJO5BSU DNλϧτܕ DNUBSUNPME  &YBNQMFTPGTFSWJOHFTUJNBUJPO "MUIPVHIUIFSFBSFTFWFSBMBOTXFSTGPSTPNFSFDJQFT XFEPOPUQVSTVFUIJTJTTVFJOPVSTFSWJDF

  11. 4FSWJOH&TUJNBUJPO  "QQMZUXPOFVSBMDMBTTJpDBUJPONPEFMT 5IFFODPEFSUBLFTBUJUMFBOEPSBNPVOUJOBSFDJQFBTBOJOQVU
 5IFEFOTFMBZFSTUSBOTGPSNUIFPVUQVUPGUIFFODPEFS T JOUPUIFOVNCFSPG
 TFSWJOHT dense title

    or amount encoder xa1 xa2 xaI … softmax y serving dense amount encoder xa1 xa2 xaJ … title encoder xt1 xt2 xtI … softmax y serving 4JOHMFTPVSDFNPEFM .VMUJTPVSDFNPEFM

  12. &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO %BUB 8FDPMMFDUFE EJTUJODUJOHSFEJFOUTGSPN$PPLQBE OPSNBMJ[FEUIFN
 NBOVBMMZ UIFOSFNPWFE XIPTFOPSNBMJ[FEWFSTJPOTXFSFUIFTBNFBT
 UIFJSPSJHJOBMTUSJOHT 8FVTFEUIFSFNBJOJOH

    JOHSFEJFOUT .FUIPET 3&SFHVMBSFYQSFTTJPOCBTFENFUIPEXIJDISFNPWFTTZNCPMTBOE
 QBSFOUIFTFTGSPNUIFPSJHJOBMTUSJOHT .-PVS.-CBTFENFUIPE

  13. &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO 3FTVMUT 5IF.-CBTFENFUIPETVDDFTTGVMMZOPSNBMJ[FENPSF
 UIBOPGUIFJOHSFEJFOUT 0SJHJOBMGPSN $BOPOJDBMGPSN 0SUIPHSBQIJD WBSJBOUT ͔ͨ͘Γค QPUBUPTUBSDI

    ย܀ค QPUBUPTUBSDI "CCSFWJBUJPOT ڇͻ͖ HSPVOECFFG ڇͻ͖೑ HSPVOECFFG 4QFMMJOH NJTUBLFT ਫ໊ NJ[VOB ਫࡊ NJ[VOB 0UIFS ࢳ͏Γ TQBHIFUUJTRVBTI ͦ͏ΊΜ͔΅ͪΌ TQBHIFUUJTRVBTI 0SJHJOBMGPSN $BOPOJDBMGPSN 4ZNCPMT ˑখഴค ˑqPVS খഴค qPVS 1BSFOUIFTFT Ϩʔζϯ ͓޷ΈͰ  SBJTJO BTZPVMJLF Ϩʔζϯ SBJTJO 1SFpY ͓౾෗ UPGV ౾෗ UPGV 0UIFS ྫྷ͑ͨτϚτ DIJMMFEUPNBUP τϚτ UPNBUP 4VDDFTTGVMFYBNQMFTPGJOHSFEJFOUOPSNBMJ[BUJPO "DDVSBDZ 3&  .- 

  14. 5XPUZQFTPGOPSNBMJ[BUJPOFSSPS 8SPOHMZHFOFSBUJOHOPOFYJTUFOUJOHSFEJFOUT 8SPOHMZHFOFSBUJOHEJ⒎FSFOUJOHSFEJFOUT 'VUVSFXPSLSFRVJSFE 5PDPOTJEFSUIFFYJTUFODFPGUIFPVUQVUBOEJUTTJNJMBSJUZUPUIFJOQVU
  )BSBTIJNBBOE:BNBEB 
 5PFYQBOEUIFUSBJOJOHTFU &YQFSJNFOU*OHSFEJFOU/PSNBMJ[BUJPO

    *OQVU )VNBOPVUQVU 4ZTUFNPVUQVU χΨ΢Ϧ CJUUFSNFMPO ΰʔϠ CJUUFSNFMPO ʹ͕͕Γ OPOFYJTUFOUXPSE ḕᤸ ZBN ࢁҶ ZBN ͡Ό͕͍΋ QPUBUP

  15. &YQFSJNFOU4FSWJOH&TUJNBUJPO %BUB 8FDPMMFDUFE SFDJQFTGSPN$PPLQBEUIFOFTUJNBUFEUIFOVNCFSPG
 TFSWJOHTGSPNUIFNNBOVBMMZ .FUIPET 3&SFHVMBSFYQSFTTJPOCBTFENFUIPEXIJDIFYUSBDUTBWBMVFGSPNUIF
 BNPVOUJOFBDISFDJQF .-PVS.-CBTFENFUIPEXIJDIVTFTDBUFHPSJFT GPSQFSTPO

    ʜ VQUP
 QFPQMF

  16. &YQFSJNFOU4FSWJOH&TUJNBUJPO 3FTVMUT 5IF.-CBTFENFUIPEBDIJFWFEBOBDDVSBDZPGNPSFUIBO 5IFTJOHMFTPVSDFNPEFMTMJHIUMZPVUQFSGPSNFEUIFNVMUJTPVSDFNPEFM
 &TTFOUJBMMZ UIFOVNCFSPGTFSWJOHTGPSBSFDJQFDBOOPUCFFTUJNBUFEXJUIPVU
 JUTUJUMFJOGPSNBUJPO
 5IFOVNCFSPGFYBNQMFTJOPVSUSBJOJOHTFUXBTUPPTNBMMUPUSBJOUXP
 FODPEFSTTPXFXJMMFYQBOEUIFUSBJOJOHTFUJOGVUVSFXPSL 4PVSDF

    5JUMF "NPVOU "DDVSBDZ 3& TJOHMF 㾎  .- TJOHMF 㾎  TJOHMF 㾎  NVMUJ 㾎 㾎 

  17. &YQFSJNFOU4FSWJOH&TUJNBUJPO ✕'BJMFECZVTJOHUIFUJUMFJOGPSNBUJPO
 0VSUSBJOJOHTFUDPOUBJOFETPNFSFDJQFTJOXIJDIPOF,PSFBOQBODBLFTFSWFEUXPQFPQMF
 ✕'BJMFECZOPUVTJOHUIFUJUMFJOGPSNBUJPO
 0OFTNBMMDSPRVFUUFJTHFOFSBMMZOPUTV⒏DJFOUGPSPOFQFSTPO
 ✕'BJMFECZOPUVTJOHUIFRVBOUJUZJOGPSNBUJPOPOUIFJOHSFEJFOUT
 'VUVSFXPSLXJMMCFOFFEFE 5JUMF "NPVOU )VNBO

    4ZTUFN TJOHMF 4ZTUFN NVMUJ γϡΨʔύϯ 4VHBS#SFBE ݸ QJFDFT    ૉ๿ͳϨʔζϯύϯ 4JNQMF3BJTJO#SFBE ی MPBG    ΋ͪ΋ͪ໺ࡊνξϛ $IFXZ,PSFBO7FHFUBCMF1BODBLF ϑϥΠύϯຕ෼ GSZJOHQBOT    πφϙςτͷϛχίϩοέˑ͓ห౰ʹ΋ 4NBMM5VOBBOE1PUBUP$SPRVFUUFTˑBMTPGPS-VODI#PY ݸ෼ QJFDFT    ؁͞߇͑ΊͷΫοΩʔ $PPLJFTXJUI-FTT4VHBS మ൘ຕ෼ JSPOQMBUF    4VDDFTTGVMBOEGBJMFEFYBNQMFTPGTFSWJOHFTUJNBUJPO ✕ ✕ ✕ ✕

  18. %FQMPZ "TBSJ$MBN3JDF HP ɹɹɹɹɹΞαϦɹ ɹɹɹɹɹถɹɹɹ ɹɹɹɹɹԘɹɹɹ ɹɹɹɹɹञɹɹɹ ɹɹɹɹɹ͠ΐ͏Ώ ɹɹɹɹɹΈΓΜɹ SJDF

    BTBSJDMBN TBMU TBLF TPZTBVDF TXFFUTBLF 㾎 㾎 㾎 㾎 㾎 㾎 8FIBWFFTUJNBUFEUIFOVNCFSPGDBMPSJFTJOPWFS  SFDJQFTBOEBDUVBMMZVTFUIFNJOPVSSFDJQFTFSWJDF 6TFUIFTJOHMFTPVSDFNPEFMGPSTFSWJOHFTUJNBUJPO  c(r) = ∑ i∈Ir c(i) ⋅ q(i)/100 s(r) = 306.6 㾎 *OHSFEJFOU

  19. 4VNNBSZ 8FIBWFJOUSPEVDFEUIFGPMMPXJOHUISFFUBTLT
 JOUP$PPLQBE $BMPSJFFTUJNBUJPO NBJOUBTL 
 *OHSFEJFOUOPSNBMJ[BUJPO TVCUBTL 
 4FSWJOHFTUJNBUJPO

    TVCUBTL  8FIBWFBQQMJFE.-CBTFENFUIPETGPSUIFTF UBTLTBOEEFQMPZFEUIFNJOPVSSFBMXPSMESFDJQF TFSWJDF 5IFNFUIPETQFSGPSNFETV⒏DJFOUMZXFMMUPCFVTFEJOPVSTFSWJDF 'VUVSFXPSL 5PFYQBOEUIFOVNCFSPGJOHSFEJFOUTBOESFDJQFTUPXIJDIPVSNFUIPETDBOCF
 BQQMJFE

  20. 5IBOLZPV