画像を用いたファッションアイテム検索/Image Retrieval for Fashion

Transcript

1. © 2017 VASILY,Inc. ը૾Λ༻͍ͨϑΝογϣϯΞΠςϜ ݕࡧ !UO
   7"4*-:
   *OD
   
   5PLZP8FCNJOJOH
   
2. © 2017 VASILY,Inc. ࣗݾ঺հ ‣ தଜ
   ୓ຏ
   
   !UO
   ‣ σʔλαΠΤϯςΟετ
   ‣ ུྺɿ
    
   
   
   ΞΫηϯνϡΞ
    
   
   
   
   
   ݱࡏ
   
   
   
   
   7"4*-:
   ‣ ۀ຿ɿ
    ػցֶशɾը૾ೝࣝ
    ΞϧΰϦζϜͷ։ൃ
    αʔϏε΁ͷద༻ 
3. © 2017 VASILY,Inc. Ҏ্ͷϑΝογϣϯ&$αΠτ͔Βͷ΂ສ఺Λ௒͑Δ঎඼Λܝࡌ ݄ؒສਓҎ্͕ར༻͢Δ೔ຊ࠷େڃͷϑΝογϣϯαΠτ
4. © 2017 VASILY,Inc. ໨࣍  ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
    ϑΝογϣϯը૾ͷσʔλಛੑ
    ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
    جຊతͳߟ͑ํ
    "UUSJCVUF
   1SFEJDUJPO
    4JNJMBSJUZ
   -FBSOJOH
    4FNBOUJD
   4FHNFOUBUJPO
    ,FZ
   QPJOU
   %FUFDUJPO 
5. © 2017 VASILY,Inc. ໨࣍  ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
    ϑΝογϣϯը૾ͷσʔλಛੑ
    ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
    جຊతͳߟ͑ํ
    "UUSJCVUF
   1SFEJDUJPO
    4JNJMBSJUZ
   -FBSOJOH
    4FNBOUJD
   4FHNFOUBUJPO
    ,FZ
   QPJOU
   %FUFDUJPO 
6. © 2017 VASILY,Inc. ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋ ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔ 
7. © 2017 VASILY,Inc. ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋ ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔ ʻ.VOJDIʼ
   ϒϥ΢εʢ./5ʣ
   = 
   ϒϥϯυɿϛϡχοΫʦ.6/*$)ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   Ϟʔυͳண͜ͳ͠Λ׎͑ΔϘϦϡʔϜεϦʔϒͷϒϥ΢εͰ͢ɻ କΛંΓฦͯ͠௚ઢతͳΧοτΛڧௐ͢Δ͜ͱͰɺ०ͷσΟςΠ ϧ΋ͻͱຯҧ͏ݟ͑ํʹɻγϯϓϧͳ਎ࠒͱͷόϥϯε΋ྑ޷Ͱ ͢ɻγϫʹͳΓʹ͍͘৳ॖૉࡐΛ࢖͓ͬͯΓɺσΠϦʔʹؾܰʹ औΓೖΕΒΕΔͷ͕ϙΠϯτɻ͖ͬ͢Γͱ։͍ͨ7ωοΫ͕େਓ ͷঁੑΒ͠͞Λԋग़͠·͢ɻ <8&#ݶఆ঎඼><΢Υογϟϒϧ>ϑϨΞεϦʔϒϒϥ΢ε
   = 
   ϒϥϯυɿ
   ΦΫτʔϒϧʦ
   0$50#3&ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   τϨϯυΛҙࣝͨ͠ϑϨΞεϦʔϒτοϓεɻ͖ͬ͢Γͱൈ͚ײ ͷ͋ΔωοΫϥΠϯ΍όοΫγϣοτ͕ঁੑΒ͍͠งғؾͮ͘Γ ͷϙΠϯτɻ্඼͞΋͓͠ΌΕײ΋ซͤ࣋ͬͨҰ඼͸ɺͲΜͳੈ ୅ͷํ͔Β΋޷ධͰ͢ɻΦϑΟε΋σʔτ΋͓೚ͤͷσβΠϯͰ ͢ɻ ςΩετͰൺֱͨ͠৔߹ 
8. © 2017 VASILY,Inc. ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋ ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔ ʻ.VOJDIʼ
   ϒϥ΢εʢ./5ʣ
   = 
   ϒϥϯυɿϛϡχοΫʦ.6/*$)ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   Ϟʔυͳண͜ͳ͠Λ׎͑ΔϘϦϡʔϜεϦʔϒͷϒϥ΢εͰ͢ɻ କΛંΓฦͯ͠௚ઢతͳΧοτΛڧௐ͢Δ͜ͱͰɺ०ͷσΟςΠ ϧ΋ͻͱຯҧ͏ݟ͑ํʹɻγϯϓϧͳ਎ࠒͱͷόϥϯε΋ྑ޷Ͱ ͢ɻγϫʹͳΓʹ͍͘৳ॖૉࡐΛ࢖͓ͬͯΓɺσΠϦʔʹؾܰʹ औΓೖΕΒΕΔͷ͕ϙΠϯτɻ͖ͬ͢Γͱ։͍ͨ7ωοΫ͕େਓ ͷঁੑΒ͠͞Λԋग़͠·͢ɻ <8&#ݶఆ঎඼><΢Υογϟϒϧ>ϑϨΞεϦʔϒϒϥ΢ε
   = 
   ϒϥϯυɿ
   ΦΫτʔϒϧʦ
   0$50#3&ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   τϨϯυΛҙࣝͨ͠ϑϨΞεϦʔϒτοϓεɻ͖ͬ͢Γͱൈ͚ײ ͷ͋ΔωοΫϥΠϯ΍όοΫγϣοτ͕ঁੑΒ͍͠งғؾͮ͘Γ ͷϙΠϯτɻ্඼͞΋͓͠ΌΕײ΋ซͤ࣋ͬͨҰ඼͸ɺͲΜͳੈ ୅ͷํ͔Β΋޷ධͰ͢ɻΦϑΟε΋σʔτ΋͓೚ͤͷσβΠϯͰ ͢ɻ ςΩετͰൺֱͨ͠৔߹ କʹؔ͢Δઆ໌
   ϑϨΞεϦʔϒ
   WT
   ϘϦϡʔϜεϦʔϒʁ ۗʹؔ͢Δઆ໌
   ൈ͚ײͷ͋ΔωοΫϥΠϯͱ͸ʁ 
9. © 2017 VASILY,Inc. ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋ ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔ ը૾Ͱൺֱͨ͠৔߹ 
10. © 2017 VASILY,Inc. ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋ ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔ ը૾Ͱൺֱͨ͠৔߹ 
11. © 2017 VASILY,Inc. ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋ ΞΠςϜͷྨࣅ౓ΛධՁ͢Δ্Ͱը૾͸͔ܽͤͳ͍৘ใͰ͋Δ ‣ ΞΠςϜͷڞ௨఺΍ࠩ෼͕೺ѲͰ͖Δ
     ςΩετʹൺ΂ؚͯ·ΕΔ৘ใͷྔ͕ଟ͍
    ‣ ΞΠςϜͷը૾͸ίϯςΩετΛؚΜͰ͍Δ
     ը૾ΛݟΔ͚ͩͰར༻γʔϯ΍ίʔσΟωʔτ͕૝૾Ͱ͖Δࣄ͕͋Δ
    ‣ ϑΝογϣϯ༻ޠͷࣙॻ΍Φϯτϩδʔ͕ඞཁͳ͍
     ϑΝογϣϯ͸ྲྀߦʹහײͳ෼໺ͷͨΊɺࣙॻͷϝϯςͷ޻਺Λ࡟ݮ Ͱ͖Δ͜ͱͷϝϦοτ͸ඇৗʹେ͖͍ ෳࡶͳ৘ใΛநग़Մೳͳը૾ೝٕࣝज़͸ϑΝογϣϯͱ૬ੑ͕ྑ͍ 
12. © 2017 VASILY,Inc. ໨࣍  ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
     ϑΝογϣϯը૾ͷσʔλಛੑ
     ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
     جຊతͳߟ͑ํ
     "UUSJCVUF
    1SFEJDUJPO
     4JNJMBSJUZ
    -FBSOJOH
     4FNBOUJD
    4FHNFOUBUJPO
     ,FZ
    QPJOU
    %FUFDUJPO 
13. © 2017 VASILY,Inc. ϑΝογϣϯσʔλͷಛੑ  ϑΝογϣϯͰѻ͏σʔλʹ͸υϝΠϯಛ༗ͷࣄ৘͕ଘࡏ͢Δ ΧςΰϦ΍ଐੑ ͷଟ༷ੑ ྫ ΧςΰϦ΍ଐੑͷछྨ͕ଟ͍ GBCMJDŊTUZMF 
    ج४͕ᐆດͰਓखͰ΋൑ผ͕ࠔ೉ ϓϧΦʔόʔγϟπ
    ͬͯͳײ͡Ͱ͍ͭ΋෰೰Ή
    شൃੑ εέʔϧ ࣭ ؍఺ Ψ΢νϣɾεΧϯπ໰୊
    നWTΦϑϗϫΠτ ϑΝογϣϯΞΠςϜ΍༻ޠ͸ೖΕସΘΓ͕ܹ͍͠
    ʮϑΝογϣϯʯ
    
    ʮྲྀߦʯͳͷͰ ສ఺೔
    ͷ৽ணΞΠςϜ
    ΦʔόʔΦʔϧ
    
    αϩϖοτ &$αΠτͰѻ͏঎඼ͷଞɺ4/4΁౤ߘ͞ΕΔը૾΋ ϑΝογϣϯը૾ʹؚ·ΕΔ΋ͷ͕͋Δ *OTUBHSBN
    1JOUFSFTU ଟ༷ͳΧςΰϦͱ$POTVNFS
    HFOFSBUFEͳը૾
    ϥϕϧͷؒҧ͍΍ࣗ༝ա͗Δϋογϡλά આ໌
14. © 2017 VASILY,Inc. ϑΝογϣϯ෼໺Ͱѻ͏ը૾ͷྫ  &$αΠτ $POTVNFS
    HFOFSBUFE ஔ͖ࡱΓ ண༻ ιʔε
15. © 2017 VASILY,Inc. ໨࣍  ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
     ϑΝογϣϯը૾ͷσʔλಛੑ
     ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
     جຊతͳߟ͑ํ
     "UUSJCVUF
    1SFEJDUJPO
     4JNJMBSJUZ
    -FBSOJOH
     4FNBOUJD
    4FHNFOUBUJPO
     ,FZ
    QPJOU
    %FUFDUJPO 
16. © 2017 VASILY,Inc. جຊతͳߟ͑ํ ϑΝογϣϯը૾ͷݕࡧ͸*NBHF
    3FUSJFWBMͱ͍͏ΑΓ*OTUBODF
    3FUSJFWBM  ‣ ը૾͸ඇઢܗؔ਺ʹΑͬͯಛ௃্ۭؒͷ఺ ʹࣹӨ͞ΕΔ
    ‣ ը૾ͷυϝΠϯʹؔ܎ͳ͘ɺಉ͡ΞΠςϜ͸ ۙ͘ͷ఺ʹࣹӨ͢ΔΑ͏ͳؔ਺͕͋Ε͹ྑ͍
    ‣ ্ड़ͷཁ݅Λຬͨؔ͢਺ΛʮֶशʯʹΑͬͯ ֫ಘ͢Δ CNN CNN ݕࡧΫΤϦ ඇઢܗؔ਺ ಛ௃ۭؒ Ξϓϩʔν ‣ ಉ͡ΞΠςϜΛಉ͡Ͱ͋Δͱಉఆ͢Δ
    ‣ ΞΠςϜͷมܗ΍എܠ͸ແࢹ͢Δ *OTUBODF
    3FUSJFWBM
17. © 2017 VASILY,Inc. ݚڀࣄྫ  ख๏͸༷ʑ͋Δ͕ɺओʹಛ௃நग़ͷํ๏͕ҟͳΔ :BOH
    ;IBJ ,FZXPSET ൑ผλεΫͷֶशͰಘΒΕΔજࡏঢ়ଶΛ ಛ௃ྔͱ͢Δ LFZQPJOUճؼλεΫͷֶशͰಘΒΕΔ
    
    
    જࡏঢ়ଶΛಛ௃ྔͱ͢Δ ΞΠςϜಉ࢜ͷྨࣅ౓Λֶश͢Δ ྖҬ෼ׂͰಘΒΕͨྖҬ͔Βہॴಛ௃ྔ Λநग़ͯ͠ൺֱ͢Δ "UUSJCVUF
    1SFEJDUJPO
    )BTIJOH 'BTIJPO
    -BOENBSL
    %FUFDUJPO 4IBOLBS
    4POH 7JUUBZBLPSO -JV ֓ཁ 4FNBOUJD
    4FHNFOUBUJPO
    'FBUVSF
    &YUSBDUJPO 5SJQMFU
    MPTT
    4JNJMBSJUZ
    -FBSOJOH ख๏
18. © 2017 VASILY,Inc. "UUSJCVUF
    1SFEJDUJPO
19. © 2017 VASILY,Inc. 7JTVBM
    4FBSDI
    BU
    F#BZ
    :BOH  ‣ F#BZͷը૾ݕࡧγεςϜʹؔͯ͠ɺΞϧΰϦζϜ΍ΞʔΩςΫνϟΛ঺հ
    ‣ ΧςΰϦ༧ଌλεΫ΍ଐੑ༧ଌλεΫͷ݁ՌΛݕࡧʹԠ༻͍ͯ͠Δ
20. © 2017 VASILY,Inc. 7JTVBM
    4FBSDI
    BU
    F#BZ
    :BOH  ‣ $PSF
    7JTJPO
    4FSWJDF͕ը૾ͷಛ௃ྔநग़Λߦ͏
    ‣ ը૾΍ಛ௃ྔΛͦͷ··อଘ͢ΔͷͰ͸ͳ͘ɺϋογϡ஋Λܭࢉͯ͠อଘ͢Δ ‣ )BTI
    (FOFSBUJPO
    ‣ $BUFHPSZ
    3FDPHOJUJPO
    ‣ "TQFDU
    1SFEJDUJPO ը૾ʹؔ͢Δɹ ίϯϙʔωϯτ
21. © 2017 VASILY,Inc. 0 1 0 1 0 1 )BTI
    (FOFSBUJPO  ‣ ΧςΰϦ൑ผ໰୊Λ௨ͯ͠ϋογϡؔ਺Λֶश͢Δ
    ‣ ςετ࣌͸׆ੑԽؔ਺ͷग़ྗΛᮢ஋Ͱ஋Խͯ͠ը૾ͷϋογϡ஋ͱ͢Δ )BNNJOHڑ཭ͰൺֱՄೳʹͳΓߴ଎ 0 1 4JHNPJEؔ਺ͷग़ྗΛ ద౰ͳᮢ஋Ͱ஋Խ͢Δ
22. © 2017 VASILY,Inc. "TQFDU
    1SFEJDUJPO
    BOE
    3FSBOLJOH  ‣ ΞΠςϜͷ"TQFDU͸9(#PPTUͰ൑ผ͢Δ
    ‣ "TQFDUͷྨࣅ౓ͱը૾ͷ)BNNJOHڑ཭ͷઢܗ݁߹Ͱ࠷ऴతͳ4DPSFΛܭࢉ͢Δ ai S = Sappearance + (1 )Saspect Saspect = 1 Pn i=1 wi n X i=1 m X j=1 wiI(aq i = aj) )BNNJOHڑ཭ʹجͮ͘4DPSF ‣ ΫΤϦͱݕࡧର৅ͷ"TQFDUͷҰக਺ʹґଘͯ͠4DPSF͕ܾ·Δ
    ‣ "TQFDUͷॏཁ౓ʹ͸܏͕͍͍ࣼͭͯΔ
    ‣ ߪೖʹޮ͍ͯ͘Δ"TQFDU΄ͱॏཁ౓͕େ͖͘ɺ͜ͷ஋͸
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    ϋʔυίʔυ͞Ε͍ͯΔ
23. © 2017 VASILY,Inc. ॴײ ‣ "UUSJCVUF
    1SFEJDUJPO͚ͩͰΞΠςϜݕࡧ͸࣮ݱͰ͖Δͷ͔
     ༧ଌͨ͠"TQFDUʹΑΔ3FSBOLJOHΛߦ͍ͬͯΔ
     ೖྗը૾ͷυϝΠϯʹؔͯ͠ݴٴ͕ͳ͍
    ‣ λεΫࣗମ͸ඇৗʹγϯϓϧ
     ൑ผλεΫ͸ൺֱత؆୯ʹֶशͰ͖Δ
    ‣ εέʔϧͤ͞ΔࡍͷࢀߟʹͳΔ
     ͜ͷ࢓૊͸F#BZͷνϟοτϘοτʹར༻͞Ε͍ͯΔ
     େྔͷϦΫΤετΛϦΞϧλΠϜʹॲཧ͢Δೳྗ͕ٻΊΒΕΔ 
24. © 2017 VASILY,Inc. 4JNJMBSJUZ
    -FBSOJOH
25. © 2017 VASILY,Inc. %FFQ
    -FBSOJOH
    CBTFE
    -BSHF
    4DBMF
    7JTVBM
    3FDPNNFOEBUJPO
    BOE
    4FBSDI
    GPS
    & $PNNFSDF
    4IBOLBS  ‣ ΠϯυͷϑΝογϣϯ&$αΠτͷը૾ݕࡧγεςϜ
    ‣ ΞΠςϜͷྨࣅ౓Λֶश͍ͯ͠Δ
26. © 2017 VASILY,Inc. Ϟσϧͷ֓ཁ  ‣ ਂ͍ύεͱઙ͍ύεΛ૊Έ߹ΘͤͨωοτϫʔΫʹΑΔಛ௃நग़
    ‣ ΞΠςϜͷྨࣅ౓͸5SJQMFU
    MPTTͰධՁ͍ͯ͠Δ 'JOF(SBJOFE
    *NBHF
    4JNJMBSJUZ 5SJQMFU
    MPTT
27. © 2017 VASILY,Inc.  'JOF(SBJOFE
    *NBHF
    4JNJMBSJUZ ‣ ਂ͍ωοτϫʔΫͱઙ͍ωοτϫʔΫΛ૊Έ߹ΘͤͨϞσϧ
    ‣ ը૾ͷෳࡶͳߏ଄ͱ୯७ͳߏ଄Λಉ࣌ʹѻ͏ͨΊͷ޻෉ ‣ ਂ͍ωοτϫʔΫ
     ը૾ͷෳࡶͳߏ଄Λೝࣝ͢Δ
     େ·͔ͳྠֲͳͲ
     ൑ผλεΫͰ׆༂ ‣ ઙ͍ωοτϫʔΫ
     ը૾ͷ୯७ͳߏ଄Λೝࣝ͢Δ
     ৭΍໛༷ͳͲ
     ఻౷తͳಛ௃நग़ख๏ʹ͍ۙ ಉ͡ΞΠςϜͰ͋Δͱೝ͍ࣝͨ͠ ҧ͏ΞΠςϜͰ͋Δͱೝ͍ࣝͨ͠
28. © 2017 VASILY,Inc. 5SJQMFU
    MPTT  Anchor CNN CNN CNN Positive Negative Embedding Embedding margin Anchor Positive Negative ֶश ‣ 5SJQMFU
    MPTT͸"ODIPS 1PTJUJWF /FHBUJWFͷ૊Λೖྗͱͯͦ͠ΕͧΕͷؒͷڑ཭ΛධՁ͢Δ
    ‣ "ODIPSɾ1PTJUJWFʹରͯ͠"ODIPSɾ/FHBUJWFؒͷڑ཭͕ҰఆҎ্େ͖͘ͳΔΑ͏ʹྗ͕͔͔Δ
29. © 2017 VASILY,Inc. 5SJQMFU
    MPTT  margin AnchorɾPositive ؒͷڑ཭ AnchorɾNegative ؒͷڑ཭ ‣ 5SJQMFU
    MPTT͸"ODIPS 1PTJUJWF /FHBUJWFͷ૊Λೖྗͱͯͦ͠ΕͧΕͷؒͷڑ཭ΛධՁ͢Δ
    ‣ "ODIPSɾ1PTJUJWFʹରͯ͠"ODIPSɾ/FHBUJWFؒͷڑ཭͕ҰఆҎ্େ͖͘ͳΔΑ͏ʹྗ͕͔͔Δ ๬·͘͠ͳ͍ঢ়ଶ ๬·͍͠ঢ়ଶ loss 0 ↵ D(a, n) D(a, p)
30. © 2017 VASILY,Inc. 5SJQMFU
    MPTTͷֶश͸ऩଋͤ͞Δ͜ͱ͕೉͍͠ͷͰ޻෉͕ඞཁ  ղܾࡦ ‣ #BUDIIBSE
     )FSNBOT
     ϛχόονͷதͰ࠷΋"ODIPSʹࣅ͍ͯΔෛྫͱ
    
    
    ࠷΋"ODIPSʹࣅ͍ͯͳ͍ਖ਼ྫΛαϯϓϦϯά͢Δ
    ‣ 4FNJIBSE
    OFHBUJWF
    NJOJOH
     4DISP⒎
     ֶशޮՌ͕͋Δఔ౓ظ଴Ͱ͖ɺֶ͔ͭश͕೉͘͠ ͳ͍ෛྫΛαϯϓϦϯά͢Δ Embedding Embedding margin Anchor Positive Negative Embedding ظ଴͢Δ ঢ়ଶ margin ๬·͘͠ ͳ͍ঢ়ଶ loss 0 ↵ D(a, n) D(a, p) ֶश
31. © 2017 VASILY,Inc. -FBSOJOH
    6OJpFE
    &NCFEEJOH
    GPS
    "QQBSFM
    3FDPHOJUJPO
    4POH  ‣ (PPHMF͕ఏҊ͍ͯ͠ΔϑΝογϣϯΞΠςϜݕࡧγεςϜ
    ‣ ෳ਺ͷΧςΰϦΛڞ௨ͷϞσϧͰѻ͏͜ͱ͕Ͱ͖Δ
32. © 2017 VASILY,Inc. ֶशޮՌͷߴ͍ෛྫΛαϯϓϦϯά͢Δ  Negative Positive Anchor Semi-hard Negative margin ‣ ϕʔγοΫͳαϯϓϦϯά
     "ODIPSͱҟͳΔΞΠςϜΛҰ༷ʹ αϯϓϦϯά͢Δ
     "ODIPSͱ໌Β͔ʹҟͳΔΞΠςϜ ͕αϯϓϧ͞Εͨ৔߹ɺֶशͷ
    
    
    ඞཁ͕ͳ͍
     "ODIPSͱࣅ͍͗ͯ͢ΔΞΠςϜ͕ αϯϓϧ͞Εͨ৔߹ɺѱ͍ہॴղ ʹτϥοϓ͞ΕΔ ֶशޮ཰͕ѱ͍ ‣ 4FNJIBSE
    OFHBUJWF
    NJOJOH
     "ODIPSͱҟͳΔΞΠςϜΛҎԼ ͷ੍໿Λຬͨ͢αϯϓϧΛબ୒ ͢Δ
     "ODIPS1PTJUJWFؒͷڑ཭ΑΓ "ODIPS/FHBUJWFؒͷڑ཭͕
    
    େ͖͍
     ্هΛຬ্ͨͨ͠Ͱ"ODIPSͱͷ ڑ཭͕࠷΋খ͍͞ xn i = argmin x n i || f ( xa i ) f ( xn i )||2 2 s.t. || f ( x a i ) f ( x p i )||2 2 < || f ( x a i ) f ( x n i )||2 2 ֶशޮ཰͕ߴֶ͘श͕༰қ || f ( x a i ) f ( x p i )||2
33. © 2017 VASILY,Inc. ෳ਺ͷֶशࡁΈϞσϧ͸ৠཹͯ͠ͻͱͭͷϞσϧʹ౷߹͢Δ  tops bottoms bags,… MPTT $// ɾ ɾ ɾ ɾ ɾ ɾ ɾ ɾ ɾ MMPTTͰධՁ
34. © 2017 VASILY,Inc. ॴײ ‣ 5SJQMFU
    MPTTΛ༻ֶ͍ͨश͸೉͍͠
     ൑ผλεΫͳͲΛ՝͢ͱߋʹ೉қ౓͕ߴ͘ͳΔ
     ֶशத͸"ODIPS 1PTJUJWF /FHBUJWFؒͷڑ཭Λৗʹ֬ೝͨ͠΄͏͕ྑ͍
     ඞཁʹԠͯ͡ίετؔ਺΍5SJQMFUͷαϯϓϦϯάΛ޻෉͢Δඞཁ͕͋Δ
    ‣ 'JOF(SBJOFE
    *NBHF
    4JNJMBSJUZ͸ศར
     طଘͷωοτϫʔΫΛ༰қʹ֦ுͰ͖Δ
     *20/ͷσʔλͰ΋࣮ࡍʹվળΛ֬ೝ
    ‣ ΧςΰϦຖʹϞσϧΛ࡞Δඞཁ͕͋Δ
     ϑΝογϣϯΞΠςϜ͸ΧςΰϦ਺͕ଟ͍ͷͰେม  deep shallow deep+shallow
35. © 2017 VASILY,Inc. 4FNBOUJD
    4FHNFOUBUJPO
36. © 2017 VASILY,Inc. 3VOXBZ
    UP
    3FBMXBZ
    7JTVBM
    "OBMZTJT
    PG
    'BTIJPO
    7JUUBZBLPSO  ‣ ϑΝογϣϯγϣʔͷը૾͔Β֗தͰࡱӨ͞Εͨը૾Λݕࡧ͢Δ
    ‣ ྖҬ෼ׂʹΑΔը૾ͷύʔεͱɺྖҬ͔Βͷಛ௃நग़Λߦ͍ͬͯΔ
37. © 2017 VASILY,Inc. ॲཧͷྲྀΕ  4FNBOUJD
    4FHNFOUBUJPO 'FBUVSF
    &YUSBDUJPO -JOFBS
    47. 1PTF
    &TUJNBUJPO ‣ :BOHΛར༻ͯ͠ϙʔζਪఆͱύʔπͷݕग़λεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷ#PVOEJOH
    CPY͔Βநग़͢Δ ‣ :BNBHVDIJΛར༻ͯ͠ྖҬ෼ׂͱྖҬຖͷΧςΰϦ൑ผλεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷྖҬ͔Βநग़͢Δ ‣ ෼ׂͨ͠ྖҬ͔Β༷ʑͳಛ௃ྔΛநग़͢Δ ‣ छྨͷը૾ΛαϯϓϦϯάͯ͠5VQMFΛߏ੒͢Δ
    ‣ αϯϓϦϯά͞Εͨ5VQMFʹ͍ͭͯɺࣅ͍ͯΔࣅ͍ͯͳ͍Λ൑ผ͢Δ
38. © 2017 VASILY,Inc. 1PTF
    &TUJNBUJPO  1PTF
    &TUJNBUJPO 4FNBOUJD
    4FHNFOUBUJPO 'FBUVSF
    &YUSBDUJPO -JOFBS
    47. ‣ :BOHΛར༻ͯ͠ϙʔζਪఆͱύʔπͷݕग़λεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷ#PVOEJOH
    CPY͔Βநग़͢Δ
39. © 2017 VASILY,Inc. 4FNBOUJD
    4FHNFOUBUJPO  1PTF
    &TUJNBUJPO 4FNBOUJD
    4FHNFOUBUJPO 'FBUVSF
    &YUSBDUJPO -JOFBS
    47. ‣ :BNBHVDIJΛར༻ͯ͠ྖҬ෼ׂͱྖҬຖͷΧςΰϦ൑ผλεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷྖҬ͔Βநग़͢Δ
40. © 2017 VASILY,Inc. 4FNBOUJD
    4FHNFOUBUJPO  1PTF
    &TUJNBUJPO 4FNBOUJD
    4FHNFOUBUJPO 'FBUVSF
    &YUSBDUJPO -JOFBS
    47. ‣ 3FUSJFWBM
     ύʔεࡁΈσʔληοτ͔Βࣅ ͍ͯΔը૾Λݕࡧ͢Δ
    ‣ 1BSTJOH
     ݕࡧͨ͠ը૾ͱͦΕʹඥͮ͘λ άΛύʔεʹར༻͢Δ
41. © 2017 VASILY,Inc. 'FBUVSF
    &YUSBDUJPO  1PTF
    &TUJNBUJPO 4FNBOUJD
    4FHNFOUBUJPO 'FBUVSF
    &YUSBDUJPO -JOFBS
    47. DPMPS ಛ௃ྔ ‣ 3(#
    ‣ -BC ॲཧ ‣ લܠྖҬ͔ΒΧϥʔɹɹ ώετάϥϜΛ࡞੒ UFYUVSF ‣ .3
    ‣ )0( TIBQF ‣ CJOBSZ
    NBTL
    ‣ %PMMBS QBSTF ‣ QFSDFOUBHF
    PG
    FBDI
    JUFN
    QSFTFOU TUZMF
    EFTDSJQUPS ‣ :BNBHVDIJ ‣ લܠྖҬ͔Βநग़ͯ͠ɹ ྔࢠԽ ‣ લܠྖҬΛࣔ͢CJOBSZ
    NBTLͱFEHF
    NBQ ‣ ΧςΰϦͷଘࡏ֬཰Λ ද֬͢཰ϕΫτϧ ‣ छྨͷಛ௃ྔܭ  ࣍ݩΛ1$"Ͱ࣍ݩʹ
42. © 2017 VASILY,Inc. ॴײ ‣ ݕࡧΛ࣮ݱ͢Δ·Ͱʹඞཁͳॲཧ͕ଟ͗͢Δ
     ͦΕͧΕͷॲཧͷਫ਼౓͸ͲΕ΄Ͳ͔
     &OEUP&OEͰ࠷దԽͰ͖ͳ͍͔
    ‣ ಛ௃ྔͷ࡞Γํ͕ࢀߟʹͳΔ
     ϑΝογϣϯͷ෼໺ʹ͓͍ͯޮՌతͳಛ௃ྔʹؔ͢Δࢿྉ
     ෰ͷྖҬ͕ਖ਼͘͠4FHNFOUBUJPOͰ͖Ε͹ݕࡧ༻ͷಛ௃ྔ΍ϥϯΩϯάΞϧΰϦζϜ͸γϯϓϧͰ΋ྑ͍
    ‣ ΫϩευϝΠϯݕࡧ͸Մೳ͔
     ࿦จͩͱண༻ը૾͔Βண༻ը૾ͷΈ
     ஔ͖ࡱΓը૾ʹ֦ு͢ΔͨΊʹ͸ಛ௃ྔΛ࠶౓ઃܭ͢Δඞཁ͕͋ΔͱࢥΘΕΔ 
43. © 2017 VASILY,Inc. ,FZ
    QPJOU
    %FUFDUJPO
44. © 2017 VASILY,Inc. 'BTIJPO
    -BOENBSL
    %FUFDUJPO
    JO
    UIF
    8JME
    -JV  ‣ ϑΝογϣϯΞΠςϜͷը૾͔Β,FZ
    QPJOUͷ࠲ඪ΍7JTJCMF*OWJTJCMFΛ༧ଌ͢ΔλεΫ
    ‣ ೖྗ͢Δը૾͸4IPQ
    JNBHF΋͘͠͸$POTVNFS
    HFOFSBUFE
    JNBHFΛ૝ఆͯ͠Δ
45. © 2017 VASILY,Inc. -BOENBSL
    EFUFDUJPOΛ࣮ݱ͢ΔϞσϧ  ‣ $//Λଟஈʹͯ͠ɺ4UBHFҎ߱͸લͷग़ྗΛҾ͖ܧ͙ܗʹͳ͍ͬͯΔ
    ‣ ࠲ඪͷճؼͷଞɺ1TFVEP-BCFMͷճؼͱ7JTJCJMJUZͷ൑ผΛಉ࣌ʹղ͍͍ͯΔ
    ‣ ֤4UBHFͷසग़ύλʔϯʹؔ͢Δ৘ใΛ1TFVEP-BCFMͱ͍͏ܗͰऔΓࠐΜͰ͍Δ
46. © 2017 VASILY,Inc. ֤4UBHFͱ1TFVEP-BCFMͷ໾ׂ  4UBHF ༧ଌ͢Δ΋ͷ ,FZ
    QPJOUͷେ·͔ͳ࠲ඪ 1TFVEP-BCFM 4UBHF 4UBHFͷ༧ଌͱਖ਼ղͷͣΕ
    Φϑηοτ Ͳͷ࢟੎ʹͲΕ͚͍͔ͩۙ
    ࢟੎
    㲈
    LFZ
    QPJOUͷ࠲ඪ Ͳͷ޲͖ʹͲΕ͚ͩमਖ਼ ͢Ε͹Α͍͔
    Φϑηοτͷύλʔϯ 4UBHF 4UBHFͷ༧ଌͱਖ਼ղͷͣΕ
    Φϑηοτ શମͷΦϑηοτͱݸʑͷΦϑηοτ ͷؔ܎ සग़ύλʔϯͱͷ ࠩ෼Λճؼ͢Δ
47. © 2017 VASILY,Inc. ݕࡧ΁ͷద༻  ‣ ֶशࡁΈϞσϧ͔Βநग़ͨ͠ಛ௃ྔͷMڑ཭ΛݕࡧλεΫʹద༻͢Δ
    ‣ ಛ௃ྔͱͯ͠༻͍Δͷ͸͓ͦΒ͘7((ͷग़ޱʹ౰ͨΔ࣍ݩͷϕΫτϧ ࿦จதʹৄࡉͳهࡌͳ͠ 7(( 3FUSJFWBM "UUSJCVUF
    1SFEJDUJPO
48. © 2017 VASILY,Inc. ॴײ ‣ ࠶ݱ͠ͳ͍
     ֶशΛ௥ࢼͯ͠Έ͕ͨ࿦จͷΑ͏ͳਫ਼౓Λୡ੒Ͱ͖ͳ͔ͬͨ
     ࿦จதʹॻ͔Ε͍ͯͳ͍ҋͷςΫχοΫ͕ଟͦ͏
    ‣ -BOENBSL͸఺ͷ࠲ඪΛճؼ͍ͯ͠Δ
     ϙʔζਪఆͷ෼໺ͰҰൠతͳͷ͸ώʔτϚοϓͷճؼ
     ώʔτϚοϓͷճؼͰ΋ղ͚ͦ͏
    ‣ ,FZ
    QPJOUͷݕग़λεΫ͸΋ͬͱ੝Γ্͕ͬͯཉ͍͠
     ͏·͘ݕग़Ͱ͖ΔΑ͏ʹͳΕ͹มܗʹڧ͍ݕࡧγεςϜ͕ߏஙͰ͖Δ
     ϑΝογϣϯ෼໺ͱ૬ੑྑͦ͞͏  ఺ͷ࠲ඪΛճؼ
    ֶशࡁΈϞσϧ ώʔτϚοϓΛճؼ
    8FJ
49. © 2017 VASILY,Inc. ·ͱΊ  ‣ ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
     ϑΝογϣϯ෼໺Ͱը૾ೝࣝΛѻ͏ҙٛʹ͍ͭͯ
     ѻ͏ը૾σʔλͷಛੑʹ͍ͭͯ
    ‣ ݚڀࣄྫ
     "UUSJCVUF
    1SFEJDUJPO͸γϯϓϧ͔ͭͻͱͭͷϞσϧͰࡁΉ
     4JNJMBSJUZ
    -FBSOJOH͸ը૾ͷಛੑΛٵऩͯ͘͠Εͯڧྗ͕ͩΧςΰϦຖͷϞσϧ͕ඞཁ
     4FNBOUJD
    4FHNFOUBUJPO͸ॲཧ͕ଟ͘ෳࡶ
     ,FZ
    QPJOU
    %FUFDUJPO͸ہॴಛ௃ྔͷநग़ख๏ͱͯ͠ظ଴Ͱ͖Δ
50. © 2017 VASILY,Inc. ࢀߟ  '
    :BOH
    "
    ,BMF
    :
    #VCOPW
    -
    4UFJO
    2
    8BOH
    )
    ,JBQPVS
    3
    1JSBNVUIV
    7JTVBM
    4FBSDI
    BU
    F#BZ
    
    IUUQTBSYJWPSHBCT
    
     "
    ;IBJ
    %
    ,JTMZVL
    :
    +JOH
    .
    'FOH
    &
    5[FOH
    +
    %POBIVF
    :
    -
    %V
    5
    %BSSFMM
    7JTVBM
    %JTDPWFSZ
    BU
    1JOUFSFTU
    
    IUUQTBSYJWPSHBCT 
     %
    4IBOLBS
    4
    /BSVNBODIJ
    "
    )
    "
    1
    ,PNQBMMJ
    ,
    $IBVEIVSZ
    %FFQ
    -FBSOJOH
    CBTFE
    -BSHF
    4DBMF
    7JTVBM
    3FDPNNFOEBUJPO
    BOE
    4FBSDI
    GPS
    &$PNNFSDF
    
    IUUQTBSYJWPSHBCT
     :
    4POH
    :
    -J
    #
    8V
    $
    $IFO
    -FBSOJOH
    6OJpFE
    &NCFEEJOH
    GPS
    "QQBSFM
    3FDPHOJUJPO
    
    IUUQTBSYJWPSHBCT
     4
    7JUUBZBLPSO
    ,
    :BNBHVDIJ
    "
    $
    #FSH
    5
    -
    #FSH
    3VOXBZ
    UP
    3FBMXBZ
    7JTVBM
    "OBMZTJT
    PG
    'BTIJPO
    
    IUUQUBNBSBCFSHDPN QBQFSTSVOXBZ@UP@SFBMXBZQEG
     ;
    -JV
    4
    :BO
    1
    -VP
    9
    8BOH
    9
    5BOH
    'BTIJPO
    -BOENBSL
    %FUFDUJPO
    JO
    UIF
    8JME
    
    IUUQTBSYJWPSHBCT
     +
    8BOH
    :
    4POH
    5
    -FVOH
    $
    3PTFOCFSH
    +
    8BOH
    +
    1IJMCJO
    #
    $IFO
    :
    8V
    -FBSOJOH
    'JOF(SBJOFE
    *NBHF
    4JNJMBSJUZ
    XJUI
    %FFQ
    3BOLJOH
    
    
    IUUQTBSYJWPSHBCT
     "
    )FSNBOT
    -
    #FZFS
    #
    -FJCF
    *O
    %FGFOTF
    PG
    UIF
    5SJQMFU
    -PTT
    GPS
    1FSTPO
    3F*EFOUJpDBUJPO
    
    IUUQTBSYJWPSHBCT
     '
    4DISP⒎
    %
    ,BMFOJDIFOLP
    +
    1IJMCJO
    'BDF/FU
    "
    6OJpFE
    &NCFEEJOH
    GPS
    'BDF
    3FDPHOJUJPO
    BOE
    $MVTUFSJOH
    
    IUUQTBSYJWPSHBCT  
51. © 2017 VASILY,Inc. ࢀߟ  :
    :BOH
    %
    3BNBOBO
    "SUJDVMBUFE
    QPTF
    FTUJNBUJPO
    XJUI
    qFYJCMF
    NJYUVSFTPGQBSUT
    
    IUUQTWJTJPOJDTVDJFEVQBQFST :BOH3@$713@:BOH3@$713@QEG
     ,
    :BNBHVDIJ
    .
    )
    ,JBQPVS
    5
    -
    #FSH
    1BQFS
    %PMM
    1BSTJOH
    3FUSJFWJOH
    4JNJMBS
    4UZMFT
    UP
    1BSTF
    $MPUIJOH
    *UFNT
    
    IUUQ WJTJPOJTUPIPLVBDKQdLZBNBHVQBQFSTZBNBHVDIJQBQFSQEG
     1
    %PMMBS
    $
    -
    ;JUOJDL
    4USVDUVSFE
    GPSFTUT
    GPS
    GBTU
    FEHF
    EFUFDUJPO
    
    IUUQTXXXSPCPUTPYBDVLdWHHSHTMJEFT ;JUOJDL%PMMBS&$$7FEHF#PYFT5BMLQEG
     4
    8FJ
    7
    3BNBLSJTIOB
    5
    ,BOBEF
    :
    4IFJLI
    $POWPMVUJPOBM
    1PTF
    .BDIJOFT
    
    IUUQXXXDWGPVOEBUJPOPSHPQFOBDDFTT DPOUFOU@DWQS@QBQFST8FJ@$POWPMVUJPOBM@1PTF@.BDIJOFT@$713@@QBQFSQEG