画像を用いたファッションアイテム検索/Image Retrieval for Fashion

Transcript

1. © 2017 VASILY,Inc.
   ը૾Λ༻͍ͨϑΝογϣϯΞΠςϜ
   ݕࡧ
   !UO7"4*-: *OD
   5PLZP8FCNJOJOH
   

   View Slide

2. © 2017 VASILY,Inc.
   ࣗݾ঺հ
   ‣ தଜ୓ຏ!UO
   ‣ σʔλαΠΤϯςΟετ
   ‣ ུྺɿ
   ΞΫηϯνϡΞ
   ݱࡏ 7"4*-:
   ‣ ۀ຿ɿ
   ػցֶशɾը૾ೝࣝ
   ΞϧΰϦζϜͷ։ൃ
   αʔϏε΁ͷద༻
   
   

   View Slide

3. © 2017 VASILY,Inc.
   Ҏ্ͷϑΝογϣϯ&$αΠτ͔Βͷ΂ສ఺Λ௒͑Δ঎඼Λܝࡌ
   ݄ؒສਓҎ্͕ར༻͢Δ೔ຊ࠷େڃͷϑΝογϣϯαΠτ
   

   View Slide

4. © 2017 VASILY,Inc.
   ໨࣍
   ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
   ϑΝογϣϯը૾ͷσʔλಛੑ
   ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
   جຊతͳߟ͑ํ
   "UUSJCVUF1SFEJDUJPO
   4JNJMBSJUZ-FBSOJOH
   4FNBOUJD4FHNFOUBUJPO
   ,FZQPJOU%FUFDUJPO
   
   

   View Slide

5. © 2017 VASILY,Inc.
   ໨࣍
   ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
   ϑΝογϣϯը૾ͷσʔλಛੑ
   ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
   جຊతͳߟ͑ํ
   "UUSJCVUF1SFEJDUJPO
   4JNJMBSJUZ-FBSOJOH
   4FNBOUJD4FHNFOUBUJPO
   ,FZQPJOU%FUFDUJPO
   
   

   View Slide

6. © 2017 VASILY,Inc.
   ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋
   ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔
   
   

   View Slide

7. © 2017 VASILY,Inc.
   ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋
   ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔
   ʻ.VOJDIʼϒϥ΢εʢ./5ʣ
   =
   ϒϥϯυɿϛϡχοΫʦ.6/*$)ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   Ϟʔυͳண͜ͳ͠Λ׎͑ΔϘϦϡʔϜεϦʔϒͷϒϥ΢εͰ͢ɻ
   କΛંΓฦͯ͠௚ઢతͳΧοτΛڧௐ͢Δ͜ͱͰɺ०ͷσΟςΠ
   ϧ΋ͻͱຯҧ͏ݟ͑ํʹɻγϯϓϧͳ਎ࠒͱͷόϥϯε΋ྑ޷Ͱ
   ͢ɻγϫʹͳΓʹ͍͘৳ॖૉࡐΛ࢖͓ͬͯΓɺσΠϦʔʹؾܰʹ
   औΓೖΕΒΕΔͷ͕ϙΠϯτɻ͖ͬ͢Γͱ։͍ͨ7ωοΫ͕େਓ
   ͷঁੑΒ͠͞Λԋग़͠·͢ɻ
   <8ݶఆ঎඼><΢Υογϟϒϧ>ϑϨΞεϦʔϒϒϥ΢ε
   =
   ϒϥϯυɿΦΫτʔϒϧʦ0$50#3&ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   τϨϯυΛҙࣝͨ͠ϑϨΞεϦʔϒτοϓεɻ͖ͬ͢Γͱൈ͚ײ
   ͷ͋ΔωοΫϥΠϯ΍όοΫγϣοτ͕ঁੑΒ͍͠งғؾͮ͘Γ
   ͷϙΠϯτɻ্඼͞΋͓͠ΌΕײ΋ซͤ࣋ͬͨҰ඼͸ɺͲΜͳੈ
   ୅ͷํ͔Β΋޷ධͰ͢ɻΦϑΟε΋σʔτ΋͓೚ͤͷσβΠϯͰ
   ͢ɻ
   ςΩετͰൺֱͨ͠৔߹
   
   

   View Slide

8. © 2017 VASILY,Inc.
   ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋
   ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔
   ʻ.VOJDIʼϒϥ΢εʢ./5ʣ
   =
   ϒϥϯυɿϛϡχοΫʦ.6/*$)ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   Ϟʔυͳண͜ͳ͠Λ׎͑ΔϘϦϡʔϜεϦʔϒͷϒϥ΢εͰ͢ɻ
   କΛંΓฦͯ͠௚ઢతͳΧοτΛڧௐ͢Δ͜ͱͰɺ०ͷσΟςΠ
   ϧ΋ͻͱຯҧ͏ݟ͑ํʹɻγϯϓϧͳ਎ࠒͱͷόϥϯε΋ྑ޷Ͱ
   ͢ɻγϫʹͳΓʹ͍͘৳ॖૉࡐΛ࢖͓ͬͯΓɺσΠϦʔʹؾܰʹ
   औΓೖΕΒΕΔͷ͕ϙΠϯτɻ͖ͬ͢Γͱ։͍ͨ7ωοΫ͕େਓ
   ͷঁੑΒ͠͞Λԋग़͠·͢ɻ
   <8ݶఆ঎඼><΢Υογϟϒϧ>ϑϨΞεϦʔϒϒϥ΢ε
   =
   ϒϥϯυɿΦΫτʔϒϧʦ0$50#3&ʧ
   ΧςΰϦɿϒϥ΢ε
   ৭ɿ྘ʢάϦʔϯʣ
   ΞΠςϜઆ໌ɿ
   τϨϯυΛҙࣝͨ͠ϑϨΞεϦʔϒτοϓεɻ͖ͬ͢Γͱൈ͚ײ
   ͷ͋ΔωοΫϥΠϯ΍όοΫγϣοτ͕ঁੑΒ͍͠งғؾͮ͘Γ
   ͷϙΠϯτɻ্඼͞΋͓͠ΌΕײ΋ซͤ࣋ͬͨҰ඼͸ɺͲΜͳੈ
   ୅ͷํ͔Β΋޷ධͰ͢ɻΦϑΟε΋σʔτ΋͓೚ͤͷσβΠϯͰ
   ͢ɻ
   ςΩετͰൺֱͨ͠৔߹
   କʹؔ͢Δઆ໌
   ϑϨΞεϦʔϒ
   WTϘϦϡʔϜεϦʔϒʁ
   ۗʹؔ͢Δઆ໌
   ൈ͚ײͷ͋ΔωοΫϥΠϯͱ͸ʁ
   
   

   View Slide

9. © 2017 VASILY,Inc.
   ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋
   ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔
   ը૾Ͱൺֱͨ͠৔߹
   
   

   View Slide

10. © 2017 VASILY,Inc.
    ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋
    ͜ͷͭͷΞΠςϜͷ۠ผʹد༩͢Δ৘ใ͸Կ͔
    ը૾Ͱൺֱͨ͠৔߹
    
    

    View Slide

11. © 2017 VASILY,Inc.
    ΞΠςϜݕࡧʹ͓͚Δը૾ೝࣝͷՁ஋
    ΞΠςϜͷྨࣅ౓ΛධՁ͢Δ্Ͱը૾͸͔ܽͤͳ͍৘ใͰ͋Δ
    ‣ ΞΠςϜͷڞ௨఺΍ࠩ෼͕೺ѲͰ͖Δ
    ςΩετʹൺ΂ؚͯ·ΕΔ৘ใͷྔ͕ଟ͍
    ‣ ΞΠςϜͷը૾͸ίϯςΩετΛؚΜͰ͍Δ
    ը૾ΛݟΔ͚ͩͰར༻γʔϯ΍ίʔσΟωʔτ͕૝૾Ͱ͖Δࣄ͕͋Δ
    ‣ ϑΝογϣϯ༻ޠͷࣙॻ΍Φϯτϩδʔ͕ඞཁͳ͍
    ϑΝογϣϯ͸ྲྀߦʹහײͳ෼໺ͷͨΊɺࣙॻͷϝϯςͷ޻਺Λ࡟ݮ
    Ͱ͖Δ͜ͱͷϝϦοτ͸ඇৗʹେ͖͍
    ෳࡶͳ৘ใΛநग़Մೳͳը૾ೝٕࣝज़͸ϑΝογϣϯͱ૬ੑ͕ྑ͍
    
    

    View Slide

12. © 2017 VASILY,Inc.
    ໨࣍
    ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
    ϑΝογϣϯը૾ͷσʔλಛੑ
    ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
    جຊతͳߟ͑ํ
    "UUSJCVUF1SFEJDUJPO
    4JNJMBSJUZ-FBSOJOH
    4FNBOUJD4FHNFOUBUJPO
    ,FZQPJOU%FUFDUJPO
    
    

    View Slide

13. © 2017 VASILY,Inc.
    ϑΝογϣϯσʔλͷಛੑ
    
    ϑΝογϣϯͰѻ͏σʔλʹ͸υϝΠϯಛ༗ͷࣄ৘͕ଘࡏ͢Δ
    ΧςΰϦ΍ଐੑ
    ͷଟ༷ੑ
    ྫ
    ΧςΰϦ΍ଐੑͷछྨ͕ଟ͍ GBCMJDŊTUZMF
    
    ج४͕ᐆດͰਓखͰ΋൑ผ͕ࠔ೉
    ϓϧΦʔόʔγϟπ
    ͬͯͳײ͡Ͱ͍ͭ΋෰೰Ή
    شൃੑ
    εέʔϧ
    ࣭
    ؍఺
    Ψ΢νϣɾεΧϯπ໰୊
    നWTΦϑϗϫΠτ
    ϑΝογϣϯΞΠςϜ΍༻ޠ͸ೖΕସΘΓ͕ܹ͍͠
    ʮϑΝογϣϯʯʮྲྀߦʯͳͷͰ
    ສ఺೔ͷ৽ணΞΠςϜ
    ΦʔόʔΦʔϧαϩϖοτ
    &$αΠτͰѻ͏঎඼ͷଞɺ4/4΁౤ߘ͞ΕΔը૾΋
    ϑΝογϣϯը૾ʹؚ·ΕΔ΋ͷ͕͋Δ
    *OTUBHSBN 1JOUFSFTU
    ଟ༷ͳΧςΰϦͱ$POTVNFSHFOFSBUFEͳը૾
    ϥϕϧͷؒҧ͍΍ࣗ༝ա͗Δϋογϡλά
    આ໌
    

    View Slide

14. © 2017 VASILY,Inc.
    ϑΝογϣϯ෼໺Ͱѻ͏ը૾ͷྫ
    
    &$αΠτ
    $POTVNFS
    HFOFSBUFE
    ஔ͖ࡱΓ ண༻
    ιʔε
    

    View Slide

15. © 2017 VASILY,Inc.
    ໨࣍
    ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
    ϑΝογϣϯը૾ͷσʔλಛੑ
    ϑΝογϣϯΞΠςϜݕࡧͷݚڀࣄྫ
    جຊతͳߟ͑ํ
    "UUSJCVUF1SFEJDUJPO
    4JNJMBSJUZ-FBSOJOH
    4FNBOUJD4FHNFOUBUJPO
    ,FZQPJOU%FUFDUJPO
    
    

    View Slide

16. © 2017 VASILY,Inc.
    جຊతͳߟ͑ํ
    ϑΝογϣϯը૾ͷݕࡧ͸*NBHF3FUSJFWBMͱ͍͏ΑΓ*OTUBODF3FUSJFWBM
    
    ‣ ը૾͸ඇઢܗؔ਺ʹΑͬͯಛ௃্ۭؒͷ఺
    ʹࣹӨ͞ΕΔ
    ‣ ը૾ͷυϝΠϯʹؔ܎ͳ͘ɺಉ͡ΞΠςϜ͸
    ۙ͘ͷ఺ʹࣹӨ͢ΔΑ͏ͳؔ਺͕͋Ε͹ྑ͍
    ‣ ্ड़ͷཁ݅Λຬͨؔ͢਺ΛʮֶशʯʹΑͬͯ
    ֫ಘ͢Δ
    CNN
    CNN
    ݕࡧΫΤϦ ඇઢܗؔ਺ ಛ௃ۭؒ
    Ξϓϩʔν
    ‣ ಉ͡ΞΠςϜΛಉ͡Ͱ͋Δͱಉఆ͢Δ
    ‣ ΞΠςϜͷมܗ΍എܠ͸ແࢹ͢Δ
    *OTUBODF3FUSJFWBM
    

    View Slide

17. © 2017 VASILY,Inc.
    ݚڀࣄྫ
    
    ख๏͸༷ʑ͋Δ͕ɺओʹಛ௃நग़ͷํ๏͕ҟͳΔ
    :BOH
    ;IBJ
    ,FZXPSET
    ൑ผλεΫͷֶशͰಘΒΕΔજࡏঢ়ଶΛ
    ಛ௃ྔͱ͢Δ
    LFZQPJOUճؼλεΫͷֶशͰಘΒΕΔ
    જࡏঢ়ଶΛಛ௃ྔͱ͢Δ
    ΞΠςϜಉ࢜ͷྨࣅ౓Λֶश͢Δ
    ྖҬ෼ׂͰಘΒΕͨྖҬ͔Βہॴಛ௃ྔ
    Λநग़ͯ͠ൺֱ͢Δ
    "UUSJCVUF1SFEJDUJPO )BTIJOH
    'BTIJPO-BOENBSL%FUFDUJPO
    4IBOLBS
    4POH
    7JUUBZBLPSO
    -JV
    ֓ཁ
    4FNBOUJD4FHNFOUBUJPO 'FBUVSF
    &YUSBDUJPO
    5SJQMFUMPTT 4JNJMBSJUZ-FBSOJOH
    ख๏
    

    View Slide

18. © 2017 VASILY,Inc.
    "UUSJCVUF1SFEJDUJPO
    

    View Slide

19. © 2017 VASILY,Inc.
    7JTVBM4FBSDIBUF#BZ :BOH
    
    
    ‣ F#BZͷը૾ݕࡧγεςϜʹؔͯ͠ɺΞϧΰϦζϜ΍ΞʔΩςΫνϟΛ঺հ
    ‣ ΧςΰϦ༧ଌλεΫ΍ଐੑ༧ଌλεΫͷ݁ՌΛݕࡧʹԠ༻͍ͯ͠Δ
    

    View Slide

20. © 2017 VASILY,Inc.
    7JTVBM4FBSDIBUF#BZ :BOH
    
    
    ‣ $PSF7JTJPO4FSWJDF͕ը૾ͷಛ௃ྔநग़Λߦ͏
    ‣ ը૾΍ಛ௃ྔΛͦͷ··อଘ͢ΔͷͰ͸ͳ͘ɺϋογϡ஋Λܭࢉͯ͠อଘ͢Δ
    ‣ )BTI(FOFSBUJPO
    ‣ $BUFHPSZ3FDPHOJUJPO
    ‣ "TQFDU1SFEJDUJPO
    ը૾ʹؔ͢Δɹ
    ίϯϙʔωϯτ
    

    View Slide

21. © 2017 VASILY,Inc.
    0
    1
    0
    1
    0
    1
    )BTI(FOFSBUJPO
    
    ‣ ΧςΰϦ൑ผ໰୊Λ௨ͯ͠ϋογϡؔ਺Λֶश͢Δ
    ‣ ςετ࣌͸׆ੑԽؔ਺ͷग़ྗΛᮢ஋Ͱ஋Խͯ͠ը૾ͷϋογϡ஋ͱ͢Δ
    )BNNJOHڑ཭ͰൺֱՄೳʹͳΓߴ଎
    0
    1 4JHNPJEؔ਺ͷग़ྗΛ
    ద౰ͳᮢ஋Ͱ஋Խ͢Δ
    

    View Slide

22. © 2017 VASILY,Inc.
    "TQFDU1SFEJDUJPOBOE3FSBOLJOH
    
    ‣ ΞΠςϜͷ"TQFDU͸9(#PPTUͰ൑ผ͢Δ
    ‣ "TQFDUͷྨࣅ౓ͱը૾ͷ)BNNJOHڑ཭ͷઢܗ݁߹Ͱ࠷ऴతͳ4DPSFΛܭࢉ͢Δ
    ai
    S = Sappearance + (1 )Saspect
    Saspect =
    1
    Pn
    i=1
    wi
    n
    X
    i=1
    m
    X
    j=1
    wiI(aq
    i
    = aj)
    )BNNJOHڑ཭ʹجͮ͘4DPSF
    ‣ ΫΤϦͱݕࡧର৅ͷ"TQFDUͷҰக਺ʹґଘͯ͠4DPSF͕ܾ·Δ
    ‣ "TQFDUͷॏཁ౓ʹ͸܏͕͍͍ࣼͭͯΔ
    ‣ ߪೖʹޮ͍ͯ͘Δ"TQFDU΄ͱॏཁ౓͕େ͖͘ɺ͜ͷ஋͸
    ϋʔυίʔυ͞Ε͍ͯΔ
    

    View Slide

23. © 2017 VASILY,Inc.
    ॴײ
    ‣ "UUSJCVUF1SFEJDUJPO͚ͩͰΞΠςϜݕࡧ͸࣮ݱͰ͖Δͷ͔
    ༧ଌͨ͠"TQFDUʹΑΔ3FSBOLJOHΛߦ͍ͬͯΔ
    ೖྗը૾ͷυϝΠϯʹؔͯ͠ݴٴ͕ͳ͍
    ‣ λεΫࣗମ͸ඇৗʹγϯϓϧ
    ൑ผλεΫ͸ൺֱత؆୯ʹֶशͰ͖Δ
    ‣ εέʔϧͤ͞ΔࡍͷࢀߟʹͳΔ
    ͜ͷ࢓૊͸F#BZͷνϟοτϘοτʹར༻͞Ε͍ͯΔ
    େྔͷϦΫΤετΛϦΞϧλΠϜʹॲཧ͢Δೳྗ͕ٻΊΒΕΔ
    
    

    View Slide

24. © 2017 VASILY,Inc.
    4JNJMBSJUZ-FBSOJOH
    

    View Slide

25. © 2017 VASILY,Inc.
    %FFQ-FBSOJOHCBTFE-BSHF4DBMF7JTVBM3FDPNNFOEBUJPOBOE4FBSDIGPS&
    $PNNFSDF 4IBOLBS
    
    
    ‣ ΠϯυͷϑΝογϣϯ&$αΠτͷը૾ݕࡧγεςϜ
    ‣ ΞΠςϜͷྨࣅ౓Λֶश͍ͯ͠Δ
    

    View Slide

26. © 2017 VASILY,Inc.
    Ϟσϧͷ֓ཁ
    
    ‣ ਂ͍ύεͱઙ͍ύεΛ૊Έ߹ΘͤͨωοτϫʔΫʹΑΔಛ௃நग़
    ‣ ΞΠςϜͷྨࣅ౓͸5SJQMFUMPTTͰධՁ͍ͯ͠Δ
    'JOF(SBJOFE*NBHF4JNJMBSJUZ 5SJQMFUMPTT
    

    View Slide

27. © 2017 VASILY,Inc.
    'JOF(SBJOFE*NBHF4JNJMBSJUZ
    ‣ ਂ͍ωοτϫʔΫͱઙ͍ωοτϫʔΫΛ૊Έ߹ΘͤͨϞσϧ
    ‣ ը૾ͷෳࡶͳߏ଄ͱ୯७ͳߏ଄Λಉ࣌ʹѻ͏ͨΊͷ޻෉
    ‣ ਂ͍ωοτϫʔΫ
    ը૾ͷෳࡶͳߏ଄Λೝࣝ͢Δ
    େ·͔ͳྠֲͳͲ
    ൑ผλεΫͰ׆༂
    ‣ ઙ͍ωοτϫʔΫ
    ը૾ͷ୯७ͳߏ଄Λೝࣝ͢Δ
    ৭΍໛༷ͳͲ
    ఻౷తͳಛ௃நग़ख๏ʹ͍ۙ
    ಉ͡ΞΠςϜͰ͋Δͱೝ͍ࣝͨ͠
    ҧ͏ΞΠςϜͰ͋Δͱೝ͍ࣝͨ͠
    

    View Slide

28. © 2017 VASILY,Inc.
    5SJQMFUMPTT
    
    Anchor
    CNN
    CNN
    CNN
    Positive
    Negative
    Embedding
    Embedding
    margin
    Anchor
    Positive
    Negative
    ֶश
    ‣ 5SJQMFUMPTT͸"ODIPS 1PTJUJWF /FHBUJWFͷ૊Λೖྗͱͯͦ͠ΕͧΕͷؒͷڑ཭ΛධՁ͢Δ
    ‣ "ODIPSɾ1PTJUJWFʹରͯ͠"ODIPSɾ/FHBUJWFؒͷڑ཭͕ҰఆҎ্େ͖͘ͳΔΑ͏ʹྗ͕͔͔Δ
    

    View Slide

29. © 2017 VASILY,Inc.
    5SJQMFUMPTT
    
    margin AnchorɾPositive
    ؒͷڑ཭
    AnchorɾNegative
    ؒͷڑ཭
    ‣ 5SJQMFUMPTT͸"ODIPS 1PTJUJWF /FHBUJWFͷ૊Λೖྗͱͯͦ͠ΕͧΕͷؒͷڑ཭ΛධՁ͢Δ
    ‣ "ODIPSɾ1PTJUJWFʹରͯ͠"ODIPSɾ/FHBUJWFؒͷڑ཭͕ҰఆҎ্େ͖͘ͳΔΑ͏ʹྗ͕͔͔Δ
    ๬·͘͠ͳ͍ঢ়ଶ ๬·͍͠ঢ়ଶ
    loss
    0 ↵ D(a, n) D(a, p)
    

    View Slide

30. © 2017 VASILY,Inc.
    5SJQMFUMPTTͷֶश͸ऩଋͤ͞Δ͜ͱ͕೉͍͠ͷͰ޻෉͕ඞཁ
    
    ղܾࡦ
    ‣ #BUDIIBSE
    )FSNBOT
    ϛχόονͷதͰ࠷΋"ODIPSʹࣅ͍ͯΔෛྫͱ
    ࠷΋"ODIPSʹࣅ͍ͯͳ͍ਖ਼ྫΛαϯϓϦϯά͢Δ
    ‣ 4FNJIBSEOFHBUJWFNJOJOH
    4DISP⒎
    ֶशޮՌ͕͋Δఔ౓ظ଴Ͱ͖ɺֶ͔ͭश͕೉͘͠
    ͳ͍ෛྫΛαϯϓϦϯά͢Δ
    Embedding
    Embedding
    margin
    Anchor
    Positive
    Negative
    Embedding
    ظ଴͢Δ
    ঢ়ଶ
    margin
    ๬·͘͠
    ͳ͍ঢ়ଶ
    loss
    0 ↵ D(a, n) D(a, p)
    ֶश
    

    View Slide

31. © 2017 VASILY,Inc.
    -FBSOJOH6OJpFE&NCFEEJOHGPS"QQBSFM3FDPHOJUJPO 4POH
    
    
    ‣ (PPHMF͕ఏҊ͍ͯ͠ΔϑΝογϣϯΞΠςϜݕࡧγεςϜ
    ‣ ෳ਺ͷΧςΰϦΛڞ௨ͷϞσϧͰѻ͏͜ͱ͕Ͱ͖Δ
    

    View Slide

32. © 2017 VASILY,Inc.
    ֶशޮՌͷߴ͍ෛྫΛαϯϓϦϯά͢Δ
    
    Negative
    Positive
    Anchor
    Semi-hard
    Negative
    margin
    ‣ ϕʔγοΫͳαϯϓϦϯά
    "ODIPSͱҟͳΔΞΠςϜΛҰ༷ʹ
    αϯϓϦϯά͢Δ
    "ODIPSͱ໌Β͔ʹҟͳΔΞΠςϜ
    ͕αϯϓϧ͞Εͨ৔߹ɺֶशͷ
    ඞཁ͕ͳ͍
    "ODIPSͱࣅ͍͗ͯ͢ΔΞΠςϜ͕
    αϯϓϧ͞Εͨ৔߹ɺѱ͍ہॴղ
    ʹτϥοϓ͞ΕΔ
    ֶशޮ཰͕ѱ͍
    ‣ 4FNJIBSEOFHBUJWFNJOJOH
    "ODIPSͱҟͳΔΞΠςϜΛҎԼ
    ͷ੍໿Λຬͨ͢αϯϓϧΛબ୒
    ͢Δ
    "ODIPS1PTJUJWFؒͷڑ཭ΑΓ
    "ODIPS/FHBUJWFؒͷڑ཭͕
    େ͖͍
    ্هΛຬ্ͨͨ͠Ͱ"ODIPSͱͷ
    ڑ཭͕࠷΋খ͍͞
    xn
    i
    = argmin
    x
    n
    i
    ||
    f
    (
    xa
    i
    )
    f
    (
    xn
    i
    )||2
    2
    s.t.
    ||
    f
    (
    x
    a
    i
    )
    f
    (
    x
    p
    i
    )||2
    2 <
    ||
    f
    (
    x
    a
    i
    )
    f
    (
    x
    n
    i
    )||2
    2
    ֶशޮ཰͕ߴֶ͘श͕༰қ
    ||
    f
    (
    x
    a
    i
    )
    f
    (
    x
    p
    i
    )||2
    

    View Slide

33. © 2017 VASILY,Inc.
    ෳ਺ͷֶशࡁΈϞσϧ͸ৠཹͯ͠ͻͱͭͷϞσϧʹ౷߹͢Δ
    
    tops
    bottoms
    bags,…
    MPTT
    $//
    ɾ
    ɾ
    ɾ
    ɾ
    ɾ
    ɾ
    ɾ
    ɾ
    ɾ
    MMPTTͰධՁ
    

    View Slide

34. © 2017 VASILY,Inc.
    ॴײ
    ‣ 5SJQMFUMPTTΛ༻ֶ͍ͨश͸೉͍͠
    ൑ผλεΫͳͲΛ՝͢ͱߋʹ೉қ౓͕ߴ͘ͳΔ
    ֶशத͸"ODIPS 1PTJUJWF /FHBUJWFؒͷڑ཭Λৗʹ֬ೝͨ͠΄͏͕ྑ͍
    ඞཁʹԠͯ͡ίετؔ਺΍5SJQMFUͷαϯϓϦϯάΛ޻෉͢Δඞཁ͕͋Δ
    ‣ 'JOF(SBJOFE*NBHF4JNJMBSJUZ͸ศར
    طଘͷωοτϫʔΫΛ༰қʹ֦ுͰ͖Δ
    *20/ͷσʔλͰ΋࣮ࡍʹվળΛ֬ೝ
    ‣ ΧςΰϦຖʹϞσϧΛ࡞Δඞཁ͕͋Δ
    ϑΝογϣϯΞΠςϜ͸ΧςΰϦ਺͕ଟ͍ͷͰେม
    
    deep
    shallow
    deep+shallow
    

    View Slide

35. © 2017 VASILY,Inc.
    4FNBOUJD4FHNFOUBUJPO
    

    View Slide

36. © 2017 VASILY,Inc.
    3VOXBZUP3FBMXBZ7JTVBM"OBMZTJTPG'BTIJPO 7JUUBZBLPSO
    
    
    ‣ ϑΝογϣϯγϣʔͷը૾͔Β֗தͰࡱӨ͞Εͨը૾Λݕࡧ͢Δ
    ‣ ྖҬ෼ׂʹΑΔը૾ͷύʔεͱɺྖҬ͔Βͷಛ௃நग़Λߦ͍ͬͯΔ
    

    View Slide

37. © 2017 VASILY,Inc.
    ॲཧͷྲྀΕ
    
    4FNBOUJD
    4FHNFOUBUJPO
    'FBUVSF&YUSBDUJPO
    -JOFBS47.
    1PTF&TUJNBUJPO
    ‣ :BOHΛར༻ͯ͠ϙʔζਪఆͱύʔπͷݕग़λεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷ#PVOEJOHCPY͔Βநग़͢Δ
    ‣ :BNBHVDIJΛར༻ͯ͠ྖҬ෼ׂͱྖҬຖͷΧςΰϦ൑ผλεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷྖҬ͔Βநग़͢Δ
    ‣ ෼ׂͨ͠ྖҬ͔Β༷ʑͳಛ௃ྔΛநग़͢Δ
    ‣ छྨͷը૾ΛαϯϓϦϯάͯ͠5VQMFΛߏ੒͢Δ
    ‣ αϯϓϦϯά͞Εͨ5VQMFʹ͍ͭͯɺࣅ͍ͯΔࣅ͍ͯͳ͍Λ൑ผ͢Δ
    

    View Slide

38. © 2017 VASILY,Inc.
    1PTF&TUJNBUJPO
    
    1PTF&TUJNBUJPO
    4FNBOUJD
    4FHNFOUBUJPO
    'FBUVSF&YUSBDUJPO
    -JOFBS47.
    ‣ :BOHΛར༻ͯ͠ϙʔζਪఆͱύʔπͷݕग़λεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷ#PVOEJOHCPY͔Βநग़͢Δ
    

    View Slide

39. © 2017 VASILY,Inc.
    4FNBOUJD4FHNFOUBUJPO
    
    1PTF&TUJNBUJPO
    4FNBOUJD
    4FHNFOUBUJPO
    'FBUVSF&YUSBDUJPO
    -JOFBS47.
    ‣ :BNBHVDIJΛར༻ͯ͠ྖҬ෼ׂͱྖҬຖͷΧςΰϦ൑ผλεΫΛղ͘
    ‣ ޙଓͷॲཧʹ༻͍Δಛ௃ྔ͸ͦΕͧΕͷྖҬ͔Βநग़͢Δ
    

    View Slide

40. © 2017 VASILY,Inc.
    4FNBOUJD4FHNFOUBUJPO
    
    1PTF&TUJNBUJPO
    4FNBOUJD
    4FHNFOUBUJPO
    'FBUVSF&YUSBDUJPO
    -JOFBS47.
    ‣ 3FUSJFWBM
    ύʔεࡁΈσʔληοτ͔Βࣅ
    ͍ͯΔը૾Λݕࡧ͢Δ
    ‣ 1BSTJOH
    ݕࡧͨ͠ը૾ͱͦΕʹඥͮ͘λ
    άΛύʔεʹར༻͢Δ
    

    View Slide

41. © 2017 VASILY,Inc.
    'FBUVSF&YUSBDUJPO
    
    1PTF&TUJNBUJPO
    4FNBOUJD
    4FHNFOUBUJPO
    'FBUVSF&YUSBDUJPO
    -JOFBS47.
    DPMPS
    ಛ௃ྔ
    ‣ 3(#
    ‣ -BC
    ॲཧ
    ‣ લܠྖҬ͔ΒΧϥʔɹɹ
    ώετάϥϜΛ࡞੒
    UFYUVSF
    ‣ .3
    ‣ )0(
    TIBQF
    ‣ CJOBSZNBTL
    ‣ %PMMBS
    QBSTF
    ‣ QFSDFOUBHFPG
    FBDIJUFNQSFTFOU
    TUZMF
    EFTDSJQUPS
    ‣ :BNBHVDIJ
    ‣ લܠྖҬ͔Βநग़ͯ͠ɹ
    ྔࢠԽ
    ‣ લܠྖҬΛࣔ͢CJOBSZ
    NBTLͱFEHFNBQ
    ‣ ΧςΰϦͷଘࡏ֬཰Λ
    ද֬͢཰ϕΫτϧ
    ‣ छྨͷಛ௃ྔܭ
    ࣍ݩΛ1$"Ͱ࣍ݩʹ
    

    View Slide

42. © 2017 VASILY,Inc.
    ॴײ
    ‣ ݕࡧΛ࣮ݱ͢Δ·Ͱʹඞཁͳॲཧ͕ଟ͗͢Δ
    ͦΕͧΕͷॲཧͷਫ਼౓͸ͲΕ΄Ͳ͔
    &OEUP&OEͰ࠷దԽͰ͖ͳ͍͔
    ‣ ಛ௃ྔͷ࡞Γํ͕ࢀߟʹͳΔ
    ϑΝογϣϯͷ෼໺ʹ͓͍ͯޮՌతͳಛ௃ྔʹؔ͢Δࢿྉ
    ෰ͷྖҬ͕ਖ਼͘͠4FHNFOUBUJPOͰ͖Ε͹ݕࡧ༻ͷಛ௃ྔ΍ϥϯΩϯάΞϧΰϦζϜ͸γϯϓϧͰ΋ྑ͍
    ‣ ΫϩευϝΠϯݕࡧ͸Մೳ͔
    ࿦จͩͱண༻ը૾͔Βண༻ը૾ͷΈ
    ஔ͖ࡱΓը૾ʹ֦ு͢ΔͨΊʹ͸ಛ௃ྔΛ࠶౓ઃܭ͢Δඞཁ͕͋ΔͱࢥΘΕΔ
    
    

    View Slide

43. © 2017 VASILY,Inc.
    ,FZQPJOU%FUFDUJPO
    

    View Slide

44. © 2017 VASILY,Inc.
    'BTIJPO-BOENBSL%FUFDUJPOJOUIF8JME -JV
    
    
    ‣ ϑΝογϣϯΞΠςϜͷը૾͔Β,FZQPJOUͷ࠲ඪ΍7JTJCMF*OWJTJCMFΛ༧ଌ͢ΔλεΫ
    ‣ ೖྗ͢Δը૾͸4IPQJNBHF΋͘͠͸$POTVNFSHFOFSBUFEJNBHFΛ૝ఆͯ͠Δ
    

    View Slide

45. © 2017 VASILY,Inc.
    -BOENBSLEFUFDUJPOΛ࣮ݱ͢ΔϞσϧ
    
    ‣ $//Λଟஈʹͯ͠ɺ4UBHFҎ߱͸લͷग़ྗΛҾ͖ܧ͙ܗʹͳ͍ͬͯΔ
    ‣ ࠲ඪͷճؼͷଞɺ1TFVEP-BCFMͷճؼͱ7JTJCJMJUZͷ൑ผΛಉ࣌ʹղ͍͍ͯΔ
    ‣ ֤4UBHFͷසग़ύλʔϯʹؔ͢Δ৘ใΛ1TFVEP-BCFMͱ͍͏ܗͰऔΓࠐΜͰ͍Δ
    

    View Slide

46. © 2017 VASILY,Inc.
    ֤4UBHFͱ1TFVEP-BCFMͷ໾ׂ
    
    4UBHF
    ༧ଌ͢Δ΋ͷ ,FZQPJOUͷେ·͔ͳ࠲ඪ
    1TFVEP-BCFM
    4UBHF
    4UBHFͷ༧ଌͱਖ਼ղͷͣΕ
    Φϑηοτ
    
    Ͳͷ࢟੎ʹͲΕ͚͍͔ͩۙ
    ࢟੎㲈LFZQPJOUͷ࠲ඪ
    Ͳͷ޲͖ʹͲΕ͚ͩमਖ਼
    ͢Ε͹Α͍͔
    Φϑηοτͷύλʔϯ
    
    4UBHF
    4UBHFͷ༧ଌͱਖ਼ղͷͣΕ
    Φϑηοτ
    
    શମͷΦϑηοτͱݸʑͷΦϑηοτ
    ͷؔ܎
    සग़ύλʔϯͱͷ
    ࠩ෼Λճؼ͢Δ
    

    View Slide

47. © 2017 VASILY,Inc.
    ݕࡧ΁ͷద༻
    
    ‣ ֶशࡁΈϞσϧ͔Βநग़ͨ͠ಛ௃ྔͷMڑ཭ΛݕࡧλεΫʹద༻͢Δ
    ‣ ಛ௃ྔͱͯ͠༻͍Δͷ͸͓ͦΒ͘7((ͷग़ޱʹ౰ͨΔ࣍ݩͷϕΫτϧ ࿦จதʹৄࡉͳهࡌͳ͠
    
    7((
    3FUSJFWBM
    "UUSJCVUF
    1SFEJDUJPO
    

    View Slide

48. © 2017 VASILY,Inc.
    ॴײ
    ‣ ࠶ݱ͠ͳ͍
    ֶशΛ௥ࢼͯ͠Έ͕ͨ࿦จͷΑ͏ͳਫ਼౓Λୡ੒Ͱ͖ͳ͔ͬͨ
    ࿦จதʹॻ͔Ε͍ͯͳ͍ҋͷςΫχοΫ͕ଟͦ͏
    ‣ -BOENBSL͸఺ͷ࠲ඪΛճؼ͍ͯ͠Δ
    ϙʔζਪఆͷ෼໺ͰҰൠతͳͷ͸ώʔτϚοϓͷճؼ
    ώʔτϚοϓͷճؼͰ΋ղ͚ͦ͏
    ‣ ,FZQPJOUͷݕग़λεΫ͸΋ͬͱ੝Γ্͕ͬͯཉ͍͠
    ͏·͘ݕग़Ͱ͖ΔΑ͏ʹͳΕ͹มܗʹڧ͍ݕࡧγεςϜ͕ߏஙͰ͖Δ
    ϑΝογϣϯ෼໺ͱ૬ੑྑͦ͞͏
    
    ఺ͷ࠲ඪΛճؼ ֶशࡁΈϞσϧ
    
    ώʔτϚοϓΛճؼ 8FJ
    
    

    View Slide

49. © 2017 VASILY,Inc.
    ·ͱΊ
    
    ‣ ϑΝογϣϯΞΠςϜݕࡧͱը૾ೝࣝ
    ϑΝογϣϯ෼໺Ͱը૾ೝࣝΛѻ͏ҙٛʹ͍ͭͯ
    ѻ͏ը૾σʔλͷಛੑʹ͍ͭͯ
    ‣ ݚڀࣄྫ
    "UUSJCVUF1SFEJDUJPO͸γϯϓϧ͔ͭͻͱͭͷϞσϧͰࡁΉ
    4JNJMBSJUZ-FBSOJOH͸ը૾ͷಛੑΛٵऩͯ͘͠Εͯڧྗ͕ͩΧςΰϦຖͷϞσϧ͕ඞཁ
    4FNBOUJD4FHNFOUBUJPO͸ॲཧ͕ଟ͘ෳࡶ
    ,FZQPJOU%FUFDUJPO͸ہॴಛ௃ྔͷநग़ख๏ͱͯ͠ظ଴Ͱ͖Δ
    

    View Slide

50. © 2017 VASILY,Inc.
    ࢀߟ
    ':BOH ",BMF :#VCOPW -4UFJO 28BOH ),JBQPVS 31JSBNVUIV7JTVBM4FBSDIBUF#BZIUUQTBSYJWPSHBCT
    ";IBJ %,JTMZVL :+JOH .'FOH &5[FOH +%POBIVF :-%V 5%BSSFMM7JTVBM%JTDPWFSZBU1JOUFSFTUIUUQTBSYJWPSHBCT
    
    %4IBOLBS 4/BSVNBODIJ ")" 1,PNQBMMJ ,$IBVEIVSZ%FFQ-FBSOJOHCBTFE-BSHF4DBMF7JTVBM3FDPNNFOEBUJPOBOE4FBSDI
    GPS&$PNNFSDFIUUQTBSYJWPSHBCT
    :4POH :-J #8V $$IFO-FBSOJOH6OJpFE&NCFEEJOHGPS"QQBSFM3FDPHOJUJPOIUUQTBSYJWPSHBCT
    47JUUBZBLPSO ,:BNBHVDIJ "$#FSH 5-#FSH3VOXBZUP3FBMXBZ7JTVBM"OBMZTJTPG'BTIJPOIUUQUBNBSBCFSHDPN
    QBQFSTSVOXBZ@UP@SFBMXBZQEG
    ;-JV 4:BO 1-VP 98BOH 95BOH'BTIJPO-BOENBSL%FUFDUJPOJOUIF8JMEIUUQTBSYJWPSHBCT
    +8BOH :4POH 5-FVOH $3PTFOCFSH +8BOH +1IJMCJO #$IFO :8V-FBSOJOH'JOF(SBJOFE*NBHF4JNJMBSJUZXJUI%FFQ3BOLJOH
    IUUQTBSYJWPSHBCT
    ")FSNBOT -#FZFS #-FJCF*O%FGFOTFPGUIF5SJQMFU-PTTGPS1FSTPO3F*EFOUJpDBUJPOIUUQTBSYJWPSHBCT
    '4DISP⒎ %,BMFOJDIFOLP +1IJMCJO'BDF/FU"6OJpFE&NCFEEJOHGPS'BDF3FDPHOJUJPOBOE$MVTUFSJOHIUUQTBSYJWPSHBCT
    
    
    

    View Slide

51. © 2017 VASILY,Inc.
    ࢀߟ
    ::BOH %3BNBOBO"SUJDVMBUFEQPTFFTUJNBUJPOXJUIqFYJCMFNJYUVSFTPGQBSUTIUUQTWJTJPOJDTVDJFEVQBQFST
    :BOH3@$713@:BOH3@$713@QEG
    ,:BNBHVDIJ .),JBQPVS 5-#FSH1BQFS%PMM1BSTJOH3FUSJFWJOH4JNJMBS4UZMFTUP1BSTF$MPUIJOH*UFNTIUUQ
    WJTJPOJTUPIPLVBDKQdLZBNBHVQBQFSTZBNBHVDIJQBQFSQEG
    1%PMMBS $-;JUOJDL4USVDUVSFEGPSFTUTGPSGBTUFEHFEFUFDUJPOIUUQTXXXSPCPUTPYBDVLdWHHSHTMJEFT
    ;JUOJDL%PMMBS&$$7FEHF#PYFT5BMLQEG
    48FJ 73BNBLSJTIOB 5,BOBEF :4IFJLI$POWPMVUJPOBM1PTF.BDIJOFT IUUQXXXDWGPVOEBUJPOPSHPQFOBDDFTT
    DPOUFOU@DWQS@QBQFST8FJ@$POWPMVUJPOBM@1PTF@.BDIJOFT@$713@@QBQFSQEG
    
    

    View Slide